00000100:00100000:0.0:1746066728.969736:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3101 00000100:00100000:0.0:1746066728.969742:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882982305152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066728.975110:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066728.975354:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066728.975375:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982305280 00000100:00100000:0.0:1746066728.975412:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982305280 00000100:00100000:0.0:1746066728.975451:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982305536 00000100:00100000:0.0:1746066728.975453:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982305536 00000100:00100000:0.0:1746066728.975469:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15855 00000100:00100000:0.0:1746066728.975477:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:31905:x1830882982305280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066728.975496:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066728.975513:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa1c7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce16c expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.975566:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa1c7d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce16c expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.975577:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa1c7d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce16c expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.975590:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066728.975592:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066728.975595:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa1c76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce165 expref: 7 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.975600:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b400, rc 0) 00000100:00100000:0.0:1746066728.975615:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:31905:x1830882982305280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 140us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066728.975620:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15855 00000100:00100000:0.0:1746066728.976949:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984071552 00000100:00100000:0.0:1746066728.976952:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984071552 00000100:00100000:0.0:1746066728.977778:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984072576 00000100:00100000:0.0:1746066728.977781:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984072576 00000100:00100000:0.0:1746066728.977797:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13621 00000100:00100000:0.0:1746066728.977803:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3776:x1830882984071680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066728.977872:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882984071680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1274us total) trans 17179874020 rc 0/0 00000100:00100000:0.0:1746066728.977877:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13621 00000100:00100000:0.0:1746066728.979024:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13632 00000100:00100000:0.0:1746066728.979030:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3777:x1830882984071296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066728.979078:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066728.979080:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066728.979082:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066728.979083:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066728.979085:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066728.979111:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882984071296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (303us total) trans 17179874024 rc 0/0 00000100:00100000:0.0:1746066728.979115:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13632 00000100:00100000:0.0:1746066728.982745:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982305792 00000100:00100000:0.0:1746066728.982749:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982305792 00000100:00100000:0.0:1746066728.982779:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5672 00000100:00100000:0.0:1746066728.982785:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4ba1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:31915:x1830882982305792:12345-192.168.204.16@tcp:49:lfs.0 00000100:00100000:0.0:1746066728.982842:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4ba1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:31915:x1830882982305792:12345-192.168.204.16@tcp:49:lfs.0 Request processed in 57us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066728.982846:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5672 00000100:00100000:0.0:1746066728.986588:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982306048 00000100:00100000:0.0:1746066728.986597:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982306048 00000100:00100000:0.0:1746066728.986646:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5674 00000100:00100000:0.0:1746066728.986654:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:31917:x1830882982306048:12345-192.168.204.16@tcp:49:multiop.0 00000100:00100000:0.0:1746066728.986772:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:31917:x1830882982306048:12345-192.168.204.16@tcp:49:multiop.0 Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066728.986778:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5674 00000100:00100000:0.0:1746066728.989452:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982306304 00000100:00100000:0.0:1746066728.989461:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982306304 00000100:00100000:0.0:1746066728.989521:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15858 00000100:00100000:0.0:1746066728.989529:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:31915:x1830882982306304:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066728.989547:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066728.989564:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa1cae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce181 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.989651:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a800/0xf1867c21abfa1cb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066728.989665:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a800/0xf1867c21abfa1cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066728.989676:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a800/0xf1867c21abfa1cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066728.989698:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:0.0:1746066728.989702:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066728.989715:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a800/0xf1867c21abfa1cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066728.989735:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa1cae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce181 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.989763:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a800/0xf1867c21abfa1cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce181 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.989771:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066728.989774:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066728.989777:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a800, rc 0) 00000100:00100000:0.0:1746066728.989818:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:31915:x1830882982306304:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 290us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066728.989823:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15858 00000100:00100000:0.0:1746066728.995153:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982306560 00000100:00100000:0.0:1746066728.995157:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982306560 00000100:00100000:0.0:1746066728.995305:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13635 00000100:00100000:0.0:1746066728.995310:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+18:31917:x1830882982306560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066728.995326:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066728.995346:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa1cbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce188 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.995373:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa1bb2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0c4 expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066728.995381:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2200/0xf1867c21abfa1c4c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce149 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066728.995387:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfa1c14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce118 expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066728.995398:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066728.995400:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066728.995403:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa1cbc lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1892352->2027519] (req 1892352->2027519) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce188 expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066728.995431:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfa1c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce118 expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066728.995442:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfa1c14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce118 expref: 18 pid: 9592 timeout: 797 lvb_type: 1 00000100:00100000:0.0:1746066728.995453:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984073216:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066728.995514:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a2200/0xf1867c21abfa1c4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce149 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066728.995521:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2200/0xf1867c21abfa1c4c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce149 expref: 19 pid: 12255 timeout: 797 lvb_type: 1 00000100:00100000:0.0:1746066728.995527:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984073344:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066728.995549:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa1bb2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0c4 expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066728.995555:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa1bb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0c4 expref: 34 pid: 20361 timeout: 797 lvb_type: 1 00000100:00100000:0.0:1746066728.995567:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984073472:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066728.995578:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.001792:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.003547:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.003617:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.003657:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.003687:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982307456 00000100:00100000:0.0:1746066729.003694:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982307456 00010000:00010000:0.0:1746066729.003732:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfa1c14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce118 expref: 19 pid: 9592 timeout: 797 lvb_type: 1 00000100:00100000:0.0:1746066729.003766:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5901 00000100:00100000:0.0:1746066729.003773:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982307968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.003787:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.003807:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa1bb2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0c4 expref: 35 pid: 20361 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746066729.004048:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa1bb2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0c4 expref: 35 pid: 20361 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746066729.004073:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.004223:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982307968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 446us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.004230:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5901 00000100:00100000:0.0:1746066729.014664:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.017500:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.017520:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.017530:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.018965:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3110 00000100:00100000:0.0:1746066729.018975:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+24:2013:x1830882982309504:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066729.019009:0:9596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa1ced lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.019020:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.019021:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.019025:0:9596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa1ced lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.019035:0:9596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa1ced lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.019721:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3111 00000100:00100000:0.0:1746066729.019728:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2013:x1830882982309760:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066729.019747:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfa1cf4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.019756:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.019757:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.019760:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfa1cf4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.019768:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3c00/0xf1867c21abfa1cf4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.043958:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.048965:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.053094:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.055540:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982310528:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6349us (6585us total) trans 17179874025 rc 0/0 00000100:00100000:0.0:1746066729.055549:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 613 00002000:00100000:0.0:1746066729.055559:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1892352->2027519) req@ffff8800936cce00 x1830882982310528/t17179874025(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:135/0 lens 488/448 e 0 to 0 dl 1746066740 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066729.055568:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936cce00 with x1830882982310528 ext(1892352->2027519) 00010000:00010000:0.0:1746066729.055578:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa1cbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce188 expref: 20 pid: 3528 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.055592:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa1cbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce188 expref: 20 pid: 3528 timeout: 797 lvb_type: 0 00002000:00010000:0.0:1746066729.055598:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936cce00 00000100:00100000:0.0:1746066729.059338:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.070709:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.072719:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.076846:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.076921:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.076957:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.082077:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.085141:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.085185:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.085222:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.088355:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.088487:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.089997:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.092394:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.092942:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.093013:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.097427:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.104128:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.104219:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.108851:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.110834:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.110858:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.110915:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.110933:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982313856 00000100:00100000:0.0:1746066729.110938:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982313856 00010000:00010000:0.0:1746066729.110961:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa1c0d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce12d expref: 21 pid: 12233 timeout: 797 lvb_type: 1 00000100:00100000:0.0:1746066729.111002:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982313984 00000100:00100000:0.0:1746066729.111004:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982313984 00010000:00010000:0.0:1746066729.111013:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa1bab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0d9 expref: 33 pid: 20361 timeout: 797 lvb_type: 1 00000100:00100000:0.0:1746066729.111024:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982313728 00000100:00100000:0.0:1746066729.111026:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982313728 00010000:00010000:0.0:1746066729.111032:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa1bce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0e7 expref: 18 pid: 9591 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746066729.111046:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5917 00000100:00100000:0.0:1746066729.111052:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882982313856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.111062:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.111083:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa1c0d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce12d expref: 21 pid: 12233 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746066729.111091:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa1c0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce12d expref: 21 pid: 12233 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746066729.111112:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.111137:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882982313856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.111143:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5917 00000100:00100000:0.0:1746066729.111155:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5918 00000100:00100000:0.0:1746066729.111158:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982313984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.111164:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.111169:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa1bab lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0d9 expref: 33 pid: 20361 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746066729.111176:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa1bab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0d9 expref: 33 pid: 20361 timeout: 797 lvb_type: 1 00010000:00010000:0.0:1746066729.111185:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.111195:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982313984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 37us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.111201:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5918 00000100:00100000:0.0:1746066729.111208:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5919 00000100:00100000:0.0:1746066729.111212:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982313728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.111216:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.111221:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa1bce lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0e7 expref: 18 pid: 9591 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.111227:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa1bce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce0e7 expref: 18 pid: 9591 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.111236:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.111237:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.111242:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa1d2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1b9 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.111249:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa1d2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1b9 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.111271:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa1d2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1b9 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.111280:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936cdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984076416:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066729.111322:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.115235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.115272:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.115301:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.115328:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.115341:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.115366:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.119025:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.119080:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.124794:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4db5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984076544:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066729.124816:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.124870:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2014:x1830882982314880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4506us (5855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.124894:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5920 00000100:00100000:0.0:1746066729.133971:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982315776 00000100:00100000:0.0:1746066729.133981:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982315776 00000100:00100000:0.0:1746066729.134040:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13649 00000100:00100000:0.0:1746066729.134047:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009695c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:31919:x1830882982315776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066729.134067:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.134084:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfa1d33 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce1c0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.134116:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa1d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce196 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.134123:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066729.134124:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066729.134127:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2e00/0xf1867c21abfa1d33 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->1400831] (req 1048576->1400831) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1c0 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.134157:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa1d09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce196 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.134173:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa1d09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce196 expref: 21 pid: 3528 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746066729.134186:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984076672:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066729.134322:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.137420:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.141726:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.144392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.229116:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.232030:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.232067:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.232094:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.232106:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.232119:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.232250:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.232454:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13652 00000100:00100000:0.0:1746066729.232461:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882982316928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.232468:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.232476:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be3600/0xf1867c21abfa1d6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce1d5 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.232500:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984077184:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066729.232663:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854c00 going to sleep for 11 seconds 00002000:00010000:0.0:1746066729.235704:0:12237:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066729 -> 1746066730 00002000:00010000:0.0:1746066729.235712:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066729 -> 1746066730 00000100:00100000:0.0:1746066729.235732:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984077184:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066729.235764:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be3600/0xf1867c21abfa1d6b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1d5 expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.235776:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be3600/0xf1867c21abfa1d6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1d5 expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.235790:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3600, rc 0) 00000100:00100000:0.0:1746066729.235831:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982316928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3370us (3735us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066729.235840:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13652 00000100:00100000:0.0:1746066729.237295:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4db6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984077440:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066729.237312:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa1d79 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1ea expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.237320:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa1d79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1ea expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.237328:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93dc00, rc 0) 00000100:00100000:0.0:1746066729.237542:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882982317312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4961us (5421us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066729.237547:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13654 00000100:00100000:0.0:1746066729.240644:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.242067:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.245164:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.245919:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.250845:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.250873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.250919:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982318208 00000100:00100000:0.0:1746066729.250927:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982318208 00000100:00100000:0.0:1746066729.250964:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982318336 00000100:00100000:0.0:1746066729.250966:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982318336 00000100:00100000:0.0:1746066729.251048:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13659 00000100:00100000:0.0:1746066729.251056:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982318336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.251072:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.251088:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfa1db8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce214 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.251137:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984077952:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066729.251199:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.251219:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.251232:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982318464 00000100:00100000:0.0:1746066729.251234:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982318464 00000100:00100000:0.0:1746066729.251259:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13660 00000100:00100000:0.0:1746066729.251264:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982318464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.251269:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.251276:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5993600/0xf1867c21abfa1dbf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce21b expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.251297:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984078080:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066729.251313:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.251360:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.254141:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984077952:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066729.254159:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfa1db8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce214 expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.254167:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfa1db8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce214 expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.254173:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3400, rc 0) 00000100:00100000:0.0:1746066729.254190:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882982318336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3135us (3316us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066729.254195:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13659 00000100:00100000:0.0:1746066729.256451:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.260063:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.261195:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982319104 00000100:00100000:0.0:1746066729.261202:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982319104 00000100:00100000:0.0:1746066729.261233:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13664 00000100:00100000:0.0:1746066729.261238:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982319104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.261251:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.261262:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898800/0xf1867c21abfa1de2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce237 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.261300:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984078720:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066729.261342:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.264270:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984078720:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066729.264289:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898800/0xf1867c21abfa1de2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce237 expref: 32 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.264303:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898800/0xf1867c21abfa1de2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce237 expref: 32 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.264312:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898800, rc 0) 00000100:00100000:0.0:1746066729.264333:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982319104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3094us (3154us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066729.264339:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13664 00000100:00100000:0.0:1746066729.272011:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.274714:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.275643:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982320128 00000100:00100000:0.0:1746066729.275646:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982320128 00010000:00010000:0.0:1746066729.275662:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa1d4f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1c7 expref: 13 pid: 7243 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746066729.275686:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5924 00000100:00100000:0.0:1746066729.275692:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982320128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.275699:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.275703:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa1d4f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1c7 expref: 13 pid: 7243 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.275710:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa1d4f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1c7 expref: 13 pid: 7243 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.275722:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa1d4f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1c7 expref: 13 pid: 7243 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.275736:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066729.275739:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa1dfe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066729.275745:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa1dfe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066729.275750:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa1dfe lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066729.275770:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.275797:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882982320128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.275803:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5924 00000100:00100000:0.0:1746066729.277116:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.277150:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.277554:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.282147:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.300027:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.309578:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.312991:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.313662:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.320301:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.326185:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.326232:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.330428:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.331879:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.333484:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.338103:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.338148:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.338472:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.353164:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.353221:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.355009:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.355547:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.355576:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982324352 00000100:00100000:0.0:1746066729.355579:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982324352 00010000:00010000:0.0:1746066729.355599:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f9c000/0xf1867c21abfa1d1e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1ab expref: 22 pid: 3528 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746066729.355623:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5928 00000100:00100000:0.0:1746066729.355628:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2013:x1830882982324352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.355637:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.355657:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f9c000/0xf1867c21abfa1d1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1ab expref: 22 pid: 3528 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.355667:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f9c000/0xf1867c21abfa1d1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1ab expref: 22 pid: 3528 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.355831:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f9c000/0xf1867c21abfa1d1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1ab expref: 22 pid: 3528 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.355948:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.355979:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2013:x1830882982324352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 351us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.355999:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5928 00000100:00100000:0.0:1746066729.359923:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.361675:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.362139:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.362738:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.366820:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.378214:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.378257:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.378286:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.378326:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.378360:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982325632 00000100:00100000:0.0:1746066729.378362:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982325632 00000100:00100000:0.0:1746066729.378535:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13676 00000100:00100000:0.0:1746066729.378544:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+17:31927:x1830882982325504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.378564:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.378583:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2e00/0xf1867c21abfa1e67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce292 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.378614:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa1d25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1b2 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.378622:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066729.378624:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066729.378628:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2e00/0xf1867c21abfa1e67 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce292 expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.378664:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa1d25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1b2 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.378676:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa1d25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1b2 expref: 20 pid: 3528 timeout: 797 lvb_type: 0 00000100:00100000:0.0:1746066729.378688:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984081024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066729.378755:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.380507:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.383051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.383091:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.384376:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.388305:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.394195:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982326912 00000100:00100000:0.0:1746066729.394205:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982326912 00002000:00100000:0.0:1746066729.394266:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1425408->1429503) req@ffff8800a4db7800 x1830882982326912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:135/0 lens 488/0 e 0 to 0 dl 1746066740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066729.394276:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4db7800 with x1830882982326912 ext(1425408->1429503) 00002000:00010000:0.0:1746066729.394282:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4db7800 00000100:00100000:0.0:1746066729.394306:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982327296 00000100:00100000:0.0:1746066729.394309:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982327296 00002000:00100000:0.0:1746066729.394320:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800a4db7480 x1830882982327296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:135/0 lens 488/0 e 0 to 0 dl 1746066740 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066729.394327:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4db7480 with x1830882982327296 ext(2097152->4194303) 00002000:00010000:0.0:1746066729.394330:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4db7480 00000100:00100000:0.0:1746066729.394349:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3127 00000100:00100000:0.0:1746066729.394356:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982326912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066729.394495:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982326912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 139us (1650us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066729.394501:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3127 00002000:00100000:0.0:1746066729.394507:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1425408->1429503) req@ffff8800a4db7800 x1830882982326912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746066740 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066729.394514:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4db7800 with x1830882982326912 ext(1425408->1429503) 00002000:00010000:0.0:1746066729.394516:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4db7800 00000100:00100000:0.0:1746066729.394530:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3128 00000100:00100000:0.0:1746066729.394535:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882982327296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066729.404543:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.412256:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.419980:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.427056:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.433025:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.439495:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.439542:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.466198:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.466253:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.469720:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.470959:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.480816:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.480958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.482671:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.488072:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.488119:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.495281:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.564734:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.567945:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.617796:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.627066:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.630415:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.630768:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.630915:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3135 00000100:00100000:0.0:1746066729.630922:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982331648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066729.637399:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982332288 00000100:00100000:0.0:1746066729.637412:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982332288 00000100:00100000:0.0:1746066729.637476:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 739 00000100:00100000:0.0:1746066729.637484:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982332288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.637497:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.637523:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017e00/0xf1867c21abfa1f1d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce2fb expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.637545:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066729.637549:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.637605:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882982332288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.637612:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 739 00000100:00100000:0.0:1746066729.649689:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.649726:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.666794:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.667537:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.686062:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.699766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.705937:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.718669:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.719577:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.719945:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5937 00000100:00100000:0.0:1746066729.719953:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882982334208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.719961:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.720210:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfa1e91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce2bc expref: 23 pid: 9591 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.720220:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfa1e91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce2bc expref: 23 pid: 9591 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.720233:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfa1e91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce2bc expref: 23 pid: 9591 timeout: 797 lvb_type: 0 00010000:00010000:0.0:1746066729.720250:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.720251:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.720258:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfa1f63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce31e expref: 22 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.720267:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfa1f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce31e expref: 22 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.720314:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfa1f63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce31e expref: 22 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.720332:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093a8aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984083968:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066729.720734:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.723738:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.726059:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a8aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984083968:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066729.726078:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066729.726119:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882982334208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6168us (6542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.726129:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5937 00000100:00100000:0.0:1746066729.728688:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.732575:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.746031:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.748190:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.755201:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.756568:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.769439:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.788469:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.788526:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.804739:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.813086:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.813121:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.813141:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.813157:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.813185:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.813221:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982336896 00000100:00100000:0.0:1746066729.813229:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982336896 00000100:00100000:0.0:1746066729.813267:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982337152 00000100:00100000:0.0:1746066729.813269:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982337152 00000100:00100000:0.0:1746066729.813279:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982337024 00000100:00100000:0.0:1746066729.813280:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982337024 00000100:00100000:0.0:1746066729.813288:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982337280 00000100:00100000:0.0:1746066729.813289:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982337280 00000100:00100000:0.0:1746066729.813302:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13694 00000100:00100000:0.0:1746066729.813309:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882982336896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.813334:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.813352:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa1f9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce33a expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.813377:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.813379:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.813388:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa1f9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce33a expref: 39 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.813405:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa1f9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce33a expref: 39 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.813417:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6000, rc 0) 00000100:00100000:0.0:1746066729.813461:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982336896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 152us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.813467:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13694 00000100:00100000:0.0:1746066729.814673:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13696 00000100:00100000:0.0:1746066729.814682:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982337024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.814692:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.814701:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfa1fa9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce341 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.815205:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.815207:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.815212:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfa1fa9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce341 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.815225:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfa1fa9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce341 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.815233:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7000, rc 0) 00000100:00100000:0.0:1746066729.823248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.831033:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.831159:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.831328:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3145 00000100:00100000:0.0:1746066729.831335:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882982338176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066729.837050:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.842543:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882982338176:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11207us (11382us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066729.842550:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3145 00002000:00100000:0.0:1746066729.842555:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e3e4000 x1830882982338176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:135/0 lens 488/440 e 0 to 0 dl 1746066740 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066729.842563:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e3e4000 with x1830882982338176 ext(1048576->2097151) 00002000:00010000:0.0:1746066729.842566:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e3e4000 00000100:00100000:0.0:1746066729.844763:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.844808:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.845038:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5942 00000100:00100000:0.0:1746066729.845046:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982338560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066729.845053:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066729.845065:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f9da00/0xf1867c21abfa1d87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1f8 expref: 18 pid: 12233 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066729.845076:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f9da00/0xf1867c21abfa1d87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1f8 expref: 18 pid: 12233 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066729.845093:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f9da00/0xf1867c21abfa1d87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce1f8 expref: 18 pid: 12233 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066729.845107:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.845109:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.845117:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa1fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->1036287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce356 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.845125:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa1fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->1036287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce356 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.845155:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa1fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 45056->1036287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce356 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.845167:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e3e6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984085248:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066729.845241:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.846095:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.848057:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.848953:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982339200 00000100:00100000:0.0:1746066729.848956:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982339200 00000100:00100000:0.0:1746066729.848982:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982339328 00000100:00100000:0.0:1746066729.848986:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982339328 00000100:00100000:0.0:1746066729.849001:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13699 00000100:00100000:0.0:1746066729.849005:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882982339200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066729.849014:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.849029:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa1fbe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce35d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066729.849072:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984085376:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066729.849123:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066729.852473:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.854747:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.855584:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.868134:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.871950:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.883461:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.893164:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.900247:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882982340480:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6181us (7084us total) trans 17179874032 rc 0/0 00000100:00100000:0.0:1746066729.900260:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 620 00002000:00100000:0.0:1746066729.900271:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (2727936->3145727) req@ffff88012b904700 x1830882982340480/t17179874032(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:135/0 lens 488/448 e 0 to 0 dl 1746066740 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066729.900280:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b904700 with x1830882982340480 ext(2727936->3145727) 00010000:00010000:0.0:1746066729.900291:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfa1f63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce31e expref: 24 pid: 12237 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066729.900310:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129d2c200/0xf1867c21abfa1f63 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2727936->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce31e expref: 24 pid: 12237 timeout: 798 lvb_type: 0 00002000:00010000:0.0:1746066729.900316:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b904700 00000100:00100000:0.0:1746066729.905733:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.905779:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.940263:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.946395:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.946484:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.954029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.957667:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.957751:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.958324:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13704 00000100:00100000:0.0:1746066729.958331:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982342528:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066729.958343:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.958353:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfa2020 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce38e expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.958379:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.958381:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.958394:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfa2020 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce38e expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.958409:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0200/0xf1867c21abfa2020 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce38e expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.959017:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0200, rc 0) 00000100:00100000:0.0:1746066729.959042:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882982342528:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 711us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.959048:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13704 00000100:00100000:0.0:1746066729.965849:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.966574:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.968041:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.968064:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.968086:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.968105:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982343040 00000100:00100000:0.0:1746066729.968109:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982343040 00000100:00100000:0.0:1746066729.968129:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982343168 00000100:00100000:0.0:1746066729.968130:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982343168 00000100:00100000:0.0:1746066729.968138:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982343296 00000100:00100000:0.0:1746066729.968139:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982343296 00000100:00100000:0.0:1746066729.968148:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13706 00000100:00100000:0.0:1746066729.968153:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882982343040:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066729.968163:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.968174:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa202e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce39c expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.968186:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.968187:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.968192:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa202e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce39c expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.968202:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa202e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce39c expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.968210:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0e00, rc 0) 00000100:00100000:0.0:1746066729.968228:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2014:x1830882982343040:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.968233:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13706 00000100:00100000:0.0:1746066729.968240:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13707 00000100:00100000:0.0:1746066729.968244:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882982343168:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066729.968249:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.968253:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa2035 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce3a3 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.968260:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.968261:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.968264:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa2035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3a3 expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.968271:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa2035 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3a3 expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.968277:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1600, rc 0) 00000100:00100000:0.0:1746066729.968285:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2014:x1830882982343168:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.968288:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13707 00000100:00100000:0.0:1746066729.968294:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13708 00000100:00100000:0.0:1746066729.968297:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882982343296:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066729.968303:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066729.968309:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfa203c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce3aa expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066729.968318:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.968319:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066729.968322:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfa203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3aa expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.968330:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc1e00/0xf1867c21abfa203c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3aa expref: 22 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066729.968336:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1e00, rc 0) 00000100:00100000:0.0:1746066729.968350:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2014:x1830882982343296:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066729.968354:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13708 00000100:00100000:0.0:1746066729.974210:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.983859:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.988810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066729.992874:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.072962:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.079237:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.079280:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.079328:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.079441:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.079474:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982344832 00000100:00100000:0.0:1746066730.079478:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982344832 00000100:00100000:0.0:1746066730.079514:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982344960 00000100:00100000:0.0:1746066730.079517:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982344960 00000100:00100000:0.0:1746066730.080152:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13710 00000100:00100000:0.0:1746066730.080159:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982344832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.080165:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.080174:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa2090 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce3d4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.080186:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.080188:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.080195:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa2090 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3d4 expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.080208:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa2090 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3d4 expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.080218:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0a00, rc 0) 00000100:00100000:0.0:1746066730.080243:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882982344832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 85us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.080248:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13710 00000100:00100000:0.0:1746066730.080265:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13712 00000100:00100000:0.0:1746066730.080269:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882982344960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.080276:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.080284:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfa209e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce3db expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.080295:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.080297:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.080302:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfa209e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3db expref: 24 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.080310:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfa209e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3db expref: 24 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.080317:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1c00, rc 0) 00000100:00100000:0.0:1746066730.080332:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882982344960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.080336:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13712 00000100:00100000:0.0:1746066730.087595:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.087627:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982345216 00000100:00100000:0.0:1746066730.087637:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982345216 00010000:00010000:0.0:1746066730.087676:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfa1fa9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce341 expref: 33 pid: 12233 timeout: 798 lvb_type: 1 00000100:00100000:0.0:1746066730.087724:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5947 00000100:00100000:0.0:1746066730.087732:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982345216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.087747:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.087758:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfa1fa9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce341 expref: 33 pid: 12233 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746066730.087769:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962f7000/0xf1867c21abfa1fa9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce341 expref: 33 pid: 12233 timeout: 798 lvb_type: 1 00010000:00010000:0.0:1746066730.087791:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.088037:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982345216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 305us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.088044:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5947 00000100:00100000:0.0:1746066730.088273:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982345088 00000100:00100000:0.0:1746066730.088277:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982345088 00000100:00100000:0.0:1746066730.091245:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.092376:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.095255:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984087168:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066730.095281:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa20a5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce3e2 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.095297:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3800, rc 0) 00000100:00100000:0.0:1746066730.096066:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:31965:x1830882982345472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3787us (4077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.096075:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13713 00000100:00100000:0.0:1746066730.097875:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.105736:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.110068:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.120047:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982346112:12345-192.168.204.16@tcp:4:cat.0 Request processed in 21739us (22170us total) trans 21474841433 rc 0/0 00000100:00100000:0.0:1746066730.120058:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 621 00002000:00100000:0.0:1746066730.120069:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (45056->1036287) req@ffff880095cc9180 x1830882982346112/t21474841433(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:136/0 lens 488/448 e 0 to 0 dl 1746066741 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.120078:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cc9180 with x1830882982346112 ext(45056->1036287) 00010000:00010000:0.0:1746066730.120085:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa1fb7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->1036287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce356 expref: 39 pid: 20361 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.120103:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa1fb7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 45056->1036287) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce356 expref: 39 pid: 20361 timeout: 798 lvb_type: 0 00002000:00010000:0.0:1746066730.120109:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cc9180 00000100:00100000:0.0:1746066730.135282:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984087552:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066730.135301:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.136847:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982347264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11461us (11541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.136856:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5950 00000100:00100000:0.0:1746066730.143180:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.143225:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.143278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.143318:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982347648 00000100:00100000:0.0:1746066730.143326:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982347648 00002000:00100000:0.0:1746066730.143368:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880095cc9c00 x1830882982347648/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:136/0 lens 488/0 e 0 to 0 dl 1746066741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.143376:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cc9c00 with x1830882982347648 ext(0->1048575) 00002000:00010000:0.0:1746066730.143381:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cc9c00 00000100:00100000:0.0:1746066730.143408:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982347776 00000100:00100000:0.0:1746066730.143409:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982347776 00002000:00100000:0.0:1746066730.143415:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (2076672->2097151) req@ffff880095cc9f80 x1830882982347776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:136/0 lens 488/0 e 0 to 0 dl 1746066741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.143420:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cc9f80 with x1830882982347776 ext(2076672->2097151) 00002000:00010000:0.0:1746066730.143422:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cc9f80 00000100:00100000:0.0:1746066730.143428:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982348160 00000100:00100000:0.0:1746066730.143430:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982348160 00002000:00100000:0.0:1746066730.143437:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880095cca300 x1830882982348160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:136/0 lens 488/0 e 0 to 0 dl 1746066741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.143441:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cca300 with x1830882982348160 ext(0->1048575) 00002000:00010000:0.0:1746066730.143443:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cca300 00000100:00100000:0.0:1746066730.171764:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.171812:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.179813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.188789:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.201675:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.206753:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.209847:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.213019:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.213165:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.213187:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982349824 00000100:00100000:0.0:1746066730.213193:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982349824 00002000:00100000:0.0:1746066730.213233:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a4d08000 x1830882982349824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:136/0 lens 488/0 e 0 to 0 dl 1746066741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.213242:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d08000 with x1830882982349824 ext(1048576->2097151) 00002000:00010000:0.0:1746066730.213247:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d08000 00000100:00100000:0.0:1746066730.213267:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3160 00000100:00100000:0.0:1746066730.213274:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882982349824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066730.224087:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.224137:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.224170:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982349952 00000100:00100000:0.0:1746066730.224177:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982349952 00000100:00100000:0.0:1746066730.224226:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13719 00000100:00100000:0.0:1746066730.224234:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2013:x1830882982349952:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066730.224260:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.224278:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fac400/0xf1867c21abfa2123 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce421 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066730.225810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.226856:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.239499:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.239608:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.239739:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.247110:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.254977:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.275207:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.281839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.283212:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.284065:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.286410:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.293170:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.297427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.297464:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.297502:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.297541:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982352896 00000100:00100000:0.0:1746066730.297546:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982352896 00010000:00010000:0.0:1746066730.297576:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfa1e2f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce25a expref: 24 pid: 11630 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746066730.297615:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5958 00000100:00100000:0.0:1746066730.297624:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882982352896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.297641:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.297662:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfa1e2f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce25a expref: 24 pid: 11630 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.297674:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984bb000/0xf1867c21abfa1e2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce25a expref: 24 pid: 11630 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.297701:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.297742:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882982352896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.297749:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5958 00000100:00100000:0.0:1746066730.300086:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.303480:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4db6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984089344:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066730.303501:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.303552:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982352768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5819us (6086us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.303564:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5960 00000100:00100000:0.0:1746066730.316710:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.357610:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.365271:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.367156:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982354304 00000100:00100000:0.0:1746066730.367162:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982354304 00002000:00100000:0.0:1746066730.367187:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1552384->2097151) req@ffff8800a4db4700 x1830882982354304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:136/0 lens 488/0 e 0 to 0 dl 1746066741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.367194:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4db4700 with x1830882982354304 ext(1552384->2097151) 00002000:00010000:0.0:1746066730.367199:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4db4700 00000100:00100000:0.0:1746066730.367228:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3165 00000100:00100000:0.0:1746066730.367234:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982354304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066730.378285:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982354304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11048us (11406us total) trans 0 rc 544768/544768 00000100:00100000:0.0:1746066730.378297:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3165 00002000:00100000:0.0:1746066730.378310:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1552384->2097151) req@ffff8800a4db4700 x1830882982354304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:136/0 lens 488/440 e 0 to 0 dl 1746066741 ref 1 fl Complete:/200/0 rc 544768/544768 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.378319:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4db4700 with x1830882982354304 ext(1552384->2097151) 00002000:00010000:0.0:1746066730.378326:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4db4700 00000100:00100000:0.0:1746066730.390005:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.390063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.401496:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.405769:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.405840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.405866:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982355200 00000100:00100000:0.0:1746066730.405872:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982355200 00000100:00100000:0.0:1746066730.406726:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13727 00000100:00100000:0.0:1746066730.406733:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982355200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.406748:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.406760:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fac000/0xf1867c21abfa21b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce475 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.406774:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.406775:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.406779:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac000/0xf1867c21abfa21b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce475 expref: 39 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.406793:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fac000/0xf1867c21abfa21b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce475 expref: 39 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.406801:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac000, rc 0) 00000100:00100000:0.0:1746066730.406821:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982355200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 89us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.406827:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13727 00000100:00100000:0.0:1746066730.425504:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.449393:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.453266:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.464578:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.474107:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.474215:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.483948:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.491490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.491537:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.494287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.496372:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.502705:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.504161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.517002:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.518466:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.519853:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.525176:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.526147:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.538499:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.541006:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.548437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.566402:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.568773:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.589680:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.592317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.599878:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.631379:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.631439:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.640259:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.640299:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.674371:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.695779:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.699839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.706241:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.706267:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982361600 00000100:00100000:0.0:1746066730.706273:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982361600 00002000:00100000:0.0:1746066730.706313:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3203071) req@ffff880093ab2680 x1830882982361600/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:136/0 lens 488/0 e 0 to 0 dl 1746066741 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.706322:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ab2680 with x1830882982361600 ext(3145728->3203071) 00010000:00010000:0.0:1746066730.706330:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0e00/0xf1867c21abfa21cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce48a expref: 24 pid: 12237 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.706343:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ce0e00/0xf1867c21abfa21cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce48a expref: 24 pid: 12237 timeout: 798 lvb_type: 0 00002000:00010000:0.0:1746066730.706348:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ab2680 00000100:00100000:0.0:1746066730.706373:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 625 00000100:00100000:0.0:1746066730.706380:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982361600:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066730.717434:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.717945:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13736 00000100:00100000:0.0:1746066730.717955:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+23:31996:x1830882982361728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.717987:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.718006:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d93c600/0xf1867c21abfa220a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce4bb expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.719558:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa21e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce498 expref: 37 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.719569:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066730.719570:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066730.719574:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93c600/0xf1867c21abfa220a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4bb expref: 24 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.719608:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa21e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->2555903) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce498 expref: 37 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.719620:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa21e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->2555903) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce498 expref: 37 pid: 12237 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746066730.719634:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984092032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066730.722827:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982361856 00000100:00100000:0.0:1746066730.722836:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982361856 00010000:00010000:0.0:1746066730.722871:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce0e00/0xf1867c21abfa21cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce48a expref: 26 pid: 12237 timeout: 798 lvb_type: 0 00000100:00100000:0.0:1746066730.722930:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5971 00000100:00100000:0.0:1746066730.722937:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982361856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.722950:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.722981:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ce0e00/0xf1867c21abfa21cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3203071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce48a expref: 26 pid: 12237 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.722992:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ce0e00/0xf1867c21abfa21cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3203071) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce48a expref: 26 pid: 12237 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.723013:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0e00/0xf1867c21abfa21cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3203071) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce48a expref: 26 pid: 12237 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.723040:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.723042:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.723049:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfa2203 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4b4 expref: 40 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.723057:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfa2203 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4b4 expref: 40 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.723087:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097ce1e00/0xf1867c21abfa2203 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4b4 expref: 40 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066730.723102:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ab3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984092160:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066730.723164:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066730.726238:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ab2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984092032:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066730.726266:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d93c600/0xf1867c21abfa220a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4bb expref: 24 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.726282:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93c600, rc 0) 00000100:00100000:0.0:1746066730.726311:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+24:31996:x1830882982361728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8357us (8886us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.726318:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13736 00000100:00100000:0.0:1746066730.735369:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882982361984:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9687us (9845us total) trans 21474841437 rc 0/0 00000100:00100000:0.0:1746066730.735383:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 626 00002000:00100000:0.0:1746066730.735395:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2203648->2555903) req@ffff8800966e3100 x1830882982361984/t21474841437(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:136/0 lens 488/448 e 0 to 0 dl 1746066741 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.735404:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3100 with x1830882982361984 ext(2203648->2555903) 00010000:00010000:0.0:1746066730.735414:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa21e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce498 expref: 40 pid: 12237 timeout: 798 lvb_type: 0 00010000:00010000:0.0:1746066730.735429:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa21e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2203648->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce498 expref: 40 pid: 12237 timeout: 798 lvb_type: 0 00002000:00010000:0.0:1746066730.735435:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e3100 00000100:00100000:0.0:1746066730.756252:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.773588:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.782915:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3181 00000100:00100000:0.0:1746066730.782925:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882982363008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066730.801779:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882982363008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18853us (19292us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066730.801786:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3181 00002000:00100000:0.0:1746066730.801793:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a4db7100 x1830882982363008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:136/0 lens 488/440 e 0 to 0 dl 1746066741 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066730.801799:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4db7100 with x1830882982363008 ext(3145728->4194303) 00002000:00010000:0.0:1746066730.801803:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4db7100 00000100:00100000:0.0:1746066730.808506:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.810682:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.825079:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.825154:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.847086:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.849163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.851681:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.852855:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.853818:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.853867:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.853900:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.853927:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.853945:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982365184 00000100:00100000:0.0:1746066730.853948:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982365184 00010000:00010000:0.0:1746066730.853975:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa1f9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce33a expref: 41 pid: 12233 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746066730.853994:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982365312 00000100:00100000:0.0:1746066730.853996:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982365312 00010000:00010000:0.0:1746066730.854005:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2e00/0xf1867c21abfa2211 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4c2 expref: 41 pid: 12233 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.854016:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982365440 00000100:00100000:0.0:1746066730.854017:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982365440 00010000:00010000:0.0:1746066730.854025:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2ca00/0xf1867c21abfa1f5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce317 expref: 27 pid: 12237 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.854032:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5974 00000100:00100000:0.0:1746066730.854037:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882982365184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.854045:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.854060:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa1f9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce33a expref: 41 pid: 12233 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066730.854068:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa1f9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce33a expref: 41 pid: 12233 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066730.854083:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa1f9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce33a expref: 41 pid: 12233 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066730.854097:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.854114:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882982365184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.854119:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5974 00000100:00100000:0.0:1746066730.854129:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5976 00000100:00100000:0.0:1746066730.854132:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882982365440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.854138:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.854144:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2ca00/0xf1867c21abfa1f5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce317 expref: 27 pid: 12237 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.854152:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2ca00/0xf1867c21abfa1f5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce317 expref: 27 pid: 12237 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.854161:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2ca00/0xf1867c21abfa1f5c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce317 expref: 27 pid: 12237 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.854170:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.854755:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982365440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 560us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.854764:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5976 00000100:00100000:0.0:1746066730.856437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.863457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.865442:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.867715:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.874439:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.875121:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.875153:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.876942:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.877014:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.882775:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.883919:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.886461:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.886502:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.886528:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.887487:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.887504:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982368768 00000100:00100000:0.0:1746066730.887508:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982368768 00000100:00100000:0.0:1746066730.887827:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13748 00000100:00100000:0.0:1746066730.887832:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2015:x1830882982368768:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066730.887839:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.887846:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa228f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce51d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.887861:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa228f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce51d expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.887869:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa228f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce51d expref: 23 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.887880:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafa00, rc 0) 00000100:00100000:0.0:1746066730.888115:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2015:x1830882982368768:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 282us (628us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066730.888122:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13748 00000100:00100000:0.0:1746066730.888801:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.890836:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.890931:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.890948:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982369152 00000100:00100000:0.0:1746066730.890953:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982369152 00000100:00100000:0.0:1746066730.890991:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982369280 00000100:00100000:0.0:1746066730.890994:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982369280 00000100:00100000:0.0:1746066730.891018:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13749 00000100:00100000:0.0:1746066730.891025:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982369152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.891041:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.891056:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2296 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce524 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.891077:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2296 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce524 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.891085:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2296 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce524 expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.891093:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafc00, rc 0) 00000100:00100000:0.0:1746066730.891114:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982369152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 90us (280us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066730.891119:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13749 00000100:00100000:0.0:1746066730.893052:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.895966:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.897765:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.906853:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982370048 00000100:00100000:0.0:1746066730.906863:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982370048 00000100:00100000:0.0:1746066730.906936:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15885 00000100:00100000:0.0:1746066730.906943:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32003:x1830882982370048:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066730.906975:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.906992:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafc00/0xf1867c21abfa22b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce539 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.907077:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa22c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066730.907095:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa22ab lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce532 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.907102:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa22c0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066730.907131:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa22ab lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce532 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.907142:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa22ab lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce532 expref: 19 pid: 7243 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.907153:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984094208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066730.907225:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066730.912675:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.917712:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982370688 00000100:00100000:0.0:1746066730.917716:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982370688 00000100:00100000:0.0:1746066730.917731:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982370816 00000100:00100000:0.0:1746066730.917733:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982370816 00000100:00100000:0.0:1746066730.917744:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13754 00000100:00100000:0.0:1746066730.917749:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2016:x1830882982370688:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066730.917902:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.917910:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa22e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce555 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.917924:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa22e3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce555 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.917936:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa22e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce555 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.918003:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae200, rc 0) 00000100:00100000:0.0:1746066730.918022:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2016:x1830882982370688:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 273us (442us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066730.918027:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13754 00000100:00100000:0.0:1746066730.920565:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.920659:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.923445:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.925994:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.926027:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.926482:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.930663:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13763 00000100:00100000:0.0:1746066730.930672:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2015:x1830882982372096:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066730.930704:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.930718:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4200/0xf1867c21abfa2249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2621439) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4ec expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.930726:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfa226c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4fa expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.930732:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066730.930734:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066730.930737:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.930756:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfa226c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4fa expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.930766:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfa226c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4fa expref: 25 pid: 12233 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.930775:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984095744:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066730.930808:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091cb4200/0xf1867c21abfa2249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2621439) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4ec expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.930816:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091cb4200/0xf1867c21abfa2249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2621439) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4ec expref: 39 pid: 12233 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.930823:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984096000:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066730.930841:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066730.934580:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.934607:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982372352 00000100:00100000:0.0:1746066730.934613:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982372352 00010000:00010000:0.0:1746066730.934644:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb5000/0xf1867c21abfa2273 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce501 expref: 25 pid: 12233 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746066730.934679:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5984 00000100:00100000:0.0:1746066730.934687:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+25:2015:x1830882982372352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.934702:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.934723:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cb5000/0xf1867c21abfa2273 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce501 expref: 25 pid: 12233 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066730.934734:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cb5000/0xf1867c21abfa2273 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce501 expref: 25 pid: 12233 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066730.934757:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5000/0xf1867c21abfa2273 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce501 expref: 25 pid: 12233 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066730.934782:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.934831:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+24:2015:x1830882982372352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 144us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.934837:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5984 00000100:00100000:0.0:1746066730.935484:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984095744:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066730.935492:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984096000:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066730.935506:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066730.936716:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.936739:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.936749:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.936779:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.939189:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982373504 00000100:00100000:0.0:1746066730.939194:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982373504 00010000:00010000:0.0:1746066730.939212:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfa226c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4fa expref: 27 pid: 12233 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.939225:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5993 00000100:00100000:0.0:1746066730.939231:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882982373504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.939237:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.939245:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfa226c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4fa expref: 27 pid: 12233 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.939253:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfa226c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4fa expref: 27 pid: 12233 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.939264:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ec800/0xf1867c21abfa226c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4fa expref: 27 pid: 12233 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.939273:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.939832:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982373504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 598us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.939838:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5993 00000100:00100000:0.0:1746066730.942012:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982373888 00000100:00100000:0.0:1746066730.942017:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982373888 00010000:00010000:0.0:1746066730.942037:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa2242 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4e5 expref: 22 pid: 12237 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.942061:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5994 00000100:00100000:0.0:1746066730.942067:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882982373888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.942078:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.942092:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa2242 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4e5 expref: 22 pid: 12237 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.942102:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa2242 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4e5 expref: 22 pid: 12237 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.942120:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa2242 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce4e5 expref: 22 pid: 12237 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.942134:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.942157:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982373888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.942162:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5994 00000001:00080000:0.0:1746066730.957834:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841438 is committed 00000001:00080000:0.0:1746066730.957848:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841436 is committed 00000001:00080000:0.0:1746066730.957880:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841428 is committed 00000001:00080000:0.0:1746066730.957901:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841425 is committed 00000100:00100000:0.0:1746066730.964232:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066730.966339:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966348:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966368:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966375:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966384:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966390:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098faec00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066730.966394:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966401:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966413:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.966420:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa2329 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066730.968115:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982372096:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 37441us (39294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.968125:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13763 00000100:00100000:0.0:1746066730.968412:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982374528 00000100:00100000:0.0:1746066730.968420:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982374528 00000100:00100000:0.0:1746066730.968460:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13764 00000100:00100000:0.0:1746066730.968466:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882982374528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.968482:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.968499:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fae400/0xf1867c21abfa2337 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce57f expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066730.968519:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd2b, atime: 0x6812dd2b, ctime: 0x6812dd2b, blocks: 0x808 00010000:00010000:0.0:1746066730.968538:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.968539:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.968547:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fae400/0xf1867c21abfa2337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce57f expref: 41 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.968561:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fae400/0xf1867c21abfa2337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce57f expref: 41 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.968571:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae400, rc 0) 00000100:00100000:0.0:1746066730.968615:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982374528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 149us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.968620:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13764 00000100:00100000:0.0:1746066730.970619:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982375040 00000100:00100000:0.0:1746066730.970624:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982375040 00000100:00100000:0.0:1746066730.970643:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13766 00000100:00100000:0.0:1746066730.970648:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982375040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.970655:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.970664:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fae200/0xf1867c21abfa2345 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce59b expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066730.970677:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd2b, atime: 0x6812dd2b, ctime: 0x6812dd2b, blocks: 0x1000 00010000:00010000:0.0:1746066730.970685:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.970687:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066730.970691:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fae200/0xf1867c21abfa2345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce59b expref: 42 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.970705:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fae200/0xf1867c21abfa2345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce59b expref: 42 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066730.970712:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae200, rc 0) 00000100:00100000:0.0:1746066730.971302:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982375040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 652us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.971308:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13766 00000100:00100000:0.0:1746066730.973347:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.981930:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.981969:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.982000:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.982019:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982375424 00000100:00100000:0.0:1746066730.982027:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982375424 00010000:00010000:0.0:1746066730.982064:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa1c7d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce16c expref: 31 pid: 10125 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066730.982093:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5998 00000100:00100000:0.0:1746066730.982102:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882982375424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066730.982116:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066730.982121:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa1c7d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce16c expref: 32 pid: 10125 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.982132:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa1c7d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce16c expref: 32 pid: 10125 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066730.982503:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066730.982511:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0000/0xf1867c21abfa2361 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066730.982527:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066730.982572:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882982375424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 470us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.982579:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5998 00000100:00100000:0.0:1746066730.983129:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.983172:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.983682:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.983724:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.983784:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.983846:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982376448 00000100:00100000:0.0:1746066730.983850:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982376448 00000100:00100000:0.0:1746066730.983873:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15888 00000100:00100000:0.0:1746066730.983878:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:32010:x1830882982376448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066730.983909:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.983921:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2368 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce5a2 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.983970:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0000/0xf1867c21abfa2361 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066730.983977:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2368 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5a2 expref: 45 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.983993:0:17253:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0000/0xf1867c21abfa2361 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066730.984003:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2368 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5a2 expref: 45 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.984013:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066730.984016:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066730.984018:0:17253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0000/0xf1867c21abfa2361 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066730.984023:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafc00, rc 0) 00000100:00100000:0.0:1746066730.984040:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:32010:x1830882982376448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 162us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066730.984045:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15888 00000100:00100000:0.0:1746066730.987097:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066730.995580:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982376832 00000100:00100000:0.0:1746066730.995589:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982376832 00000100:00100000:0.0:1746066730.995643:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15889 00000100:00100000:0.0:1746066730.995652:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:32012:x1830882982376832:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066730.995678:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066730.995696:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf000/0xf1867c21abfa236f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce5a9 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066730.995773:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa2376 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.995786:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa2376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.995796:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa2376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.995809:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa237d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.995815:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa237d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.995820:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa237d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.998917:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa1cfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.998927:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa1cfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.998934:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa1cfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.998939:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b32600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066730.998943:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa1cfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.998950:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa1cfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.999385:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066730.999388:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066730.999902:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa1cfb lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066730.999980:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa1cfb lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066731.000125:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984097408 00000100:00100000:0.0:1746066731.000132:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984097408 00000100:00100000:0.0:1746066731.000178:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984097536 00000100:00100000:0.0:1746066731.000181:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984097536 00000100:00100000:0.0:1746066731.000192:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984097792 00000100:00100000:0.0:1746066731.000194:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984097792 00000100:00100000:0.0:1746066731.000207:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13770 00000100:00100000:0.0:1746066731.000215:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984097408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066731.000355:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066731.000358:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.000360:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.000362:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.000364:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066731.000384:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3777:x1830882984097408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (401us total) trans 17179874038 rc 0/0 00000100:00100000:0.0:1746066731.000389:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13770 00000100:00100000:0.0:1746066731.000698:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984097280 00000100:00100000:0.0:1746066731.000701:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984097280 00000100:00100000:0.0:1746066731.000721:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13774 00000100:00100000:0.0:1746066731.000725:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882984097280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066731.000771:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066731.000773:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.000775:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066730 -> 1746066730 00002000:00010000:0.0:1746066731.000777:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.000778:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066731.000797:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882984097280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (144us total) trans 17179874041 rc 0/0 00000100:00100000:0.0:1746066731.000802:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13774 00000100:00100000:0.0:1746066731.001663:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984098304 00000100:00100000:0.0:1746066731.001667:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984098304 00000100:00100000:0.0:1746066731.001677:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984098816 00000100:00100000:0.0:1746066731.001679:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984098816 00000100:00100000:0.0:1746066731.002082:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13776 00000100:00100000:0.0:1746066731.002088:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882984097920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066731.002161:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882984097920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (518us total) trans 17179874042 rc 0/0 00000100:00100000:0.0:1746066731.002166:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13776 00000100:00100000:0.0:1746066731.002798:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13784 00000100:00100000:0.0:1746066731.002803:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3776:x1830882984098304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066731.002859:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066731.002862:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.002869:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.002871:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066731 -> 1746066731 00002000:00010000:0.0:1746066731.002872:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066731.002909:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984098304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (2046us total) trans 21474841446 rc 0/0 00000100:00100000:0.0:1746066731.002913:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13784 00000100:00100000:0.0:1746066731.003874:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13786 00000100:00100000:0.0:1746066731.003898:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984099328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066731.003979:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984099328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (222us total) trans 21474841447 rc 0/0 00000100:00100000:0.0:1746066731.003984:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13786 00000100:00100000:0.0:1746066731.004222:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066731.004743:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed800/0xf1867c21abfa2384 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066731.004757:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa22ff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce571 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.004765:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed800/0xf1867c21abfa2384 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066731.004788:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa22ff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce571 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.004797:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa22ff lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce571 expref: 8 pid: 7243 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.004807:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b906300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984099456:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066731.004840:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066731.009389:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.010093:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.014065:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066731.015491:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066731.017170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.042017:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.045230:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.045543:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.046227:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6007 00000100:00100000:0.0:1746066731.046233:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982379392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.046240:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.046244:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2368 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5a2 expref: 27 pid: 17253 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.046252:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2368 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5a2 expref: 27 pid: 17253 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.046264:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafc00/0xf1867c21abfa2368 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5a2 expref: 27 pid: 17253 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.046714:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066731.046717:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.046731:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b907480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882982379392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 499us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.046736:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6007 00000100:00100000:0.0:1746066731.048169:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.053130:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984102016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066731.053153:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066731.053174:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984102016 00000100:00100000:0.0:1746066731.053177:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984102016 00000100:00100000:0.0:1746066731.053192:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13803 00000100:00100000:0.0:1746066731.053196:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984102016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066731.053249:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882984102016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (95us total) trans 21474841456 rc 0/0 00000100:00100000:0.0:1746066731.053254:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13803 00000004:00080000:0.0:1746066731.053272:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095ccb480/2, rc 0, transno 21474841456 00000100:00100000:0.0:1746066731.053275:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984102016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066731.056610:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.058620:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066731.059300:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066731.060013:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.071879:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.074382:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.074433:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.092489:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.097093:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.097148:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.097784:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.105657:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.123276:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.126789:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.126827:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982382208 00000100:00100000:0.0:1746066731.126835:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982382208 00002000:00100000:0.0:1746066731.126875:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3252223) req@ffff88012faf3b80 x1830882982382208/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:137/0 lens 488/0 e 0 to 0 dl 1746066742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066731.126896:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3b80 with x1830882982382208 ext(3145728->3252223) 00010000:00010000:0.0:1746066731.126904:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094541600/0xf1867c21abfa23bc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5d3 expref: 6 pid: 9591 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.126916:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094541600/0xf1867c21abfa23bc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3252223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5d3 expref: 6 pid: 9591 timeout: 799 lvb_type: 0 00002000:00010000:0.0:1746066731.126922:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf3b80 00000100:00100000:0.0:1746066731.139806:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.146311:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.153131:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.153165:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.158704:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.175488:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.180534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.180589:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.185490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.185537:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.185582:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982384000 00000100:00100000:0.0:1746066731.185589:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982384000 00000100:00100000:0.0:1746066731.185629:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15895 00000100:00100000:0.0:1746066731.185637:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:32019:x1830882982384000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.185660:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.185680:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418200/0xf1867c21abfa2409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce604 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.185758:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185770:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185780:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185791:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185796:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185801:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185907:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418c00/0xf1867c21abfa241e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185915:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094418c00/0xf1867c21abfa241e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.185921:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418c00/0xf1867c21abfa241e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066731.185930:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066731.186037:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186043:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186048:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186054:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186060:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094418800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066731.186064:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186070:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186080:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066731.186083:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066731.186087:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186091:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa2410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186107:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186115:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186120:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186124:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094418600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066731.186126:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186130:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186135:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b4834600) 00010000:00010000:0.0:1746066731.186137:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066731.186139:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186144:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418600/0xf1867c21abfa2417 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.186176:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418200/0xf1867c21abfa2409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce604 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.186187:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418c00/0xf1867c21abfa241e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce604 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.186193:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066731.186194:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066731.186197:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418c00, rc 0) 00000100:00100000:0.0:1746066731.186239:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:32019:x1830882982384000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 603us (756us total) trans 8589936147 rc 0/0 00000100:00100000:0.0:1746066731.186246:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15895 00000100:00100000:0.0:1746066731.194958:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.194981:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.195004:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.195043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.195066:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982384256 00000100:00100000:0.0:1746066731.195074:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982384256 00000100:00100000:0.0:1746066731.195108:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982384512 00000100:00100000:0.0:1746066731.195110:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982384512 00000100:00100000:0.0:1746066731.195120:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982384384 00000100:00100000:0.0:1746066731.195122:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982384384 00000100:00100000:0.0:1746066731.195130:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982384640 00000100:00100000:0.0:1746066731.195132:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982384640 00000100:00100000:0.0:1746066731.195144:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13811 00000100:00100000:0.0:1746066731.195151:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882982384256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.195170:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.195193:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa242c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce60b expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066731.195246:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984103552:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066731.195320:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066731.195338:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13812 00000100:00100000:0.0:1746066731.195344:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982384512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.195351:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.195359:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ce0a00/0xf1867c21abfa2433 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce619 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.195375:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.195377:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.195386:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce0a00/0xf1867c21abfa2433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce619 expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.195399:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ce0a00/0xf1867c21abfa2433 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce619 expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.195408:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0a00, rc 0) 00000100:00100000:0.0:1746066731.195429:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982384512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 85us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.195434:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13812 00000100:00100000:0.0:1746066731.195449:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13813 00000100:00100000:0.0:1746066731.195453:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982384384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.195457:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.195463:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ce1200/0xf1867c21abfa243a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce612 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.195471:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.195473:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.195476:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1200/0xf1867c21abfa243a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce612 expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.195484:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ce1200/0xf1867c21abfa243a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce612 expref: 30 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.195495:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce1200, rc 0) 00000100:00100000:0.0:1746066731.195507:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982384384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 54us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.195512:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13813 00000100:00100000:0.0:1746066731.195519:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13814 00000100:00100000:0.0:1746066731.195523:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982384640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.195528:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.195534:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfa2441 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce620 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.195542:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.195543:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.195547:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfa2441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce620 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.195555:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfa2441 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce620 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.195562:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0200, rc 0) 00000100:00100000:0.0:1746066731.195573:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982384640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 49us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.195577:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13814 00000100:00100000:0.0:1746066731.197077:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.197103:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.197117:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982384768 00000100:00100000:0.0:1746066731.197123:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982384768 00000100:00100000:0.0:1746066731.197144:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982384896 00000100:00100000:0.0:1746066731.197145:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982384896 00000100:00100000:0.0:1746066731.197155:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13815 00000100:00100000:0.0:1746066731.197160:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982384768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.197172:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.197183:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa2448 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce627 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.197197:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.197199:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.197204:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa2448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce627 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.197214:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa2448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce627 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.197223:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0e00, rc 0) 00000100:00100000:0.0:1746066731.197246:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982384768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.197251:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13815 00000100:00100000:0.0:1746066731.197259:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13816 00000100:00100000:0.0:1746066731.197263:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982384896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.197268:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.197274:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ce1800/0xf1867c21abfa244f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce62e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066731.197299:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984103680:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066731.197343:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066731.197385:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.205213:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.237511:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.240141:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.246843:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.248098:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.256139:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.256177:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.256203:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.256218:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.256243:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982386560 00000100:00100000:0.0:1746066731.256254:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982386560 00000100:00100000:0.0:1746066731.256292:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982386688 00000100:00100000:0.0:1746066731.256295:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982386688 00000100:00100000:0.0:1746066731.256305:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982386816 00000100:00100000:0.0:1746066731.256307:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982386816 00000100:00100000:0.0:1746066731.256315:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982386944 00000100:00100000:0.0:1746066731.256316:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982386944 00000100:00100000:0.0:1746066731.256340:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13819 00000100:00100000:0.0:1746066731.256349:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982386560:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.256369:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.256386:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa2480 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce64a expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.256411:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256413:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256422:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa2480 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce64a expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256440:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa2480 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce64a expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256450:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226cc00, rc 0) 00000100:00100000:0.0:1746066731.256492:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982386560:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 144us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.256497:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13819 00000100:00100000:0.0:1746066731.256509:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13820 00000100:00100000:0.0:1746066731.256513:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882982386688:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.256520:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.256529:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfa2487 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce651 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.256539:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256541:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256544:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfa2487 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce651 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256553:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226d200/0xf1867c21abfa2487 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce651 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256559:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226d200, rc 0) 00000100:00100000:0.0:1746066731.256572:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882982386688:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.256577:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13820 00000100:00100000:0.0:1746066731.256585:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13821 00000100:00100000:0.0:1746066731.256589:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882982386816:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.256594:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.256598:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfa248e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce658 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.256607:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256608:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256612:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfa248e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce658 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256619:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfa248e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce658 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256625:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226c000, rc 0) 00000100:00100000:0.0:1746066731.256638:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882982386816:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 49us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.256643:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13821 00000100:00100000:0.0:1746066731.256651:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13822 00000100:00100000:0.0:1746066731.256655:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982386944:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.256660:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.256666:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfa2495 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce65f expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.256675:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256676:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.256680:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfa2495 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce65f expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256689:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b226de00/0xf1867c21abfa2495 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce65f expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.256701:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226de00, rc 0) 00000100:00100000:0.0:1746066731.256717:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982386944:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 61us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.256722:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13822 00000100:00100000:0.0:1746066731.256762:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.258608:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982387712 00000100:00100000:0.0:1746066731.258612:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982387712 00002000:00100000:0.0:1746066731.258629:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093ab0e00 x1830882982387712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:137/0 lens 488/0 e 0 to 0 dl 1746066742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066731.258636:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ab0e00 with x1830882982387712 ext(1048576->2097151) 00002000:00010000:0.0:1746066731.258639:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ab0e00 00000100:00100000:0.0:1746066731.258650:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982387968 00000100:00100000:0.0:1746066731.258652:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982387968 00002000:00100000:0.0:1746066731.258662:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a4d0f100 x1830882982387968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:137/0 lens 488/0 e 0 to 0 dl 1746066742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066731.258668:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0f100 with x1830882982387968 ext(1048576->2097151) 00002000:00010000:0.0:1746066731.258671:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d0f100 00000100:00100000:0.0:1746066731.258687:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3209 00000100:00100000:0.0:1746066731.258692:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982388096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066731.269171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.270050:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982388480 00000100:00100000:0.0:1746066731.270062:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982388480 00000100:00100000:0.0:1746066731.270121:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15897 00000100:00100000:0.0:1746066731.270131:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32021:x1830882982388480:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.270153:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.270172:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575b200/0xf1867c21abfa24aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce674 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.270622:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa24b1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.270636:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfa23ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5ef expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.270644:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418c00/0xf1867c21abfa241e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce604 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.270650:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa2479 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce643 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.270657:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa24b1 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.270690:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa2479 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce643 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.270702:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa2479 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce643 expref: 9 pid: 17253 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.270715:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984104320:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066731.271060:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094418c00/0xf1867c21abfa241e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce604 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.271069:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418c00/0xf1867c21abfa241e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce604 expref: 10 pid: 7245 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.271077:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984104448:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066731.271101:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfa23ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5ef expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.271107:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfa23ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5ef expref: 29 pid: 7245 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.271114:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984104576:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066731.271128:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066731.280607:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.287506:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.287542:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.287597:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.287793:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982387584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29336us (29940us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066731.287803:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3207 00002000:00100000:0.0:1746066731.287815:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880093ab0380 x1830882982387584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:137/0 lens 488/440 e 0 to 0 dl 1746066742 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066731.287828:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ab0380 with x1830882982387584 ext(0->1048575) 00002000:00010000:0.0:1746066731.287834:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ab0380 00000100:00100000:0.0:1746066731.287964:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6014 00000100:00100000:0.0:1746066731.287973:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982388736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.287987:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.287994:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa2479 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce643 expref: 10 pid: 17253 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.288004:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa2479 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce643 expref: 10 pid: 17253 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.288040:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa2479 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce643 expref: 10 pid: 17253 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.288060:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066731.288065:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa24b1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.288073:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa24b1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.288078:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.288096:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882982388736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 125us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.288102:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6014 00000100:00100000:0.0:1746066731.303316:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984104704:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066731.303347:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa24cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066731.303849:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066731.305075:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa24cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.305086:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa24cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066731.305178:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:0.0:1746066731.305184:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1746066731.308751:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.309390:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15900 00000100:00100000:0.0:1746066731.309397:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32021:x1830882982390272:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.309404:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.309411:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfa24f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce690 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.309731:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309739:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309745:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309755:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309760:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309765:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309770:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093506200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066731.309775:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309782:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309792:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066731.309796:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066731.309800:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309805:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa24fe lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066731.309835:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfa24f7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce690 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.309843:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507a00/0xf1867c21abfa24f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce690 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.309851:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507a00, rc 0) 00000100:00100000:0.0:1746066731.309880:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32021:x1830882982390272:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 484us (977us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066731.309912:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15900 00000100:00100000:0.0:1746066731.317189:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.333725:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.347335:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.353709:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.360999:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.416327:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.434865:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.438261:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.443287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.443387:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.443587:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3216 00000100:00100000:0.0:1746066731.443593:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882982392832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066731.448512:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.448544:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.448590:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.448623:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982393088 00000100:00100000:0.0:1746066731.448632:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982393088 00010000:00010000:0.0:1746066731.448671:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa2505 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce697 expref: 32 pid: 1893 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.448697:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982393216 00000100:00100000:0.0:1746066731.448699:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982393216 00010000:00010000:0.0:1746066731.448707:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cce00/0xf1867c21abfa2402 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5fd expref: 45 pid: 9591 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.448718:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982392960 00000100:00100000:0.0:1746066731.448720:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982392960 00010000:00010000:0.0:1746066731.448729:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa24a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce66d expref: 22 pid: 1893 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746066731.448742:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6018 00000100:00100000:0.0:1746066731.448750:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982393088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.448765:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.448785:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa2505 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce697 expref: 32 pid: 1893 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.448797:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa2505 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce697 expref: 32 pid: 1893 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.448820:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa2505 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce697 expref: 32 pid: 1893 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.449437:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.459605:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.467234:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.470662:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.472733:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.474086:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.499034:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.508443:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.522769:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.533400:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.533603:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.534119:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.540500:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.556133:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.570739:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.572662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.573383:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.573409:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982396032 00000100:00100000:0.0:1746066731.573412:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982396032 00010000:00010000:0.0:1746066731.573427:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa2353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce586 expref: 44 pid: 9591 timeout: 799 lvb_type: 1 00000100:00100000:0.0:1746066731.573444:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6026 00000100:00100000:0.0:1746066731.573451:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2014:x1830882982395904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.573459:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.573472:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfa248e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce658 expref: 20 pid: 9591 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066731.573481:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfa248e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce658 expref: 20 pid: 9591 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066731.573497:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226c000/0xf1867c21abfa248e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce658 expref: 20 pid: 9591 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066731.573512:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.573537:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882982395904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.573542:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6026 00000100:00100000:0.0:1746066731.573556:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6027 00000100:00100000:0.0:1746066731.573560:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882982396032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.573565:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.573572:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa2353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce586 expref: 44 pid: 9591 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066731.573580:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa2353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce586 expref: 44 pid: 9591 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066731.573596:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa2353 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce586 expref: 44 pid: 9591 timeout: 799 lvb_type: 1 00010000:00010000:0.0:1746066731.573604:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.573606:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.573612:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf56800/0xf1867c21abfa2560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6c8 expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.573619:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf56800/0xf1867c21abfa2560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6c8 expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.573648:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf56800/0xf1867c21abfa2560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6c8 expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066731.573659:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cc8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984106624:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066731.573710:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066731.575369:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.576045:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cc8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984106624:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066731.576064:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.576542:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982396032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2978us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.576551:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6027 00000100:00100000:0.0:1746066731.578450:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.581854:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982397184 00000100:00100000:0.0:1746066731.581859:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982397184 00000100:00100000:0.0:1746066731.581904:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5709 00000100:00100000:0.0:1746066731.581910:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:32023:x1830882982397184:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066731.582104:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:32023:x1830882982397184:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 194us (750us total) trans 8589936157 rc 0/0 00000100:00100000:0.0:1746066731.582110:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5709 00000100:00100000:0.0:1746066731.583212:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.598398:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.613995:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.621163:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984107136:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066731.621191:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.621250:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982397568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6131us (7263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.621262:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6028 00000100:00100000:0.0:1746066731.624473:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.642443:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.645054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.653007:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.659571:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.684487:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.709496:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066731.714071:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa24e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce689 expref: 34 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.714088:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa24e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce689 expref: 34 pid: 17253 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.714102:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984107648:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066731.721681:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.721722:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.721755:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982399360 00000100:00100000:0.0:1746066731.721758:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982399360 00010000:00010000:0.0:1746066731.721785:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa24e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce689 expref: 35 pid: 17253 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.721827:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6031 00000100:00100000:0.0:1746066731.721850:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882982399360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066731.737527:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.741061:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.748248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.749522:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.749555:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.755855:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.755899:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.755991:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.756680:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982400384 00000100:00100000:0.0:1746066731.756688:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982400384 00000100:00100000:0.0:1746066731.756727:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13838 00000100:00100000:0.0:1746066731.756734:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2014:x1830882982400384:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.756751:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.756770:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa25d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce715 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.756794:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.756796:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.756806:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa25d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce715 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.756820:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa25d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce715 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.756829:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8400, rc 0) 00000100:00100000:0.0:1746066731.756869:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2014:x1830882982400384:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 136us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.756875:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13838 00000100:00100000:0.0:1746066731.756993:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984108544 00000100:00100000:0.0:1746066731.756996:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984108544 00000100:00100000:0.0:1746066731.757020:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1746066731.757025:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984108544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746066731.757052:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:0.0:1746066731.757114:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984108544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.757119:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1746066731.757245:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984108416 00000100:00100000:0.0:1746066731.757249:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984108416 00000100:00100000:0.0:1746066731.757264:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1746066731.757268:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882984108416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746066731.757285:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445695488 avail 1316233216 00000100:00100000:0.0:1746066731.757320:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882984108416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.757324:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1746066731.757346:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982400128 00000100:00100000:0.0:1746066731.757350:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982400128 00010000:00010000:0.0:1746066731.757364:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfa23d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5e8 expref: 21 pid: 9591 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.757382:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6036 00000100:00100000:0.0:1746066731.757387:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882982400128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.757397:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.757417:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfa23d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5e8 expref: 21 pid: 9591 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.757426:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfa23d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5e8 expref: 21 pid: 9591 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.757444:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cca00/0xf1867c21abfa23d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5e8 expref: 21 pid: 9591 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.757466:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.757468:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.757472:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa25d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce707 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.757479:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa25d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->3825663) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce707 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.757499:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa25d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3551232->3825663) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce707 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066731.757506:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984108672:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066731.757550:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066731.761139:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.761188:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.761447:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13841 00000100:00100000:0.0:1746066731.761459:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882982400640:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066731.761473:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.761485:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8200/0xf1867c21abfa25ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce723 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.761503:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.761505:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066731.761513:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c8200/0xf1867c21abfa25ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce723 expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.761527:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8200/0xf1867c21abfa25ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce723 expref: 22 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.761537:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8200, rc 0) 00000100:00100000:0.0:1746066731.761566:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2014:x1830882982400640:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 110us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.761571:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13841 00000100:00100000:0.0:1746066731.765927:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066731.766124:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066731 -> 1746066732 00000100:00100000:0.0:1746066731.766149:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984108800:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066731.766181:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0153000/0xf1867c21abfa25e5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce71c expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.766199:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0153000/0xf1867c21abfa25e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce71c expref: 12 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.766225:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0153000, rc 0) 00000100:00100000:0.0:1746066731.766279:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982400512:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4931us (5146us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066731.766287:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13840 00000100:00100000:0.0:1746066731.772413:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3776:1830882984109056:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.772485:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066731.772644:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984109312:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.772669:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066731.772683:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3774:1830882984109824:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.772710:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066731.772725:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066731.772731:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3774:1830882984109440:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.772747:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066731.772756:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830882984109952:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.772771:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066731.772844:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984109824 00000100:00100000:0.0:1746066731.772849:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984109824 00000100:00100000:0.0:1746066731.773046:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1746066731.773053:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984109696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.773088:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984109696:12345-0@lo:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.773096:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1746066731.773110:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1746066731.773113:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830882984109952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.773131:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830882984109952:12345-0@lo:400:kworker.0 Request processed in 17us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.773135:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1746066731.773154:0:8138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984108928 00000100:00100000:0.0:1746066731.773157:0:8138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984108928 00000100:00100000:0.0:1746066731.773178:0:8138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1746066731.773183:0:8138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28b87956-2543-42c1-b799-d011d2dfefc7+23:3775:x1830882984108928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.773218:0:8138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28b87956-2543-42c1-b799-d011d2dfefc7+23:3775:x1830882984108928:12345-0@lo:400:kworker.0 Request processed in 35us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.773223:0:8138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1746066731.773260:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3774:1830882984109440:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.773268:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830882984109952:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.773277:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984109312:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.773286:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3774:1830882984109824:0@lo:400:kworker.0 00000100:00100000:0.0:1746066731.773841:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15907 00000100:00100000:0.0:1746066731.773848:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:32045:x1830882982401664:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.773860:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.773867:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa2601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce731 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.773925:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.773935:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.773960:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.773976:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.773982:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.773987:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774058:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa2616 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774065:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa2616 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774070:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa2616 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066731.774078:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066731.774146:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774152:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774161:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774167:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774172:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066731.774176:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774182:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774192:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066731.774195:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066731.774198:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774203:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa2608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774215:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774220:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774225:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774228:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066731.774231:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774239:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774244:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34e400) 00010000:00010000:0.0:1746066731.774246:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066731.774248:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774253:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa260f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066731.774286:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa2601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce731 expref: 37 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.774295:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa2616 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce731 expref: 36 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.774302:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066731.774303:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066731.774305:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9800, rc 0) 00000100:00100000:0.0:1746066731.774341:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:32045:x1830882982401664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 493us (778us total) trans 8589936159 rc 0/0 00000100:00100000:0.0:1746066731.774346:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15907 00000100:00100000:0.0:1746066731.775446:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982401792 00000100:00100000:0.0:1746066731.775450:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982401792 00010000:00010000:0.0:1746066731.775472:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa25c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce700 expref: 12 pid: 7243 timeout: 799 lvb_type: 0 00000100:00100000:0.0:1746066731.775505:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6037 00000100:00100000:0.0:1746066731.775512:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882982401792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.775521:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.775526:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa25c9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce700 expref: 12 pid: 7243 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.775535:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa25c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce700 expref: 12 pid: 7243 timeout: 799 lvb_type: 0 00010000:00010000:0.0:1746066731.775547:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066731.775551:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22600/0xf1867c21abfa25fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066731.775557:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22600/0xf1867c21abfa25fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066731.775562:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22600/0xf1867c21abfa25fa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066731.775573:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.775603:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882982401792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.775609:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6037 00000100:00100000:0.0:1746066731.779846:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.782036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.783245:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.785236:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.786022:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.786097:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.786130:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.787536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.790073:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066731.790087:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984110464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066731.790127:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066731.793000:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.802871:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.804460:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.821766:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984110720 00000100:00100000:0.0:1746066731.821775:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984110720 00000100:00100000:0.0:1746066731.821823:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1746066731.821832:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882984110720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746066731.821863:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1067101504 pending 8044544 free 3912097792 avail 3680575488 00000100:00100000:0.0:1746066731.821923:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882984110720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.821930:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1746066731.840326:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.847107:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.853493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.858082:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.860129:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.860170:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982405248 00000100:00100000:0.0:1746066731.860176:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982405248 00000100:00100000:0.0:1746066731.860210:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5713 00000100:00100000:0.0:1746066731.860217:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:32052:x1830882982405248:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066731.860418:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373a7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:32052:x1830882982405248:12345-192.168.204.16@tcp:35:cat.0 Request processed in 199us (289us total) trans 8589936166 rc 0/0 00000100:00100000:0.0:1746066731.860426:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5713 00000100:00100000:0.0:1746066731.863578:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.873064:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.886004:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.887447:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.889848:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.889900:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.889930:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982406144 00000100:00100000:0.0:1746066731.889934:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982406144 00010000:00010000:0.0:1746066731.890404:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa2480 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce64a expref: 11 pid: 9591 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746066731.890422:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6041 00000100:00100000:0.0:1746066731.890427:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882982406144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066731.890433:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066731.890736:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa2480 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce64a expref: 11 pid: 9591 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746066731.890744:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa2480 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce64a expref: 11 pid: 9591 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746066731.890756:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa2480 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce64a expref: 11 pid: 9591 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746066731.890768:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066731.890787:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882982406144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 360us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066731.890793:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6041 00000100:00100000:0.0:1746066731.893148:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.896839:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.907256:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.911574:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.916000:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.916677:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.916709:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.916764:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982407680 00000100:00100000:0.0:1746066731.916767:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982407680 00000100:00100000:0.0:1746066731.916788:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13851 00000100:00100000:0.0:1746066731.916793:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982407680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.916802:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.916817:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfa26cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce793 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066731.916856:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984112128:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066731.917795:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066731.917907:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984112128:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066731.917924:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfa26cc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce793 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.918131:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfa26cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce793 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066731.918144:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece200, rc 0) 00000100:00100000:0.0:1746066731.918161:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982407680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1368us (1484us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066731.918170:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13851 00000100:00100000:0.0:1746066731.921590:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.921809:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.922966:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.924441:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982407424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8168us (8442us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066731.924450:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3233 00002000:00100000:0.0:1746066731.924458:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8801310f1180 x1830882982407424/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:137/0 lens 488/440 e 0 to 0 dl 1746066742 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066731.924467:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1180 with x1830882982407424 ext(4194304->5033983) 00002000:00010000:0.0:1746066731.924471:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f1180 00000100:00100000:0.0:1746066731.924846:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984112256:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066731.925681:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984112384:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066731.925690:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093a88000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984112512:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066731.925710:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ebc00/0xf1867c21abfa26da lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066731.927616:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.927651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066731.928589:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ebc00/0xf1867c21abfa26da lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066731.928597:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ebc00/0xf1867c21abfa26da lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066731.928616:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066731.929104:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943eb600/0xf1867c21abfa26d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce79a expref: 22 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.929132:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943ebc00/0xf1867c21abfa26da lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce79a expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066731.929138:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066731.929141:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066731.929143:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943ebc00, rc 0) 00000100:00100000:0.0:1746066731.929175:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:32054:x1830882982408192:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5861us (6212us total) trans 8589936167 rc 0/0 00000100:00100000:0.0:1746066731.929182:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15912 00000100:00100000:0.0:1746066731.929518:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.929555:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.930758:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982409216 00000100:00100000:0.0:1746066731.930762:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982409216 00002000:00100000:0.0:1746066731.930791:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1417216->1421311) req@ffff88012faf5180 x1830882982409216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:137/0 lens 488/0 e 0 to 0 dl 1746066742 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066731.930800:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5180 with x1830882982409216 ext(1417216->1421311) 00002000:00010000:0.0:1746066731.930804:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf5180 00000100:00100000:0.0:1746066731.930827:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3234 00000100:00100000:0.0:1746066731.930832:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982409216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066731.930968:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982409216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 135us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066731.930974:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3234 00002000:00100000:0.0:1746066731.930978:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1417216->1421311) req@ffff88012faf5180 x1830882982409216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:137/0 lens 488/4536 e 0 to 0 dl 1746066742 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066731.930985:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5180 with x1830882982409216 ext(1417216->1421311) 00002000:00010000:0.0:1746066731.930988:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf5180 00000100:00100000:0.0:1746066731.935481:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.936658:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.936694:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066731.936805:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13856 00000100:00100000:0.0:1746066731.936812:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982409600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066731.936825:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066731.936842:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa26fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce7b6 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066731.936914:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b905180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984113152:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066731.936983:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066732.070923:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3235 00000100:00100000:0.0:1746066732.070941:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093a8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882982410112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066732.080855:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.082751:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.091432:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.091488:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.099784:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982411136 00000100:00100000:0.0:1746066732.099795:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982411136 00000100:00100000:0.0:1746066732.099845:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13859 00000100:00100000:0.0:1746066732.099853:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+33:32054:x1830882982411136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066732.099871:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.099923:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa273c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce7d9 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.099971:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d06c00/0xf1867c21abfa254b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6b3 expref: 46 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.099980:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8200/0xf1867c21abfa25ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce723 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.099988:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa258a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6e4 expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.099995:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.099997:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.100000:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa273c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3244032->4194303] (req 3244032->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7d9 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066732.104818:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.107196:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982411520 00000100:00100000:0.0:1746066732.107200:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982411520 00010000:00010000:0.0:1746066732.107217:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa258a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6e4 expref: 32 pid: 9590 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746066732.107234:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6050 00000100:00100000:0.0:1746066732.107239:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982411520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066732.107247:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066732.107263:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa258a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6e4 expref: 32 pid: 9590 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746066732.107277:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa258a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6e4 expref: 32 pid: 9590 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746066732.107292:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa258a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6e4 expref: 32 pid: 9590 timeout: 800 lvb_type: 1 00010000:00010000:0.0:1746066732.107312:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066732.107344:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882982411520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.107350:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6050 00000100:00100000:0.0:1746066732.108251:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.108310:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.111797:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.123202:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984114304:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066732.123224:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066732.123274:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882982412160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5025us (5235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.123283:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6052 00000100:00100000:0.0:1746066732.124624:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.126619:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.138314:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.138418:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.142319:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.142806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.146428:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746066732.153516:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874057 is committed 00000001:00080000:0.0:1746066732.153535:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874054 is committed 00000001:00080000:0.0:1746066732.153545:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874052 is committed 00000001:00080000:0.0:1746066732.153605:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874028 is committed 00000100:00100000:0.0:1746066732.158510:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.160630:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.167008:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.174098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.180556:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982414208 00000100:00100000:0.0:1746066732.180564:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982414208 00010000:00010000:0.0:1746066732.180592:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfa2743 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7e0 expref: 12 pid: 3528 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746066732.180622:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6056 00000100:00100000:0.0:1746066732.180629:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982414208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066732.180643:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066732.180662:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfa2743 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7e0 expref: 12 pid: 3528 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746066732.180673:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfa2743 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7e0 expref: 12 pid: 3528 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746066732.180695:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728600/0xf1867c21abfa2743 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7e0 expref: 12 pid: 3528 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746066732.180720:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.180722:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.180729:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa276d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 184320->385023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7fc expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.180738:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa276d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 184320->385023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7fc expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.180769:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa276d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 184320->385023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7fc expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066732.180780:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984115200:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066732.180845:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b459f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066732.184362:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.188680:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.226036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.232349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.252502:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.264105:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.266726:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.267255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.327758:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.340986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.341018:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.341050:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.341706:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.352628:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.352679:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.354707:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3249 00000100:00100000:0.0:1746066732.354714:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982417920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066732.367934:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982417664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13573us (15300us total) trans 0 rc 593920/593920 00000100:00100000:0.0:1746066732.367947:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3248 00002000:00100000:0.0:1746066732.367959:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d0aa00 x1830882982417664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:138/0 lens 520/440 e 0 to 0 dl 1746066743 ref 1 fl Complete:/200/0 rc 593920/593920 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.367969:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0aa00 with x1830882982417664 ext(0->1048575) 00002000:00010000:0.0:1746066732.367976:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0aa00 00000100:00100000:0.0:1746066732.368737:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982417920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14015us (16048us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066732.368753:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3249 00002000:00100000:0.0:1746066732.368762:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a4d0a680 x1830882982417920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:138/0 lens 488/440 e 0 to 0 dl 1746066743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.368771:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0a680 with x1830882982417920 ext(1048576->2097151) 00002000:00010000:0.0:1746066732.368775:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d0a680 00000100:00100000:0.0:1746066732.377997:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.383224:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982418304 00000100:00100000:0.0:1746066732.383233:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982418304 00000100:00100000:0.0:1746066732.383265:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982418432 00000100:00100000:0.0:1746066732.383267:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982418432 00000100:00100000:0.0:1746066732.383290:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13871 00000100:00100000:0.0:1746066732.383294:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882982418432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066732.383307:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.383323:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fac200/0xf1867c21abfa27e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce842 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066732.383372:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984115968:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066732.383441:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b459000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066732.385384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.385437:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.387735:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.395125:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.395161:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.395183:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982419328 00000100:00100000:0.0:1746066732.395190:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982419328 00002000:00100000:0.0:1746066732.395230:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2772992->4280319) req@ffff8800a4d08a80 x1830882982419328/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:138/0 lens 504/0 e 0 to 0 dl 1746066743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.395241:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d08a80 with x1830882982419328 ext(2772992->4280319) 00010000:00010000:0.0:1746066732.395249:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfa274a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7e7 expref: 11 pid: 3528 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746066732.395263:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728800/0xf1867c21abfa274a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4280319) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7e7 expref: 11 pid: 3528 timeout: 800 lvb_type: 0 00002000:00010000:0.0:1746066732.395270:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d08a80 00000100:00100000:0.0:1746066732.395289:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 639 00000100:00100000:0.0:1746066732.395296:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882982419328:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066732.401606:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.411770:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.417169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.417454:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.417486:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982419968 00000100:00100000:0.0:1746066732.417490:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982419968 00010000:00010000:0.0:1746066732.417507:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa276d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 184320->385023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7fc expref: 26 pid: 3528 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746066732.417526:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6058 00000100:00100000:0.0:1746066732.417532:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882982419968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066732.417540:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066732.417681:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa276d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 184320->385023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7fc expref: 27 pid: 3528 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746066732.417692:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa276d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 184320->385023) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7fc expref: 27 pid: 3528 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746066732.417712:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa276d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 184320->385023) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7fc expref: 27 pid: 3528 timeout: 800 lvb_type: 0 00010000:00010000:0.0:1746066732.417738:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.417740:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.417746:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa2800 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce857 expref: 12 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.417753:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa2800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce857 expref: 12 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.417778:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa2800 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce857 expref: 12 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066732.417793:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984116736:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066732.417864:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b459000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066732.427222:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.434944:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.437499:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.442066:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.451496:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066732.451772:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfa2823 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451778:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfa2823 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066732.451819:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:0.0:1746066732.451822:0:10125:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066732.451836:0:10125:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfa2823 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451844:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfa2823 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451854:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451858:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451863:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451869:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451875:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be3c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066732.451878:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451906:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451914:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066732.451921:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066732.451939:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451945:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3c00/0xf1867c21abfa2815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451957:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfa281c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451961:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfa281c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451966:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfa281c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451970:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be2e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066732.451973:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfa281c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451977:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfa281c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451983:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9800) 00010000:00010000:0.0:1746066732.451985:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066732.451987:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfa281c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.451991:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2e00/0xf1867c21abfa281c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.452432:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa280e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce865 expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.452444:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2400/0xf1867c21abfa2823 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce865 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.452449:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066732.452451:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066732.452453:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2400, rc 0) 00000100:00100000:0.0:1746066732.452485:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32083:x1830882982420480:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 14696us (14990us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.452491:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15917 00000100:00100000:0.0:1746066732.454922:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.454998:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.455020:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.455034:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982421504 00000100:00100000:0.0:1746066732.455039:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982421504 00000100:00100000:0.0:1746066732.455853:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13876 00000100:00100000:0.0:1746066732.455860:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982421760:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066732.455873:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.455902:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fac000/0xf1867c21abfa282a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce87a expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.455919:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.455921:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.455935:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac000/0xf1867c21abfa282a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce87a expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.455947:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fac000/0xf1867c21abfa282a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce87a expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.455956:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac000, rc 0) 00000100:00100000:0.0:1746066732.455982:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982421760:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 122us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.455987:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13876 00000100:00100000:0.0:1746066732.456000:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13877 00000100:00100000:0.0:1746066732.456004:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982421504:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066732.456010:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.456016:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fad800/0xf1867c21abfa2831 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce86c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.456024:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.456025:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.456028:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fad800/0xf1867c21abfa2831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce86c expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.456035:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fad800/0xf1867c21abfa2831 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce86c expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.456040:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00000100:00100000:0.0:1746066732.456053:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982421504:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 49us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.456060:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13877 00000100:00100000:0.0:1746066732.456069:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13878 00000100:00100000:0.0:1746066732.456073:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882982421632:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066732.456079:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.456087:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfa2838 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce873 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.456095:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.456097:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.456100:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfa2838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce873 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.456108:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfa2838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce873 expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.456114:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac600, rc 0) 00000100:00100000:0.0:1746066732.456125:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982421632:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 52us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.456129:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13878 00000100:00100000:0.0:1746066732.456170:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.456184:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982421888 00000100:00100000:0.0:1746066732.456186:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982421888 00000100:00100000:0.0:1746066732.456207:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13879 00000100:00100000:0.0:1746066732.456211:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982421888:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066732.456216:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.456222:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa283f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce881 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066732.456329:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984117248:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066732.456374:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b459f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066732.456587:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.461256:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.462419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.465841:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984117504:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066732.465864:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa2854 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066732.468289:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.469212:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.486691:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.487779:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.492697:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.497346:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.497375:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982424320 00000100:00100000:0.0:1746066732.497389:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982424320 00000100:00100000:0.0:1746066732.497436:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15921 00000100:00100000:0.0:1746066732.497444:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32083:x1830882982424320:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066732.497474:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.497492:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa28af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce8ab expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.497594:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.497609:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa2854 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce88f expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.497617:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.497646:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa2854 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce88f expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.497658:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa2854 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce88f expref: 42 pid: 10125 timeout: 800 lvb_type: 0 00000100:00100000:0.0:1746066732.497670:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984117632:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066732.497756:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b459f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066732.497810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.499437:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.499477:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.502018:0:10125:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984117632:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066732.502042:0:10125:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000100:00100000:0.0:1746066732.502097:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066732.505610:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505622:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505643:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505649:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505656:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505661:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066732.505665:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505670:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505688:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066732.505691:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066732.505694:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505699:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0400/0xf1867c21abfa28b6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.505762:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa28af lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce8ab expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.505770:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa28af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce8ab expref: 14 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.505778:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1600, rc 0) 00000100:00100000:0.0:1746066732.505811:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32083:x1830882982424320:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 8367us (8465us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066732.505820:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15921 00000100:00100000:0.0:1746066732.507655:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.507698:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.520216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.523557:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982425472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15723us (15908us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066732.523567:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3256 00002000:00100000:0.0:1746066732.523577:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880098924000 x1830882982425472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:138/0 lens 488/440 e 0 to 0 dl 1746066743 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.523586:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924000 with x1830882982425472 ext(4194304->5033983) 00002000:00010000:0.0:1746066732.523592:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098924000 00000100:00100000:0.0:1746066732.531272:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.531363:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.531405:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.531446:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.531478:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982426112 00000100:00100000:0.0:1746066732.531481:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982426112 00000100:00100000:0.0:1746066732.531500:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13884 00000100:00100000:0.0:1746066732.531732:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982425984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066732.531739:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.531745:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa28d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce8c0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.531756:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.531764:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa28d9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce8c0 expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.531772:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa28d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce8c0 expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.531790:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0800, rc 0) 00000100:00100000:0.0:1746066732.531802:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982425984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 296us (543us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066732.531806:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13884 00000100:00100000:0.0:1746066732.534802:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.534835:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.535459:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.535730:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.536115:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.537517:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.537535:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982427392 00000100:00100000:0.0:1746066732.537539:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982427392 00010000:00010000:0.0:1746066732.537557:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb5000/0xf1867c21abfa233e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce58d expref: 25 pid: 9591 timeout: 800 lvb_type: 1 00000100:00100000:0.0:1746066732.542983:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.547953:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.548038:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.549756:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.551683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.552101:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.552673:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.553805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.555652:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.558666:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.558703:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.558777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.561771:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.566999:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.570317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.583443:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.587090:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.685244:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.717013:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.726282:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.742140:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.756488:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.761584:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.768438:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.772346:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.772465:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.775384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.778237:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.778565:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.782163:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882982432384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9313us (9687us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066732.782176:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3265 00002000:00100000:0.0:1746066732.782187:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800936cdf80 x1830882982432384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:138/0 lens 488/440 e 0 to 0 dl 1746066743 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.782197:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936cdf80 with x1830882982432384 ext(0->1048575) 00002000:00010000:0.0:1746066732.782203:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936cdf80 00000100:00100000:0.0:1746066732.783614:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.790639:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.790690:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066732.791450:0:10125:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa2965 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066732.791775:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa2965 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066732.791795:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066732.791940:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa295e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce937 expref: 46 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.792158:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa2965 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce937 expref: 45 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.792165:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066732.792167:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066732.792170:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3800, rc 0) 00000100:00100000:0.0:1746066732.792339:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:32103:x1830882982433408:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6676us (6783us total) trans 8589936185 rc 0/0 00000100:00100000:0.0:1746066732.792345:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15923 00000100:00100000:0.0:1746066732.794395:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.794811:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.794829:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982434048 00000100:00100000:0.0:1746066732.794832:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982434048 00002000:00100000:0.0:1746066732.794847:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88011f766d80 x1830882982434048/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:138/0 lens 488/0 e 0 to 0 dl 1746066743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.794854:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766d80 with x1830882982434048 ext(3145728->4194303) 00002000:00010000:0.0:1746066732.794857:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f766d80 00000100:00100000:0.0:1746066732.794870:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3268 00000100:00100000:0.0:1746066732.794875:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982434048:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066732.798434:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.809256:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.817008:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.822532:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.822576:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.825976:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.826018:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e3e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984120704:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066732.826039:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d31600/0xf1867c21abfa2981 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4067328->4194303] (req 4067328->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce94c expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.826054:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31600, rc 0) 00000100:00100000:0.0:1746066732.826072:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:32103:x1830882982434944:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3352us (3495us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.826078:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13902 00000100:00100000:0.0:1746066732.826630:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.828096:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.832843:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e3e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984121088:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066732.832866:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066732.832902:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982435200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6177us (6272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.832910:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6079 00000100:00100000:0.0:1746066732.838579:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.844536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.844582:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.845356:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.845406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.845425:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13905 00000100:00100000:0.0:1746066732.845431:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982436352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066732.845440:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.845457:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa298f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce961 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.845479:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.845481:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066732.845491:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa298f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce961 expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.845506:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa298f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce961 expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066732.845517:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5600, rc 0) 00000100:00100000:0.0:1746066732.845564:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982436352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 133us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.845570:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13905 00000100:00100000:0.0:1746066732.845586:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13906 00000100:00100000:0.0:1746066732.845591:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982436480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066732.845597:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066732.845607:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea4e00/0xf1867c21abfa2996 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ce968 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066732.845648:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984121344:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066732.845705:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b459000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066732.845828:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984121216:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066732.845847:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0400/0xf1867c21abfa2988 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->4501503] (req 4194304->4501503) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce953 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066732.845856:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0400, rc 0) 00000100:00100000:0.0:1746066732.845874:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:32103:x1830882982436096:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6803us (7307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066732.845880:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13903 00000100:00100000:0.0:1746066732.852121:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.856648:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.860973:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.861006:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.861045:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.861073:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982437376 00000100:00100000:0.0:1746066732.861077:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982437376 00002000:00100000:0.0:1746066732.861114:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4497408->4501503) req@ffff88012c493480 x1830882982437376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:138/0 lens 488/0 e 0 to 0 dl 1746066743 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.861125:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882982437376 ext(4497408->4501503) 00002000:00010000:0.0:1746066732.861131:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:0.0:1746066732.861147:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3273 00000100:00100000:0.0:1746066732.861153:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882982437376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066732.861278:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882982437376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 125us (232us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066732.861285:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3273 00002000:00100000:0.0:1746066732.861292:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4497408->4501503) req@ffff88012c493480 x1830882982437376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746066743 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066732.861299:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882982437376 ext(4497408->4501503) 00002000:00010000:0.0:1746066732.861302:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:0.0:1746066732.865169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.865797:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.865873:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.892014:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.897494:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.900714:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.909072:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.912542:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066732.933284:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.018786:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.021467:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984122624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066733.021508:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.022169:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984122624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066733.026936:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.027301:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.027412:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.027444:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982439680 00000100:00100000:0.0:1746066733.027447:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982439680 00000100:00100000:0.0:1746066733.027475:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6082 00000100:00100000:0.0:1746066733.027483:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982439424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.027505:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.027527:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa25d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce715 expref: 9 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.027538:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa25d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce715 expref: 9 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.027563:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa25d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce715 expref: 9 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.028390:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.028418:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882982439424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 936us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.028425:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6082 00000100:00100000:0.0:1746066733.028601:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6083 00000100:00100000:0.0:1746066733.028608:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982439552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.028620:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.028631:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfa2598 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6f2 expref: 10 pid: 12233 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.028640:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfa2598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6f2 expref: 10 pid: 12233 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.028653:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77800/0xf1867c21abfa2598 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce6f2 expref: 10 pid: 12233 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.028661:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.028675:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982439552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.028683:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6083 00000100:00100000:0.0:1746066733.032444:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.038790:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.039953:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.052060:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.055163:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.057243:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.075869:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.085988:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.112712:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.115096:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.139792:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.151297:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.175949:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.180378:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.188281:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.209498:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.219790:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.224799:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.229412:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.230983:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.236269:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.237300:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.239123:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.242087:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.244666:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.246683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.249127:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.249269:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.249323:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.250397:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 651 00000100:00100000:0.0:1746066733.250406:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882982445184:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066733.269565:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.274143:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.282624:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.282662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.282683:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.282714:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.282750:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982446080 00000100:00100000:0.0:1746066733.282758:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982446080 00010000:00010000:0.0:1746066733.282793:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c185a00/0xf1867c21abfa2a06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9c3 expref: 20 pid: 1893 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.282817:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982446336 00000100:00100000:0.0:1746066733.282818:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982446336 00010000:00010000:0.0:1746066733.282828:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa29c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4501504->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce98b expref: 30 pid: 12255 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.282840:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982446464 00000100:00100000:0.0:1746066733.282842:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982446464 00010000:00010000:0.0:1746066733.282852:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc000/0xf1867c21abfa2a1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9d8 expref: 13 pid: 9590 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.282872:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6093 00000100:00100000:0.0:1746066733.282880:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982446080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.282930:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.282954:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c185a00/0xf1867c21abfa2a06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9c3 expref: 20 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.282965:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c185a00/0xf1867c21abfa2a06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9c3 expref: 20 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.282987:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c185a00/0xf1867c21abfa2a06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9c3 expref: 20 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.283008:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.283051:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882982446080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 171us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.283057:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6093 00000100:00100000:0.0:1746066733.283072:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6094 00000100:00100000:0.0:1746066733.283076:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982446336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.283082:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.283089:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa29c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4501504->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce98b expref: 30 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.283096:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa29c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4501504->5033983) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce98b expref: 30 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.283113:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa29c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4501504->5033983) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce98b expref: 30 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.283126:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.283129:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.283136:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfa2a3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->5029887] (req 2097152->2387967) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9fb expref: 29 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.283144:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfa2a3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->5029887] (req 2097152->2387967) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9fb expref: 29 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.283176:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfa2a3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->5029887] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9fb expref: 29 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066733.283188:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984125440:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066733.283247:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4008a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.283357:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6095 00000100:00100000:0.0:1746066733.283363:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882982446464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.283371:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.283384:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc000/0xf1867c21abfa2a1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9d8 expref: 13 pid: 9590 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.283392:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc000/0xf1867c21abfa2a1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9d8 expref: 13 pid: 9590 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.283403:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc000/0xf1867c21abfa2a1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9d8 expref: 13 pid: 9590 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.283416:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.283417:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.283421:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0e00/0xf1867c21abfa2a30 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2674687) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9ed expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.283427:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0e00/0xf1867c21abfa2a30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2674687) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9ed expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.283444:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0e00/0xf1867c21abfa2a30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2674687) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9ed expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066733.283451:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984125568:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066733.283474:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.287476:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.289630:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.293479:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.294341:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.300616:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.313826:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.314379:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.341231:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.353403:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.360114:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.360377:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.360663:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982448512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6805us (7274us total) trans 0 rc 835584/835584 00000100:00100000:0.0:1746066733.360677:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3293 00002000:00100000:0.0:1746066733.360688:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5029887) req@ffff880098482680 x1830882982448512/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/440 e 0 to 0 dl 1746066744 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.360698:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098482680 with x1830882982448512 ext(4194304->5029887) 00002000:00010000:0.0:1746066733.360704:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098482680 00000100:00100000:0.0:1746066733.364685:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.372957:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.374085:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.387476:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.408350:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.440463:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.453442:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.456561:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.457649:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.457713:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982450304 00000100:00100000:0.0:1746066733.457716:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982450304 00010000:00010000:0.0:1746066733.457731:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa2a45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea02 expref: 21 pid: 9590 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.457749:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6099 00000100:00100000:0.0:1746066733.457754:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882982450304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.457761:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.457775:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa2a45 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea02 expref: 21 pid: 9590 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.457788:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa2a45 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea02 expref: 21 pid: 9590 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.457800:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa2a45 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea02 expref: 21 pid: 9590 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.457812:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.457814:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.457817:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3678208->5029887] (req 3678208->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea33 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.457824:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3678208->5029887] (req 3678208->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea33 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.457842:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3678208->5029887] (req 3678208->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea33 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066733.457850:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984126976:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066733.457875:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.460570:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.462323:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.469232:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982451072 00000100:00100000:0.0:1746066733.469243:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982451072 00002000:00100000:0.0:1746066733.469291:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (3899392->3903487) req@ffff880098926d80 x1830882982451072/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.469301:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882982451072 ext(3899392->3903487) 00002000:00010000:0.0:1746066733.469307:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066733.469325:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3298 00000100:00100000:0.0:1746066733.469333:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982451072:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066733.472290:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982451072:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 2942us (3123us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066733.472303:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3298 00002000:00100000:0.0:1746066733.472318:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (3899392->3903487) req@ffff880098926d80 x1830882982451072/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746066744 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.472327:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882982451072 ext(3899392->3903487) 00002000:00010000:0.0:1746066733.472333:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066733.488615:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.502867:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.508101:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.508136:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.508173:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.512113:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.512155:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.525702:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.527292:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882982452352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14791us (15134us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066733.527301:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3300 00002000:00100000:0.0:1746066733.527313:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012e422a00 x1830882982452352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:139/0 lens 488/440 e 0 to 0 dl 1746066744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.527321:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422a00 with x1830882982452352 ext(3145728->4194303) 00010000:00010000:0.0:1746066733.527327:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfa2a6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea2c expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.527336:0:9596:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff880094d06e00/0xf1867c21abfa2a6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea2c expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066733.527343:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e422a00 00000100:00100000:0.0:1746066733.528715:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.533152:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.533198:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.534501:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.535397:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984127744:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.535421:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfa2aa0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea5d expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.535431:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80ea00, rc 0) 00000100:00100000:0.0:1746066733.535620:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+23:32137:x1830882982452608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6404us (6906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.535628:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13940 00000100:00100000:0.0:1746066733.535836:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.542507:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.542542:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.542596:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982453376 00000100:00100000:0.0:1746066733.542608:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982453376 00002000:00100000:0.0:1746066733.542661:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012e423800 x1830882982453376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.542672:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423800 with x1830882982453376 ext(3145728->4194303) 00002000:00010000:0.0:1746066733.542679:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e423800 00000100:00100000:0.0:1746066733.557804:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.558762:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.562520:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.563613:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.569927:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.580177:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.596310:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.596519:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13946 00000100:00100000:0.0:1746066733.596529:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+13:32137:x1830882982455424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066733.596552:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066733.596573:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa2aca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cea87 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.596605:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa2a99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2162688->3145727] (req 2162688->2969599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea56 expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.596614:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066733.596615:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066733.596619:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa2aca lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea87 expref: 14 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.596651:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa2a99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2162688->3145727] (req 2162688->2969599) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea56 expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.596663:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa2a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2162688->3145727] (req 2162688->2969599) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea56 expref: 31 pid: 12237 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.596676:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984128128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.596784:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.600722:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.608120:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882982455552:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7180us (7387us total) trans 17179874063 rc 0/0 00000100:00100000:0.0:1746066733.608135:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 657 00002000:00100000:0.0:1746066733.608148:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2162688->2969599) req@ffff88009677d880 x1830882982455552/t17179874063(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:139/0 lens 488/448 e 0 to 0 dl 1746066744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.608159:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d880 with x1830882982455552 ext(2162688->2969599) 00010000:00010000:0.0:1746066733.608169:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa2a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2162688->3145727] (req 2162688->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea56 expref: 34 pid: 12237 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.608187:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa2a99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2162688->3145727] (req 2162688->2969599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea56 expref: 34 pid: 12237 timeout: 801 lvb_type: 0 00002000:00010000:0.0:1746066733.608194:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677d880 00000100:00100000:0.0:1746066733.618252:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.625230:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.625284:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.650523:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.672547:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.676490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.679957:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.680572:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.684268:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.694730:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.695857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.695914:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.703285:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982458112 00000100:00100000:0.0:1746066733.703295:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982458112 00000100:00100000:0.0:1746066733.703350:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15926 00000100:00100000:0.0:1746066733.703358:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:32141:x1830882982458112:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066733.703377:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066733.703394:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa2b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceab1 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.703492:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfa2b10 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.703506:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa2ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea8e expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.703514:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfa2b10 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.703545:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa2ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea8e expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.703555:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa2ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea8e expref: 16 pid: 7244 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.703567:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984128640:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.703657:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.708201:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.713380:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.721158:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13953 00000100:00100000:0.0:1746066733.721166:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982459136:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066733.721182:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfa2b41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.721192:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfa2a7d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea3a expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.721198:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa2afb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaa3 expref: 13 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.721204:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea48 expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.721209:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa29a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce96f expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.721214:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066733.721215:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066733.721217:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfa2b41 lrc: 7/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.721233:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa29a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce96f expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.721241:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa29a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce96f expref: 22 pid: 12255 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.721253:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129024:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.722150:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea48 expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722158:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea48 expref: 22 pid: 3528 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.722165:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129664:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.722189:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa2afb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaa3 expref: 13 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722197:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa2afb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaa3 expref: 13 pid: 12237 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.722204:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129792:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.722223:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfa2a7d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea3a expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722230:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc000/0xf1867c21abfa2a7d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea3a expref: 32 pid: 11630 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.722236:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129920:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.722248:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.722288:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.722368:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.722489:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982459008 00000100:00100000:0.0:1746066733.722494:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982459008 00000100:00100000:0.0:1746066733.722515:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982459264 00000100:00100000:0.0:1746066733.722516:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982459264 00000100:00100000:0.0:1746066733.722526:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13955 00000100:00100000:0.0:1746066733.722530:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982459008:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066733.722549:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfa2b4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722560:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfa2aa0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea5d expref: 22 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722566:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa2af4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea9c expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722572:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa2aae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea6b expref: 32 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722577:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.722579:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.722581:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfa2b4f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722596:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa2aae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea6b expref: 32 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722602:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa2aae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea6b expref: 32 pid: 1893 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.722609:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984130048:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.722636:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa2af4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea9c expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722643:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa2af4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea9c expref: 14 pid: 12237 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.722651:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984130176:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.722668:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfa2aa0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea5d expref: 22 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722675:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80ea00/0xf1867c21abfa2aa0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea5d expref: 22 pid: 1893 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.722681:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984130304:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.722692:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b459540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.722708:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13956 00000100:00100000:0.0:1746066733.722713:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982459264:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066733.722727:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098f67c00/0xf1867c21abfa2b56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722737:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa2aca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea87 expref: 13 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722748:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa2b02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaaa expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722754:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa2aa7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea64 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722759:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066733.722760:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066733.722762:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67c00/0xf1867c21abfa2b56 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722777:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa2aa7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea64 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722785:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa2aa7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea64 expref: 32 pid: 12237 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.722793:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984130432:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.722815:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa2b02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaaa expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.722823:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa2b02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaaa expref: 12 pid: 12237 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.722830:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984130560:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.722850:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa2aca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea87 expref: 13 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.722856:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa2aca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea87 expref: 13 pid: 12237 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.722862:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984130688:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.722873:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52db240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.734611:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129664:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.734656:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129792:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.734688:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984130432:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.734715:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984130560:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.734739:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129920:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.734762:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984130688:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.734793:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098f67c00/0xf1867c21abfa2b56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066733.734835:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984129024:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.734853:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009629b400/0xf1867c21abfa2b41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066733.734875:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.734931:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982459776 00000100:00100000:0.0:1746066733.734938:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982459776 00010000:00010000:0.0:1746066733.734968:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c185600/0xf1867c21abfa29ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9bc expref: 14 pid: 1893 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.735009:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6108 00000100:00100000:0.0:1746066733.735017:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982459776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.735030:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.735049:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c185600/0xf1867c21abfa29ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9bc expref: 14 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.735058:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c185600/0xf1867c21abfa29ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9bc expref: 14 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.740188:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c185600/0xf1867c21abfa29ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9bc expref: 14 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.740223:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.740291:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882982459776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5272us (5413us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.740301:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6108 00000100:00100000:0.0:1746066733.743753:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.743780:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.744163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.745179:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6110 00000100:00100000:0.0:1746066733.745187:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882982460672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.745195:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.745207:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa29a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce96f expref: 23 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.745215:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa29a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce96f expref: 23 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.745227:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa29a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce96f expref: 23 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.745236:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.746470:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882982460672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1284us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.746476:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6110 00000100:00100000:0.0:1746066733.746695:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982460544 00000100:00100000:0.0:1746066733.746701:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982460544 00010000:00010000:0.0:1746066733.746719:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa2aae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea6b expref: 33 pid: 1893 timeout: 801 lvb_type: 1 00000100:00100000:0.0:1746066733.746875:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6112 00000100:00100000:0.0:1746066733.746892:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982460544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.746899:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.746917:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa2aae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea6b expref: 33 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.746925:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa2aae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea6b expref: 33 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.746941:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa2aae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea6b expref: 33 pid: 1893 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.746949:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.746962:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882982460544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.746967:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6112 00000100:00100000:0.0:1746066733.746975:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6113 00000100:00100000:0.0:1746066733.746978:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982460800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.746985:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.746990:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfa2838 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce873 expref: 13 pid: 12237 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.746997:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfa2838 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce873 expref: 13 pid: 12237 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.747007:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fac600/0xf1867c21abfa2838 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce873 expref: 13 pid: 12237 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.747013:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.747021:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982460800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 42us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.747025:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6113 00000100:00100000:0.0:1746066733.747839:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6118 00000100:00100000:0.0:1746066733.747846:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982459904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.747853:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.747862:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfa29f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9ae expref: 33 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.747869:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfa29f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9ae expref: 33 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.747878:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2000/0xf1867c21abfa29f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce9ae expref: 33 pid: 12255 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.747919:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.747920:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.747923:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.747928:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.747943:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.747956:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982459904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.747960:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6118 00000100:00100000:0.0:1746066733.747971:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6120 00000100:00100000:0.0:1746066733.747975:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982461184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.747980:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.747988:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea48 expref: 20 pid: 3528 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.748000:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea48 expref: 20 pid: 3528 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.748010:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa2a84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cea48 expref: 20 pid: 3528 timeout: 801 lvb_type: 1 00010000:00010000:0.0:1746066733.748018:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.748028:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882982461184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.748033:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6120 00010000:00010000:0.0:1746066733.748935:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748943:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748955:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748961:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748967:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748972:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f7000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066733.748976:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748982:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748990:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.748995:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa2b3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066733.749025:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982458880:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 28032us (28773us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.749032:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13952 00000100:00100000:0.0:1746066733.754879:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.760204:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.760236:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.760947:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.761170:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982462336 00000100:00100000:0.0:1746066733.761174:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982462336 00010000:00010000:0.0:1746066733.761188:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa2720 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce7c4 expref: 35 pid: 10125 timeout: 801 lvb_type: 0 00000100:00100000:0.0:1746066733.761206:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6128 00000100:00100000:0.0:1746066733.761211:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882982462080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.761218:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.761223:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0de00/0xf1867c21abfa23a7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5be expref: 35 pid: 7245 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.761231:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0de00/0xf1867c21abfa23a7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5be expref: 35 pid: 7245 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.762246:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0de00/0xf1867c21abfa23a7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ce5be expref: 35 pid: 7245 timeout: 801 lvb_type: 0 00010000:00010000:0.0:1746066733.762698:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066733.762702:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153000/0xf1867c21abfa2b5d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066733.762707:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.762726:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982462080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1514us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.762732:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6128 00000100:00100000:0.0:1746066733.762833:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.766578:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.767078:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746066733.771192:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936194 is committed 00000004:00080000:0.0:1746066733.771202:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 350 committed 00000004:00080000:0.0:1746066733.771220:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 389 committed 00000004:00080000:0.0:1746066733.771233:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 388 committed 00000004:00080000:0.0:1746066733.771235:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 387 committed 00000004:00080000:0.0:1746066733.771236:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 386 committed 00000004:00080000:0.0:1746066733.771238:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 349 committed 00000004:00080000:0.0:1746066733.771239:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 385 committed 00000004:00080000:0.0:1746066733.771240:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 348 committed 00000004:00080000:0.0:1746066733.771242:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 384 committed 00000004:00080000:0.0:1746066733.771244:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 347 committed 00000004:00080000:0.0:1746066733.771245:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 346 committed 00000004:00080000:0.0:1746066733.771246:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 345 committed 00000004:00080000:0.0:1746066733.771248:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 383 committed 00000004:00080000:0.0:1746066733.771249:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 382 committed 00000004:00080000:0.0:1746066733.771250:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 344 committed 00000004:00080000:0.0:1746066733.771252:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 343 committed 00000004:00080000:0.0:1746066733.771253:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 381 committed 00000001:00080000:0.0:1746066733.771260:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936193 is committed 00000001:00080000:0.0:1746066733.771265:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936192 is committed 00000100:00100000:0.0:1746066733.771804:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984132352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.771836:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.771868:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984132864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.771879:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.771916:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984133376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.771933:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.771941:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984133888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.771963:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.771978:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746066733.771982:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984133504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.772002:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984132352 00000100:00100000:0.0:1746066733.772009:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984132352 00000100:00100000:0.0:1746066733.772048:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984132864 00000100:00100000:0.0:1746066733.772049:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984132864 00000100:00100000:0.0:1746066733.772056:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984133376 00000100:00100000:0.0:1746066733.772057:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984133376 00000100:00100000:0.0:1746066733.772065:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984133888 00000100:00100000:0.0:1746066733.772066:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984133888 00000100:00100000:0.0:1746066733.772071:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984132608 00000100:00100000:0.0:1746066733.772072:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984132608 00000100:00100000:0.0:1746066733.772078:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984133632 00000100:00100000:0.0:1746066733.772080:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984133632 00000100:00100000:0.0:1746066733.772089:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13957 00000100:00100000:0.0:1746066733.772095:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3774:x1830882984132352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.772346:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882984132352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 250us (509us total) trans 17179874064 rc 0/0 00000100:00100000:0.0:1746066733.772360:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13957 00000100:00100000:0.0:1746066733.772374:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13961 00000100:00100000:0.0:1746066733.772378:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984132096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.772433:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882984132096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (481us total) trans 17179874066 rc 0/0 00000100:00100000:0.0:1746066733.772437:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13961 00000100:00100000:0.0:1746066733.772448:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13963 00000100:00100000:0.0:1746066733.772452:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882984133120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.772504:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984133120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (486us total) trans 21474841473 rc 0/0 00000100:00100000:0.0:1746066733.772508:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13963 00000100:00100000:0.0:1746066733.772519:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13966 00000100:00100000:0.0:1746066733.772523:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984132480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066733.772560:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066733.772562:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.772564:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:0.0:1746066733.772565:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.772567:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:0.0:1746066733.772586:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984132480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (430us total) trans 17179874069 rc 0/0 00000100:00100000:0.0:1746066733.772592:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13966 00000100:00100000:0.0:1746066733.772602:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13969 00000100:00100000:0.0:1746066733.772606:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984132736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.773580:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984132736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 971us (1300us total) trans 17179874071 rc 0/0 00000100:00100000:0.0:1746066733.773586:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13969 00000100:00080000:0.0:1746066733.773617:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066733.773620:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066733.773630:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066733.773654:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d88000/2, rc 0, transno 17179874064 00000100:00100000:0.0:1746066733.773658:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984132352:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066733.773667:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098927480/2, rc 0, transno 21474841471 00000100:00100000:0.0:1746066733.773671:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984133888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.773683:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984133504 00000100:00100000:0.0:1746066733.773688:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984133504 00000100:00100000:0.0:1746066733.773706:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13972 00000100:00100000:0.0:1746066733.773711:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3774:x1830882984133504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066733.773767:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066733.773770:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.773772:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066733.773773:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.773775:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:0.0:1746066733.773796:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3774:x1830882984133504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (165us total) trans 21474841478 rc 0/0 00000100:00100000:0.0:1746066733.773802:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13972 00000004:00080000:0.0:1746066733.773822:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098924000/2, rc 0, transno 21474841478 00000100:00100000:0.0:1746066733.773826:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984133504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066733.773833:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d8b100/2, rc 0, transno 17179874065 00000100:00100000:0.0:1746066733.773835:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984132864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066733.774099:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098925180/2, rc 0, transno 21474841472 00000100:00100000:0.0:1746066733.774103:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984133376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.774444:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746066733.774454:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984134016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.774476:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.779506:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.787166:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.789083:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.791124:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.803044:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.804982:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.808069:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.809076:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.809113:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.809128:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982465792 00000100:00100000:0.0:1746066733.809130:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982465792 00000100:00100000:0.0:1746066733.809149:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15933 00000100:00100000:0.0:1746066733.809155:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:32152:x1830882982465792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066733.809165:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066733.809173:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa2bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceb05 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.809217:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37000/0xf1867c21abfa2bc6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.809224:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37000/0xf1867c21abfa2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.809233:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37000/0xf1867c21abfa2bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746066733.809243:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066733.809332:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa2bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb05 expref: 31 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.809350:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37000/0xf1867c21abfa2bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb05 expref: 30 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.809357:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066733.809360:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746066733.809362:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa2bb8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066733.809368:0:7244:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa2bb8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066733.809373:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37000, rc 0) 00000100:00100000:0.0:1746066733.809397:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:32152:x1830882982465792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 242us (284us total) trans 8589936199 rc 0/0 00000100:00100000:0.0:1746066733.809404:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15933 00000100:00100000:0.0:1746066733.809774:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982465408 00000100:00100000:0.0:1746066733.809777:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982465408 00000100:00100000:0.0:1746066733.809796:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 13978 00000100:00100000:0.0:1746066733.809800:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882982465408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066733.809809:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066733.809816:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfa2bf7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceaf7 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066733.809826:0:12237:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd2e, atime: 0x6812dd2d, ctime: 0x6812dd2e, blocks: 0x1668 00010000:00010000:0.0:1746066733.809831:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.809833:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.809836:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfa2bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaf7 expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.809844:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37200/0xf1867c21abfa2bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaf7 expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.809850:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37200, rc 0) 00000100:00100000:0.0:1746066733.809864:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882982465408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.809870:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 13978 00000100:00100000:0.0:1746066733.810408:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.810446:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.811054:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.811066:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982466176 00000100:00100000:0.0:1746066733.811068:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982466176 00000100:00100000:0.0:1746066733.811083:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15934 00000100:00100000:0.0:1746066733.811086:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:32152:x1830882982466176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066733.811095:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066733.811101:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa2c05 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceb0c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.811148:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfa2c0c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.811155:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa2bb8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceadb expref: 10 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.811161:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfa2c0c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.811181:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa2bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceadb expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.811193:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa2bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceadb expref: 9 pid: 10125 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066733.811202:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984134400:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.811444:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.811849:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.813809:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.816468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.817034:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.817328:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.817635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.817846:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982467072 00000100:00100000:0.0:1746066733.817848:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982467072 00000100:00100000:0.0:1746066733.818651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.818682:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.818729:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.818770:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.818795:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.818810:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982467584 00000100:00100000:0.0:1746066733.818813:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982467584 00010000:00010000:0.0:1746066733.818830:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37000/0xf1867c21abfa2bc6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb05 expref: 30 pid: 7244 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066733.818845:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982467712 00000100:00100000:0.0:1746066733.818847:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982467712 00010000:00010000:0.0:1746066733.818855:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa2b64 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceabf expref: 10 pid: 10125 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066733.818866:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6136 00000100:00100000:0.0:1746066733.818871:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982467584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.818893:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.818898:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37000/0xf1867c21abfa2bc6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb05 expref: 30 pid: 7244 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.818917:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37000/0xf1867c21abfa2bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb05 expref: 30 pid: 7244 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.818931:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066733.818935:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa2c21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.818941:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa2c21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.818945:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.818962:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982467584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.818968:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6136 00000100:00100000:0.0:1746066733.818978:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6137 00000100:00100000:0.0:1746066733.818982:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982467712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.818988:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.818992:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa2b64 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceabf expref: 10 pid: 10125 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.818998:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa2b64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceabf expref: 10 pid: 10125 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.819008:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066733.819010:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa2c21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.819016:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa2c21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.819020:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.819032:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982467712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.819036:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6137 00000100:00100000:0.0:1746066733.819096:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.819108:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982467840 00000100:00100000:0.0:1746066733.819111:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982467840 00010000:00010000:0.0:1746066733.819120:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfa2c0c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb0c expref: 30 pid: 7244 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066733.819134:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6138 00000100:00100000:0.0:1746066733.819138:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982467840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.819143:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.819146:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfa2c0c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb0c expref: 30 pid: 7244 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.819153:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd15c00/0xf1867c21abfa2c0c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb0c expref: 30 pid: 7244 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.819161:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066733.819164:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa2c21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.819170:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa2c21 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.819175:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa2c21 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066733.819187:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.819199:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982467840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.819203:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6138 00000100:00100000:0.0:1746066733.823616:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.823655:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.824325:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.824343:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982468480 00000100:00100000:0.0:1746066733.824346:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982468480 00002000:00100000:0.0:1746066733.824367:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800b40b6300 x1830882982468480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.824380:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b6300 with x1830882982468480 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.824384:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b40b6300 00000100:00100000:0.0:1746066733.824405:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3311 00000100:00100000:0.0:1746066733.824413:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882982468480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066733.825572:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982468736 00000100:00100000:0.0:1746066733.825577:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982468736 00002000:00100000:0.0:1746066733.825601:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88011f766a00 x1830882982468736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.825609:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766a00 with x1830882982468736 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.825613:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f766a00 00000100:00100000:0.0:1746066733.826284:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982468992 00000100:00100000:0.0:1746066733.826288:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982468992 00002000:00100000:0.0:1746066733.826304:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88011f765f80 x1830882982468992/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.826310:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f765f80 with x1830882982468992 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.826313:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f765f80 00000100:00100000:0.0:1746066733.826331:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3312 00000100:00100000:0.0:1746066733.826337:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982468736:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066733.827013:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.827037:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827048:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.827062:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827070:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.827084:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827090:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.827103:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827113:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746066733.827117:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.827131:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827138:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.827152:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827158:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.827176:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827183:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.827196:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066733.827212:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984135296 00000100:00100000:0.0:1746066733.827215:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984135296 00000100:00100000:0.0:1746066733.828127:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984136192 00000100:00100000:0.0:1746066733.828129:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984136192 00000100:00100000:0.0:1746066733.828141:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13987 00000100:00100000:0.0:1746066733.828146:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984135552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066733.828214:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3777:x1830882984135552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1726us total) trans 17179874074 rc 0/0 00000100:00100000:0.0:1746066733.828219:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13987 00000100:00100000:0.0:1746066733.828231:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13991 00000100:00100000:0.0:1746066733.828235:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3777:x1830882984136576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066733.828295:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3777:x1830882984136576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1641us total) trans 21474841480 rc 0/0 00000100:00100000:0.0:1746066733.828303:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13991 00000100:00100000:0.0:1746066733.828311:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13994 00000100:00100000:0.0:1746066733.828315:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984135296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066733.828349:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066733.828351:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.828353:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:0.0:1746066733.828355:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.828356:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:0.0:1746066733.828373:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984135296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (1337us total) trans 17179874076 rc 0/0 00000100:00100000:0.0:1746066733.828378:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13994 00000100:00100000:0.0:1746066733.828386:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13997 00000100:00100000:0.0:1746066733.828390:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882984136832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066733.828422:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:0.0:1746066733.828424:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.828426:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066733.828428:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066733.828430:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:0.0:1746066733.828442:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3775:x1830882984136832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1338us total) trans 21474841485 rc 0/0 00000100:00100000:0.0:1746066733.828447:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13997 00000100:00100000:0.0:1746066733.828453:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14000 00000100:00100000:0.0:1746066733.828457:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882984136192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066733.828484:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:0.0:1746066733.828487:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066733.828488:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066733 -> 1746066733 00002000:00010000:0.0:1746066733.828490:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066733.828492:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:0.0:1746066733.828516:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3775:x1830882984136192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (1339us total) trans 21474841486 rc 0/0 00000100:00100000:0.0:1746066733.828520:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14000 00000004:00080000:0.0:1746066733.828549:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098924700/2, rc 0, transno 17179874078 00000100:00100000:0.0:1746066733.828554:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066733.828561:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d7480/2, rc 0, transno 17179874079 00000100:00100000:0.0:1746066733.828564:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066733.828571:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d4380/2, rc 0, transno 21474841486 00000100:00100000:0.0:1746066733.828578:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066733.828584:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d5f80/2, rc 0, transno 21474841487 00000100:00100000:0.0:1746066733.828587:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066733.828593:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098925500/2, rc 0, transno 17179874076 00000100:00100000:0.0:1746066733.828595:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066733.828601:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d5180/2, rc 0, transno 17179874077 00000100:00100000:0.0:1746066733.828603:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984135808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066733.828609:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d5500/2, rc 0, transno 21474841484 00000100:00100000:0.0:1746066733.828612:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066733.828617:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d4700/2, rc 0, transno 21474841485 00000100:00100000:0.0:1746066733.828620:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984136832:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066733.828669:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066733.828672:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066733.828674:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066733.828675:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066733.828677:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066733.828699:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3777:x1830882984136064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 472us (2068us total) trans 21474841481 rc 0/0 00000100:00100000:0.0:1746066733.828704:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13990 00000100:00100000:0.0:1746066733.835513:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.846123:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.847976:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.850282:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.850302:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.855800:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.857988:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.858024:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.858039:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.858072:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.872585:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.872628:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.872657:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.872828:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982470144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14522us (14995us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066733.872839:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3315 00002000:00100000:0.0:1746066733.872851:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130d8ad80 x1830882982470144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:139/0 lens 488/440 e 0 to 0 dl 1746066744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.872861:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8ad80 with x1830882982470144 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.872868:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8ad80 00000100:00100000:0.0:1746066733.872926:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982471296 00000100:00100000:0.0:1746066733.872933:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982471296 00002000:00100000:0.0:1746066733.872965:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880098925880 x1830882982471296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.872972:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925880 with x1830882982471296 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.872976:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098925880 00000100:00100000:0.0:1746066733.872987:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982471808 00000100:00100000:0.0:1746066733.872989:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982471808 00002000:00100000:0.0:1746066733.872999:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88011f765c00 x1830882982471808/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.873006:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f765c00 with x1830882982471808 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.873009:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f765c00 00000100:00100000:0.0:1746066733.873016:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982471552 00000100:00100000:0.0:1746066733.873018:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982471552 00002000:00100000:0.0:1746066733.873026:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88011f766680 x1830882982471552/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.873032:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766680 with x1830882982471552 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.873035:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f766680 00000100:00100000:0.0:1746066733.873045:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3319 00000100:00100000:0.0:1746066733.873051:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882982471296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066733.879062:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.879117:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.879161:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982472192 00000100:00100000:0.0:1746066733.879170:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982472192 00000100:00100000:0.0:1746066733.879216:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14005 00000100:00100000:0.0:1746066733.879225:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:32151:x1830882982472192:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066733.879245:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066733.879263:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfa2c67 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceb60 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.879294:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6600/0xf1867c21abfa2bf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceafe expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.879303:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47e00/0xf1867c21abfa2c4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb44 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.879309:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.879311:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.879314:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba200/0xf1867c21abfa2c67 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->3346431] (req 3145728->3346431) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb60 expref: 36 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.879349:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47e00/0xf1867c21abfa2c4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb44 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.879360:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47e00/0xf1867c21abfa2c4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb44 expref: 36 pid: 9592 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066733.879372:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f765500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984137728:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066733.879462:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f6600/0xf1867c21abfa2bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceafe expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066733.879471:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6600/0xf1867c21abfa2bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceafe expref: 17 pid: 11630 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066733.879480:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f767100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984137856:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066733.879499:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.879519:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982472064 00000100:00100000:0.0:1746066733.879522:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982472064 00002000:00100000:0.0:1746066733.879550:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3846144->4194303) req@ffff88011f764700 x1830882982472064/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.879559:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764700 with x1830882982472064 ext(3846144->4194303) 00010000:00010000:0.0:1746066733.879566:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.879575:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746066733.879581:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f764700 00000100:00100000:0.0:1746066733.879597:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 659 00000100:00100000:0.0:1746066733.879603:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982472064:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066733.879805:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982470784:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20196us (21763us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066733.879813:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3317 00002000:00100000:0.0:1746066733.879820:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880098fbdc00 x1830882982470784/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:139/0 lens 488/440 e 0 to 0 dl 1746066744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.879828:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdc00 with x1830882982470784 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.879832:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbdc00 00000100:00100000:0.0:1746066733.887625:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982472064:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8011us (8563us total) trans 21474841489 rc 0/0 00000100:00100000:0.0:1746066733.887638:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 659 00002000:00100000:0.0:1746066733.887651:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3846144->4194303) req@ffff88011f764700 x1830882982472064/t21474841489(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:139/0 lens 488/448 e 0 to 0 dl 1746066744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.887660:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764700 with x1830882982472064 ext(3846144->4194303) 00010000:00010000:0.0:1746066733.887671:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.887684:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746066733.887691:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f764700 00000100:00100000:0.0:1746066733.888827:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.888858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.889035:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882982471808:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15242us (16405us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066733.889043:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3320 00002000:00100000:0.0:1746066733.889050:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88011f765c00 x1830882982471808/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/440 e 0 to 0 dl 1746066744 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.889059:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f765c00 with x1830882982471808 ext(1048576->2097151) 00002000:00010000:0.0:1746066733.889062:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f765c00 00000100:00100000:0.0:1746066733.890368:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982472576 00000100:00100000:0.0:1746066733.890372:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982472576 00010000:00010000:0.0:1746066733.890391:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066733.890450:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6143 00000100:00100000:0.0:1746066733.890457:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982472576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066733.890467:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066733.890483:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.890493:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.890510:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa2c59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb52 expref: 35 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.890538:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.890540:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066733.890544:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfa2c60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2162688->2269183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb59 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.890551:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfa2c60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2162688->2269183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb59 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066733.890572:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfa2c60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2162688->2269183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb59 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066733.890582:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984138112:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066733.890639:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066733.893963:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984138112:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066733.893981:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066733.894025:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882982472576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3567us (3721us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.894036:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6143 00000100:00100000:0.0:1746066733.895588:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.895859:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.895919:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.900703:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982473728 00000100:00100000:0.0:1746066733.900711:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982473728 00000100:00100000:0.0:1746066733.900752:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982473984 00000100:00100000:0.0:1746066733.900754:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982473984 00000100:00100000:0.0:1746066733.900781:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982473856 00000100:00100000:0.0:1746066733.900783:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982473856 00000100:00100000:0.0:1746066733.900796:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 865 00000100:00100000:0.0:1746066733.900802:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+365:2015:x1830882982473728:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066733.900842:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+365:2015:x1830882982473728:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 41us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.902456:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 865 00000100:00100000:0.0:1746066733.902470:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 867 00000100:00100000:0.0:1746066733.902476:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+5:2015:x1830882982473856:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066733.902500:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+5:2015:x1830882982473856:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.902506:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 867 00000100:00100000:0.0:1746066733.902522:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982473600 00000100:00100000:0.0:1746066733.902526:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982473600 00000100:00100000:0.0:1746066733.902544:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 175 00000100:00100000:0.0:1746066733.902549:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2015:x1830882982473600:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066733.902566:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2015:x1830882982473600:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 18us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066733.902571:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 175 00000100:00080000:0.0:1746066733.902591:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066733.907297:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.907343:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.907437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.911941:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982474880:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3812us (4497us total) trans 21474841490 rc 0/0 00000100:00100000:0.0:1746066733.911952:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 662 00002000:00100000:0.0:1746066733.911962:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2162688->2269183) req@ffff8800a03d4a80 x1830882982474880/t21474841490(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/448 e 0 to 0 dl 1746066744 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.911970:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882982474880 ext(2162688->2269183) 00010000:00010000:0.0:1746066733.911978:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfa2c60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2162688->2269183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb59 expref: 24 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066733.911988:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77400/0xf1867c21abfa2c60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2162688->2269183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb59 expref: 24 pid: 9590 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746066733.911995:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d4a80 00000100:00100000:0.0:1746066733.915135:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.917035:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.926205:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.938007:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.941560:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.945360:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.945412:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.946199:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.946214:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982476928 00000100:00100000:0.0:1746066733.946217:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982476928 00002000:00100000:0.0:1746066733.946235:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88009677df80 x1830882982476928/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:139/0 lens 488/0 e 0 to 0 dl 1746066744 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066733.946242:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677df80 with x1830882982476928 ext(3145728->4194303) 00002000:00010000:0.0:1746066733.946245:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677df80 00000100:00100000:0.0:1746066733.946271:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3327 00000100:00100000:0.0:1746066733.946276:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982476928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066733.971812:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.977592:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.989155:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066733.992807:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.007435:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066734.008096:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746066734.011607:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066734.011611:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066734.011835:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.011873:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.011943:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.012115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.016025:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.020862:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066734.021507:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a000/0xf1867c21abfa2cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066734.021518:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a000/0xf1867c21abfa2cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066734.021539:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066734.021678:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848ac00/0xf1867c21abfa2cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebb4 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.021698:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a000/0xf1867c21abfa2cd7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebb4 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.021706:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066734.021708:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066734.021711:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a000, rc 0) 00000100:00100000:0.0:1746066734.021746:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32159:x1830882982479232:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4938us (5730us total) trans 8589936206 rc 0/0 00000100:00100000:0.0:1746066734.021754:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15939 00000100:00100000:0.0:1746066734.024267:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.029758:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.035115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.039492:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14018 00000100:00100000:0.0:1746066734.039500:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982480256:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066734.039517:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfa2d16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.039527:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d600/0xf1867c21abfa2be2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceae9 expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.039539:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfa2cb4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb98 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.039546:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa2c36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb2f expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.039552:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.039553:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.039555:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097017400/0xf1867c21abfa2d16 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.039570:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa2c36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb2f expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.039578:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa2c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb2f expref: 34 pid: 9592 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.039586:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984139392:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.039613:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfa2cb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb98 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.039619:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135974e00/0xf1867c21abfa2cb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb98 expref: 11 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.039627:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984139520:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.039647:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d600/0xf1867c21abfa2be2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceae9 expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.039654:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d600/0xf1867c21abfa2be2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceae9 expref: 13 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.039661:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984139648:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.039677:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.040361:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982480384 00000100:00100000:0.0:1746066734.040365:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982480384 00000100:00100000:0.0:1746066734.040384:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982480512 00000100:00100000:0.0:1746066734.040386:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982480512 00000100:00100000:0.0:1746066734.040408:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982480640 00000100:00100000:0.0:1746066734.040410:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982480640 00000100:00100000:0.0:1746066734.040423:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14019 00000100:00100000:0.0:1746066734.040428:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982480384:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066734.040446:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa2d1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040455:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009414ca00/0xf1867c21abfa2be9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaf0 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040463:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848a800/0xf1867c21abfa2cc2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb9f expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040470:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa2c3d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb36 expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040481:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.040482:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.040484:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa2d1d lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040498:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa2c3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb36 expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040506:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa2c3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb36 expref: 34 pid: 9592 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.040514:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984140160:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.040554:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009848a800/0xf1867c21abfa2cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb9f expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040561:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009848a800/0xf1867c21abfa2cc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb9f expref: 14 pid: 20361 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.040568:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984140288:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.040586:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009414ca00/0xf1867c21abfa2be9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaf0 expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040593:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009414ca00/0xf1867c21abfa2be9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaf0 expref: 23 pid: 11630 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.040605:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984140416:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.040616:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.040634:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14020 00000100:00100000:0.0:1746066734.040639:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982480512:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066734.040653:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5728200/0xf1867c21abfa2d24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040663:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa2c6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb67 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040670:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135974400/0xf1867c21abfa2cbb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceba6 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040677:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa2c83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb7c expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040682:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.040684:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.040686:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728200/0xf1867c21abfa2d24 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040699:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa2c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb7c expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040707:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa2c83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb7c expref: 23 pid: 12233 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.040715:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984140544:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.040735:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135974400/0xf1867c21abfa2cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceba6 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040742:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135974400/0xf1867c21abfa2cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceba6 expref: 14 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.040749:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984140672:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.040765:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa2c6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb67 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040772:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa2c6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb67 expref: 34 pid: 9590 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.040779:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984140800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.040791:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a86b5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.040878:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14021 00000100:00100000:0.0:1746066734.040908:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982480640:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066734.040925:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040935:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa2c75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb6e expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040947:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135975200/0xf1867c21abfa2cc9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebad expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.040954:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfa2c7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb75 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040959:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.040961:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.040963:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040977:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfa2c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb75 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.040985:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfa2c7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb75 expref: 34 pid: 9590 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.040994:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984140928:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.041017:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135975200/0xf1867c21abfa2cc9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebad expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.041024:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135975200/0xf1867c21abfa2cc9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebad expref: 12 pid: 12233 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.041032:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984141056:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.041048:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa2c75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb6e expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.041056:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa2c75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb6e expref: 13 pid: 9590 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.041063:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984141184:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.041075:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009691b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.045243:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.045276:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.045303:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982480768 00000100:00100000:0.0:1746066734.045305:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982480768 00010000:00010000:0.0:1746066734.045333:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa2c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb2f expref: 35 pid: 9592 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.045356:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6148 00000100:00100000:0.0:1746066734.045363:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982480768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.045377:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.045396:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa2c36 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb2f expref: 35 pid: 9592 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.045405:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa2c36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb2f expref: 35 pid: 9592 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.045446:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.045484:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982480768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.045492:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6148 00000100:00100000:0.0:1746066734.046700:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.046722:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.046746:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.046769:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.046786:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.046798:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982481536 00000100:00100000:0.0:1746066734.046799:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982481536 00010000:00010000:0.0:1746066734.046810:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa2bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cead4 expref: 24 pid: 11630 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.046819:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982481408 00000100:00100000:0.0:1746066734.046821:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982481408 00010000:00010000:0.0:1746066734.046828:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa2ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb8a expref: 15 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.046836:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6151 00000100:00100000:0.0:1746066734.046840:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982481536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.046845:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.046855:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa2bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cead4 expref: 24 pid: 11630 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.046862:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa2bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cead4 expref: 24 pid: 11630 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.046871:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa2bd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cead4 expref: 24 pid: 11630 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.046920:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.046940:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882982481536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.046945:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6151 00000100:00100000:0.0:1746066734.046955:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6153 00000100:00100000:0.0:1746066734.046959:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982481408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.046963:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.046969:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa2ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb8a expref: 15 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.046976:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa2ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb8a expref: 15 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.046985:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa2ca6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb8a expref: 15 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.046992:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.047001:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982481408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 43us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.047006:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6153 00000100:00100000:0.0:1746066734.047033:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.047042:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982481792 00000100:00100000:0.0:1746066734.047044:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982481792 00010000:00010000:0.0:1746066734.047052:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa2c28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb21 expref: 35 pid: 9592 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.047065:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6154 00000100:00100000:0.0:1746066734.047068:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882982481792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.047073:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.047078:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa2c28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb21 expref: 35 pid: 9592 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.047085:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa2c28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb21 expref: 35 pid: 9592 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.047093:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa2c28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb21 expref: 35 pid: 9592 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.047100:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.047101:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.047105:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047113:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047130:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.047142:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882982481792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.047147:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6154 00010000:00010000:0.0:1746066734.047225:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047236:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047252:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047259:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047266:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047272:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f77800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066734.047276:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047284:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047293:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.047299:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa2d0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.047347:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982480000:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 8092us (8539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.047355:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14016 00000100:00100000:0.0:1746066734.058297:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.058370:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.058400:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.058466:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984140544:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.058501:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.058522:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982481664 00000100:00100000:0.0:1746066734.058529:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982481664 00010000:00010000:0.0:1746066734.058563:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa2bdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceae2 expref: 13 pid: 20361 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.058586:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982481920 00000100:00100000:0.0:1746066734.058588:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982481920 00010000:00010000:0.0:1746066734.058598:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009848a800/0xf1867c21abfa2cc2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb9f expref: 13 pid: 20361 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.058609:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982482048 00000100:00100000:0.0:1746066734.058611:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982482048 00010000:00010000:0.0:1746066734.058619:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa2c3d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb36 expref: 34 pid: 9592 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.058627:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982482176 00000100:00100000:0.0:1746066734.058628:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982482176 00010000:00010000:0.0:1746066734.058635:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009414ca00/0xf1867c21abfa2be9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceaf0 expref: 23 pid: 11630 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.058645:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6156 00000100:00100000:0.0:1746066734.058651:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982481664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.058665:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.058686:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa2bdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceae2 expref: 13 pid: 20361 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.058696:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa2bdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceae2 expref: 13 pid: 20361 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.058721:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa2bdb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceae2 expref: 13 pid: 20361 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.058738:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.058740:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.058744:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa2d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.058752:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa2d08 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.058775:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.058815:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982481664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 162us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.058821:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6156 00000100:00100000:0.0:1746066734.061818:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984141184:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.061833:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.062759:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982482560 00000100:00100000:0.0:1746066734.062767:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982482560 00010000:00010000:0.0:1746066734.062793:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135974400/0xf1867c21abfa2cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceba6 expref: 11 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.062820:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982482304 00000100:00100000:0.0:1746066734.062823:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982482304 00010000:00010000:0.0:1746066734.062833:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa2c83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb7c expref: 22 pid: 12233 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.062845:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982482688 00000100:00100000:0.0:1746066734.062848:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982482688 00010000:00010000:0.0:1746066734.062857:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfa2c7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb75 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.062866:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982482432 00000100:00100000:0.0:1746066734.062868:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982482432 00010000:00010000:0.0:1746066734.062876:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa2c6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb67 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.062912:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6160 00000100:00100000:0.0:1746066734.062919:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982482560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.062930:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.062948:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135974400/0xf1867c21abfa2cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceba6 expref: 11 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.062957:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135974400/0xf1867c21abfa2cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceba6 expref: 11 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.062976:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135974400/0xf1867c21abfa2cbb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceba6 expref: 11 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.062993:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.063028:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982482560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.063035:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6160 00000100:00100000:0.0:1746066734.063048:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6161 00000100:00100000:0.0:1746066734.063053:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882982482304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.063059:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.063066:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa2c83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb7c expref: 22 pid: 12233 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063076:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa2c83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb7c expref: 22 pid: 12233 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063086:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa2c83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb7c expref: 22 pid: 12233 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063094:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.063108:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982482304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.063114:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6161 00000100:00100000:0.0:1746066734.063123:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6162 00000100:00100000:0.0:1746066734.063127:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982482688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.063134:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.063144:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfa2c7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb75 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063152:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfa2c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb75 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063164:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2d600/0xf1867c21abfa2c7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb75 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063172:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.063185:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882982482688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.063190:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6162 00000100:00100000:0.0:1746066734.063200:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6163 00000100:00100000:0.0:1746066734.063205:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982482432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.063211:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.063217:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa2c6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb67 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063224:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa2c6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb67 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063234:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa2c6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceb67 expref: 33 pid: 9590 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.063242:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.063243:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.063247:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5728200/0xf1867c21abfa2d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.063255:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5728200/0xf1867c21abfa2d24 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.063279:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.063293:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882982482432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 88us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.063298:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6163 00010000:00010000:0.0:1746066734.066416:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066424:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066439:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066446:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066452:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066458:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa44c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066734.066461:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066478:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066489:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.066495:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa2d2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.066532:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2016:x1830882982480640:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 25648us (26400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.066538:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14021 00000100:00100000:0.0:1746066734.068327:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.070982:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.071049:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.076778:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984141952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.077603:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14027 00000100:00100000:0.0:1746066734.077610:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882984142720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.077669:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882984142720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (443us total) trans 17179874082 rc 0/0 00000100:00100000:0.0:1746066734.077673:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14027 00000100:00100000:0.0:1746066734.077691:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.077703:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984142336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.077716:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.077724:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984142848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066734.077735:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.077741:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984143360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066734.077750:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.077771:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984142336 00000100:00100000:0.0:1746066734.077773:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984142336 00000100:00100000:0.0:1746066734.077784:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984142848 00000100:00100000:0.0:1746066734.077786:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984142848 00000100:00100000:0.0:1746066734.077795:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14030 00000100:00100000:0.0:1746066734.077799:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984142336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066734.077834:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066734.077837:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.077838:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066734.077840:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.077842:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066734.078157:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882984142336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 355us (437us total) trans 17179874084 rc 0/0 00000100:00100000:0.0:1746066734.078161:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14030 00000100:00100000:0.0:1746066734.078171:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14032 00000100:00100000:0.0:1746066734.078175:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3775:x1830882984142848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066734.078211:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066734.078214:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.078215:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066734.078217:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.078219:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:0.0:1746066734.078721:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3775:x1830882984142848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 545us (984us total) trans 21474841494 rc 0/0 00000100:00100000:0.0:1746066734.078726:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14032 00000004:00080000:0.0:1746066734.078744:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83800/2, rc 0, transno 17179874084 00000100:00100000:0.0:1746066734.078747:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984142336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066734.078752:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d7b80/2, rc 0, transno 21474841494 00000100:00100000:0.0:1746066734.078755:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984142848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066734.078759:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d7800/2, rc 0, transno 21474841493 00000100:00100000:0.0:1746066734.078761:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984143360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066734.079428:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984141952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1631us (1735us total) trans 17179874085 rc 0/0 00000100:00100000:0.0:1746066734.079434:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14029 00000004:00080000:0.0:1746066734.079452:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81f80/2, rc 0, transno 17179874085 00000100:00100000:0.0:1746066734.079455:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984141952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.081315:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.084104:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.086164:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.087731:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.088249:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.088276:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.088290:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982484096 00000100:00100000:0.0:1746066734.088293:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982484096 00000100:00100000:0.0:1746066734.088770:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982484224 00000100:00100000:0.0:1746066734.088773:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982484224 00000100:00100000:0.0:1746066734.088844:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14042 00000100:00100000:0.0:1746066734.088851:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982484224:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066734.088859:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.088869:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa2d63 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cebec expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066734.088909:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd2e, atime: 0x6812dd2e, ctime: 0x6812dd2e, blocks: 0x800 00010000:00010000:0.0:1746066734.088919:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.088920:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.088925:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa2d63 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebec expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.088935:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa2d63 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebec expref: 11 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.088943:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a5ce00, rc 0) 00000100:00100000:0.0:1746066734.088967:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982484224:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 116us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.088972:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14042 00000100:00100000:0.0:1746066734.089007:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.089049:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.089064:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982484480 00000100:00100000:0.0:1746066734.089067:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982484480 00000100:00100000:0.0:1746066734.089579:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14044 00000100:00100000:0.0:1746066734.089588:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982484480:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066734.089597:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.089607:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa2d71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cebfa expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066734.089618:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd2e, atime: 0x6812dd2e, ctime: 0x6812dd2e, blocks: 0x1000 00010000:00010000:0.0:1746066734.089681:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.089684:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.089689:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa2d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebfa expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.089700:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa2d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebfa expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.089708:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2000, rc 0) 00000100:00100000:0.0:1746066734.089727:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982484480:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 141us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.089733:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14044 00000100:00100000:0.0:1746066734.093317:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.093363:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.093439:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.093546:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.093642:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.095156:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.099230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.099271:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.099971:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.100397:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.100463:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.101089:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.105318:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.114781:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.123282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.128439:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982487424 00000100:00100000:0.0:1746066734.128449:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982487424 00000100:00100000:0.0:1746066734.129913:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982487168 00000100:00100000:0.0:1746066734.129919:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982487168 00000100:00100000:0.0:1746066734.130978:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15947 00000100:00100000:0.0:1746066734.130989:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:32162:x1830882982487168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.131005:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.131019:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa2dc5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cec08 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.131279:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa2dcc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.131293:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa2dcc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.131303:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa2dcc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066734.131326:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:0.0:1746066734.131329:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066734.131343:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa2dcc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.131366:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa2dc5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec08 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.131400:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa2dcc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec08 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.131408:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066734.131410:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066734.131413:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2a00, rc 0) 00000100:00100000:0.0:1746066734.131947:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:32162:x1830882982487168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 472us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.131955:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15947 00000100:00100000:0.0:1746066734.131974:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982488192 00000100:00100000:0.0:1746066734.131977:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982488192 00000100:00100000:0.0:1746066734.131992:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15948 00000100:00100000:0.0:1746066734.131997:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:32165:x1830882982488192:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066734.132008:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.132016:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfa2dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cec16 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.132469:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa2de1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132478:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa2de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132485:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa2de1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132493:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa2de8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132499:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa2de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132504:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa2de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132581:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa2def lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132589:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa2def lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.132595:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa2def lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066734.132678:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.132693:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982488448 00000100:00100000:0.0:1746066734.132696:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982488448 00000100:00100000:0.0:1746066734.132720:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3335 00000100:00100000:0.0:1746066734.132726:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982488448:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066734.132742:0:20360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.132751:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.132752:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.132755:0:20360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.132763:0:20360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.133515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.133526:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982488704 00000100:00100000:0.0:1746066734.133529:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982488704 00000100:00100000:0.0:1746066734.133553:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3336 00000100:00100000:0.0:1746066734.133558:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982488704:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066734.133574:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097016c00/0xf1867c21abfa2e04 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.133582:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.133584:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.133586:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097016c00/0xf1867c21abfa2e04 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.133593:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097016c00/0xf1867c21abfa2e04 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.139825:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.139876:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.139929:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982489344 00000100:00100000:0.0:1746066734.139931:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982489344 00000100:00100000:0.0:1746066734.139984:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3337 00000100:00100000:0.0:1746066734.139992:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982489344:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066734.140030:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfa2e19 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.140044:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.140046:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.140051:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfa2e19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.140065:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097016a00/0xf1867c21abfa2e19 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.144548:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.144570:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.144579:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.144592:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.144599:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.144617:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.144628:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982489856 00000100:00100000:0.0:1746066734.144631:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982489856 00000100:00100000:0.0:1746066734.144654:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982490112 00000100:00100000:0.0:1746066734.144655:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982490112 00000100:00100000:0.0:1746066734.147710:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14062 00000100:00100000:0.0:1746066734.147720:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982490112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.147732:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.147780:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a5c600/0xf1867c21abfa2e3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cec40 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.147796:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.147797:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.147803:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a5c600/0xf1867c21abfa2e3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec40 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.147814:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a5c600/0xf1867c21abfa2e3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec40 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.147824:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a5c600, rc 0) 00000100:00100000:0.0:1746066734.147849:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982490112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 133us (3268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.147855:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14062 00010000:00010000:0.0:1746066734.148097:0:20360:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.148658:0:20360:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.148672:0:20360:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.148679:0:20360:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097017c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066734.148682:0:20360:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.148689:0:20360:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.148701:0:20360:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.148707:0:20360:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa2dfd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.148743:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982488448:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 16017us (16065us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066734.148751:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3335 00000100:00100000:0.0:1746066734.161195:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.161445:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.161786:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.161968:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.162346:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3340 00000100:00100000:0.0:1746066734.162353:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982490880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.167169:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.173235:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982490880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10881us (11447us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066734.173245:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3340 00002000:00100000:0.0:1746066734.173254:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a4380 x1830882982490880/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/440 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.173262:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4380 with x1830882982490880 ext(1048576->2097151) 00002000:00010000:0.0:1746066734.173266:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4380 00000100:00100000:0.0:1746066734.174489:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.183135:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982490368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20955us (21941us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066734.183142:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3339 00002000:00100000:0.0:1746066734.183148:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800958a5c00 x1830882982490368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/440 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.183154:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5c00 with x1830882982490368 ext(0->1048575) 00002000:00010000:0.0:1746066734.183157:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5c00 00000100:00100000:0.0:1746066734.184594:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982491776 00000100:00100000:0.0:1746066734.184599:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982491776 00000100:00100000:0.0:1746066734.184629:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14065 00000100:00100000:0.0:1746066734.184635:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32159:x1830882982491776:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066734.184649:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.184663:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898000/0xf1867c21abfa2e5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cec4e expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.184685:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa2d4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebd7 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.184698:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa2e43 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec1d expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.184705:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.184706:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.184709:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898000/0xf1867c21abfa2e5f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec4e expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.184738:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa2e43 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec1d expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.184751:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa2e43 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec1d expref: 23 pid: 12233 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.184764:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984144000:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.185589:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa2d4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebd7 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.185601:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa2d4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebd7 expref: 14 pid: 3528 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.185612:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984144128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.185658:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.191814:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.192690:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.197695:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.201409:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.201674:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.201742:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984144256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.201763:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfa2e6d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066734.201805:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982492544 00000100:00100000:0.0:1746066734.201809:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982492544 00010000:00010000:0.0:1746066734.201822:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa2d39 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebc9 expref: 10 pid: 7245 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.201839:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6172 00000100:00100000:0.0:1746066734.201844:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982492544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.201852:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.201856:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa2d39 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebc9 expref: 10 pid: 7245 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.201864:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa2d39 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebc9 expref: 10 pid: 7245 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.201878:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa2d39 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebc9 expref: 10 pid: 7245 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.201923:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066734.201928:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfa2e6d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.201934:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfa2e6d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.201940:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfa2e6d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.201951:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.201970:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982492544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.201976:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6172 00010000:00010000:0.0:1746066734.201994:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfa2e6d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066734.201999:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfa2e6d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000040:00080000:0.0:1746066734.202388:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].417, 88 off44392 00000004:00080000:0.0:1746066734.202394:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413510135ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202428:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].374, 88 off40688 00000004:00080000:0.0:1746066734.202432:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413548218ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066734.202444:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].375, 88 off40776 00000004:00080000:0.0:1746066734.202447:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413563843ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066734.202455:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].418, 88 off44480 00000004:00080000:0.0:1746066734.202458:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413574518ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202466:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].419, 88 off44568 00000004:00080000:0.0:1746066734.202469:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413585640ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202478:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].376, 88 off40864 00000004:00080000:0.0:1746066734.202480:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413596818ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066734.202577:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].378, 88 off41048 00000004:00080000:0.0:1746066734.202581:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413697428ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066734.202591:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].379, 88 off41136 00000004:00080000:0.0:1746066734.202594:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413711040ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066734.202602:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].420, 88 off44656 00000004:00080000:0.0:1746066734.202605:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413721433ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202630:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].380, 88 off41224 00000004:00080000:0.0:1746066734.202634:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413750308ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066734.202641:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].421, 88 off44744 00000004:00080000:0.0:1746066734.202643:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413759928ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202650:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].381, 88 off41312 00000004:00080000:0.0:1746066734.202653:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413769768ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066734.202659:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].422, 88 off44832 00000004:00080000:0.0:1746066734.202662:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413778390ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202668:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].423, 88 off44920 00000004:00080000:0.0:1746066734.202671:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413787393ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202677:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].424, 88 off45008 00000004:00080000:0.0:1746066734.202679:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413796136ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202715:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].425, 88 off45096 00000004:00080000:0.0:1746066734.202719:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702413835383ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066734.202729:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].382, 88 off41400 00000004:00080000:0.0:1746066734.202731:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 702413847678ns, next at 665959948938ns, rc = 0 00000100:00100000:0.0:1746066734.208466:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982492672 00000100:00100000:0.0:1746066734.208474:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982492672 00000100:00100000:0.0:1746066734.208511:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14066 00000100:00100000:0.0:1746066734.208517:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32159:x1830882982492672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066734.208748:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.208765:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa2e7b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cec63 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.208798:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa2d5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebde expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.208806:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfa2e2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec24 expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.208812:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.208813:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.208816:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa2e7b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec63 expref: 12 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.208842:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfa2e2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec24 expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.208852:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097016800/0xf1867c21abfa2e2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec24 expref: 13 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.208862:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984144512:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.208961:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa2d5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebde expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.208968:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa2d5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebde expref: 12 pid: 9591 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.208976:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984144640:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.208992:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.211302:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984145920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.211324:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.213183:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984146432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.213214:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.214188:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066734.214195:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984145792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.214214:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.214221:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984146304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.214235:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.214253:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984146304 00000100:00100000:0.0:1746066734.214256:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984146304 00000100:00100000:0.0:1746066734.214271:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14071 00000100:00100000:0.0:1746066734.214276:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3774:x1830882984144896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066734.214326:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.214328:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214330:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214332:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214334:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066734.214354:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3774:x1830882984144896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (3296us total) trans 21474841504 rc 0/0 00000100:00100000:0.0:1746066734.214359:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14071 00000100:00100000:0.0:1746066734.214368:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14073 00000100:00100000:0.0:1746066734.214372:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882984145920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066734.214427:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.214430:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214432:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066732 -> 1746066732 00002000:00010000:0.0:1746066734.214434:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214435:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066734.214453:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882984145920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (3128us total) trans 17179874090 rc 0/0 00000100:00100000:0.0:1746066734.214456:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14073 00000100:00100000:0.0:1746066734.214463:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14074 00000100:00100000:0.0:1746066734.214466:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882984146432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.214507:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882984146432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (1293us total) trans 17179874091 rc 0/0 00000100:00100000:0.0:1746066734.214511:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14074 00000100:00100000:0.0:1746066734.214518:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14075 00000100:00100000:0.0:1746066734.214522:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882984145792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066734.214549:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.214551:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066732 -> 1746066732 00002000:00010000:0.0:1746066734.214553:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066733 -> 1746066733 00002000:00010000:0.0:1746066734.214554:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066732 -> 1746066732 00002000:00010000:0.0:1746066734.214556:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066734.214568:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882984145792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (354us total) trans 17179874092 rc 0/0 00000100:00100000:0.0:1746066734.214572:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14075 00000100:00100000:0.0:1746066734.214579:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14076 00000100:00100000:0.0:1746066734.214582:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882984146304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066734.214611:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066734.214614:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.214615:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066734.214617:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.214619:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066734.214630:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882984146304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (395us total) trans 17179874093 rc 0/0 00000100:00100000:0.0:1746066734.214634:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14076 00000004:00080000:0.0:1746066734.214651:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a6d80/2, rc 0, transno 17179874092 00000100:00100000:0.0:1746066734.214655:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984145792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066734.214661:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd5880/2, rc 0, transno 17179874093 00000100:00100000:0.0:1746066734.214663:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984146304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066734.214669:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd4a80/2, rc 0, transno 17179874090 00000100:00100000:0.0:1746066734.214672:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984145920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066734.214677:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd6d80/2, rc 0, transno 17179874091 00000100:00100000:0.0:1746066734.214679:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984146432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.214684:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066734.214688:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984146816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066734.214704:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066734.214717:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984146048 00000100:00100000:0.0:1746066734.214720:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984146048 00000100:00100000:0.0:1746066734.214727:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984146816 00000100:00100000:0.0:1746066734.214729:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984146816 00000100:00100000:0.0:1746066734.214735:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984146560 00000100:00100000:0.0:1746066734.214736:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984146560 00000100:00100000:0.0:1746066734.214743:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14077 00000100:00100000:0.0:1746066734.214747:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3776:x1830882984146048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066734.214780:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066734.214782:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214784:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214786:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.214787:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066734.214814:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984146048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (140us total) trans 17179874094 rc 0/0 00000100:00100000:0.0:1746066734.214818:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14077 00000100:00100000:0.0:1746066734.214826:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14079 00000100:00100000:0.0:1746066734.214830:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3776:x1830882984146560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066734.214877:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984146560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (157us total) trans 17179874095 rc 0/0 00000100:00100000:0.0:1746066734.214904:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14079 00000100:00100000:0.0:1746066734.214913:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14080 00000100:00100000:0.0:1746066734.214917:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3776:x1830882984146176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066734.214951:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.214953:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.214955:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:0.0:1746066734.214957:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066734.214959:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:0.0:1746066734.214985:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984146176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (239us total) trans 17179874096 rc 0/0 00000100:00100000:0.0:1746066734.214990:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14080 00010000:00010000:0.0:1746066734.215049:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeae00/0xf1867c21abfa2e6d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec55 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.215063:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066734.215066:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746066734.215070:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfa2e74 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec5c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.215079:0:7243:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfa2e74 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec5c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.215085:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfa2e74 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec5c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.215107:0:7243:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfa2e74 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec5c expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.215117:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984146944:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.215160:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.215180:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984144640:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.215233:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984144512:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.215258:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa2e7b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec63 expref: 12 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.215271:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898c00, rc 0) 00000100:00100000:0.0:1746066734.215285:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32159:x1830882982492672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6768us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.215291:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14066 00000004:00080000:0.0:1746066734.216177:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012faf4e00/2, rc 0, transno 21474841504 00000100:00100000:0.0:1746066734.216181:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984144896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066734.216191:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012faf5f80/2, rc 0, transno 21474841505 00000100:00100000:0.0:1746066734.216195:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984145408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066734.216221:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14083 00000100:00100000:0.0:1746066734.216227:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3777:x1830882984145536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066734.216408:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.216478:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.224147:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.224228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.224259:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982493440 00000100:00100000:0.0:1746066734.224262:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982493440 00000100:00100000:0.0:1746066734.224281:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15954 00000100:00100000:0.0:1746066734.224285:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:32165:x1830882982493440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066734.224304:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.224320:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa2ea5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cec71 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.224355:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa2ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec71 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.224364:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa2ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec71 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.224376:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066734.224378:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066734.224381:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899800, rc 0) 00000100:00100000:0.0:1746066734.224403:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:32165:x1830882982493440:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 118us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.224408:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15954 00000100:00100000:0.0:1746066734.226060:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.227415:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.227484:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.229091:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.229128:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.231555:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.231586:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.231601:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.231614:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.231628:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.232328:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.232344:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.232370:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982494592 00000100:00100000:0.0:1746066734.232373:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982494592 00000100:00100000:0.0:1746066734.232388:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982494848 00000100:00100000:0.0:1746066734.232391:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982494848 00000100:00100000:0.0:1746066734.232931:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14087 00000100:00100000:0.0:1746066734.232938:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882982494336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.232946:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.232957:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899600/0xf1867c21abfa2ecf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cec94 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.232982:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984147840:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.233009:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.233028:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14089 00000100:00100000:0.0:1746066734.233033:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982494720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.233040:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.233048:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfa2edd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceca9 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.233060:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.233062:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.233068:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfa2edd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceca9 expref: 37 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233086:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfa2edd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceca9 expref: 37 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233095:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0600, rc 0) 00000100:00100000:0.0:1746066734.233116:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982494720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 82us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.233121:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14089 00000100:00100000:0.0:1746066734.233134:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14090 00000100:00100000:0.0:1746066734.233138:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982494848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.233144:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.233151:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfa2ee4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cecb0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.233159:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.233160:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.233164:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfa2ee4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecb0 expref: 37 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233176:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc1c00/0xf1867c21abfa2ee4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecb0 expref: 37 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233182:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1c00, rc 0) 00000100:00100000:0.0:1746066734.233196:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982494848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.233201:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14090 00000100:00100000:0.0:1746066734.233211:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14091 00000100:00100000:0.0:1746066734.233215:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:32166:x1830882982494976:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066734.233221:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.233227:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfa2eeb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cecb7 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.233240:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfa2d6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebf3 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233247:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfa2edd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceca9 expref: 36 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233253:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa2e35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec39 expref: 24 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233258:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.233259:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.233262:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfa2eeb lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3940352->4194303] (req 3940352->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecb7 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.233281:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa2e35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec39 expref: 24 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233291:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa2e35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec39 expref: 24 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.233300:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984148096:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.233328:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfa2edd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceca9 expref: 36 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233335:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0600/0xf1867c21abfa2edd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceca9 expref: 36 pid: 20361 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.233342:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984148224:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.233364:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfa2d6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebf3 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.233372:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfa2d6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cebf3 expref: 12 pid: 3528 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.233380:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984148352:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.233395:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.233450:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984147584:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066734.233464:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.233479:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+12:2014:x1830882982493952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4246us (4389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.233488:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6175 00000100:00100000:0.0:1746066734.233550:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.233622:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.236770:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984148096:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.236806:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984148224:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.236826:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984148352:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.236856:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfa2eeb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3940352->4194303] (req 3940352->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecb7 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.236870:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0400, rc 0) 00000100:00100000:0.0:1746066734.236939:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:32166:x1830882982494976:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3722us (4593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.236946:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14091 00000100:00100000:0.0:1746066734.237025:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.237040:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982495360 00000100:00100000:0.0:1746066734.237045:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982495360 00010000:00010000:0.0:1746066734.238231:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa2e35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec39 expref: 23 pid: 9590 timeout: 802 lvb_type: 1 00000100:00100000:0.0:1746066734.238291:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6180 00000100:00100000:0.0:1746066734.238297:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882982495360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.238306:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.238314:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa2e35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec39 expref: 23 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.238322:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa2e35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec39 expref: 23 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.238333:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa2e35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec39 expref: 23 pid: 9590 timeout: 802 lvb_type: 1 00010000:00010000:0.0:1746066734.238351:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.238353:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.238358:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfa2eeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecb7 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.238365:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfa2eeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecb7 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.238691:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0400/0xf1867c21abfa2eeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecb7 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.238699:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984148864:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.238718:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.241145:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.241175:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.241195:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982496128 00000100:00100000:0.0:1746066734.241201:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982496128 00002000:00100000:0.0:1746066734.241238:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3940352->3944447) req@ffff88012faf3800 x1830882982496128/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.241252:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3800 with x1830882982496128 ext(3940352->3944447) 00002000:00010000:0.0:1746066734.241256:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf3800 00000100:00100000:0.0:1746066734.241270:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3343 00000100:00100000:0.0:1746066734.241275:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882982496128:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066734.249701:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.250051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.250951:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 664 00000100:00100000:0.0:1746066734.250957:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882982496768:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066734.253579:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.254157:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.254601:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.262286:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984149760:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066734.262304:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.262338:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982497152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7647us (7737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.262345:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6184 00000100:00100000:0.0:1746066734.266378:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.267424:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.268542:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.278619:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.282397:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982498304 00000100:00100000:0.0:1746066734.282403:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982498304 00000100:00100000:0.0:1746066734.282438:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982498560 00000100:00100000:0.0:1746066734.282440:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982498560 00000100:00100000:0.0:1746066734.282450:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982498432 00000100:00100000:0.0:1746066734.282452:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982498432 00000100:00100000:0.0:1746066734.282461:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982498816 00000100:00100000:0.0:1746066734.282463:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982498816 00000100:00100000:0.0:1746066734.282471:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982498688 00000100:00100000:0.0:1746066734.282473:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982498688 00000100:00100000:0.0:1746066734.282479:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982498944 00000100:00100000:0.0:1746066734.282481:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982498944 00000100:00100000:0.0:1746066734.282491:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14099 00000100:00100000:0.0:1746066734.282498:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982498304:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.282643:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066734.282646:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.282648:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.282650:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.282652:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:0.0:1746066734.282694:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982498304:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 195us (497us total) trans 21474841511 rc 0/0 00000100:00100000:0.0:1746066734.282700:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14099 00000100:00100000:0.0:1746066734.282714:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14100 00000100:00100000:0.0:1746066734.282719:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982498560:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.282780:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.282782:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.282784:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.282786:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.282787:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066734.282803:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982498560:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 84us (572us total) trans 17179874099 rc 0/0 00000100:00100000:0.0:1746066734.282811:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14100 00000100:00100000:0.0:1746066734.282819:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14101 00000100:00100000:0.0:1746066734.282823:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982498432:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.282859:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.282861:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.282863:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.282864:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.282866:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066734.282911:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982498432:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 58us (632us total) trans 17179874100 rc 0/0 00000100:00100000:0.0:1746066734.282916:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14101 00000100:00100000:0.0:1746066734.282926:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14102 00000100:00100000:0.0:1746066734.282930:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982498816:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.282968:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:0.0:1746066734.282970:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066735 -> 1746066734 00002000:00010000:0.0:1746066734.282972:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.282973:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.282975:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:0.0:1746066734.282991:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982498816:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 61us (727us total) trans 21474841512 rc 0/0 00000100:00100000:0.0:1746066734.282996:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14102 00000100:00100000:0.0:1746066734.283004:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14103 00000100:00100000:0.0:1746066734.283008:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982498688:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.283043:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.283046:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.283047:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.283049:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066734 -> 1746066735 00002000:00010000:0.0:1746066734.283051:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066734.283065:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982498688:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 57us (788us total) trans 21474841513 rc 0/0 00000100:00100000:0.0:1746066734.283070:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14103 00000100:00100000:0.0:1746066734.283078:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14104 00000100:00100000:0.0:1746066734.283082:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982498944:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.283112:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066734.283114:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066735 -> 1746066734 00002000:00010000:0.0:1746066734.283116:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.283118:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.283119:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066734.283132:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982498944:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 50us (792us total) trans 17179874101 rc 0/0 00000100:00100000:0.0:1746066734.283136:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14104 00000100:00100000:0.0:1746066734.286358:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982499200 00000100:00100000:0.0:1746066734.286363:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982499200 00010000:00010000:0.0:1746066734.286383:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898000/0xf1867c21abfa2e5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec4e expref: 16 pid: 20361 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.286407:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982499328 00000100:00100000:0.0:1746066734.286409:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982499328 00010000:00010000:0.0:1746066734.286420:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa2e7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec63 expref: 14 pid: 20361 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.286435:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6187 00000100:00100000:0.0:1746066734.286439:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982499200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.286449:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.286464:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898000/0xf1867c21abfa2e5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec4e expref: 16 pid: 20361 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.286474:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5898000/0xf1867c21abfa2e5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec4e expref: 16 pid: 20361 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.286491:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898000/0xf1867c21abfa2e5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec4e expref: 16 pid: 20361 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.286507:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.286509:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.286515:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097017e00/0xf1867c21abfa2ec1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec86 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.286524:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097017e00/0xf1867c21abfa2ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec86 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.286552:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097017e00/0xf1867c21abfa2ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec86 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.286562:0:8395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097017e00/0xf1867c21abfa2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec86 expref: 33 pid: 3528 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.286580:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984150272:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.286632:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.286646:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6188 00000100:00100000:0.0:1746066734.286651:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882982499328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.286658:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.286669:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa2e7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec63 expref: 14 pid: 20361 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.286677:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa2e7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec63 expref: 14 pid: 20361 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.286688:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa2e7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec63 expref: 14 pid: 20361 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.286696:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.286698:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.286701:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728800/0xf1867c21abfa2f00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecc5 expref: 13 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.286708:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5728800/0xf1867c21abfa2f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecc5 expref: 13 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.286724:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5728800/0xf1867c21abfa2f00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecc5 expref: 13 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.286736:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984150400:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.286753:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.292571:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.292684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.292720:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982499584 00000100:00100000:0.0:1746066734.292726:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982499584 00002000:00100000:0.0:1746066734.292770:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf2a00 x1830882982499584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.292780:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2a00 with x1830882982499584 ext(1048576->2097151) 00002000:00010000:0.0:1746066734.292785:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf2a00 00000100:00100000:0.0:1746066734.294724:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.303010:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.303105:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.308075:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066734.312298:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728800/0xf1867c21abfa2f00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecc5 expref: 16 pid: 12237 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.312323:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984150656:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.312344:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa2f31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecf6 expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.312353:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0800, rc 0) 00000100:00100000:0.0:1746066734.312381:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:32165:x1830882982500224:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9155us (9378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.312393:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14106 00000100:00100000:0.0:1746066734.314917:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.316310:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.318351:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6191 00000100:00100000:0.0:1746066734.318360:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982501120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.318372:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066734.318386:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066734 -> 1746066735 00010000:00010000:0.0:1746066734.318391:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097017e00/0xf1867c21abfa2ec1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec86 expref: 36 pid: 3528 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.318403:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097017e00/0xf1867c21abfa2ec1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec86 expref: 36 pid: 3528 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.318424:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017e00/0xf1867c21abfa2ec1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec86 expref: 36 pid: 3528 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.318751:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.318753:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.318762:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009718d600/0xf1867c21abfa2f0e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecd3 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.318770:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009718d600/0xf1867c21abfa2f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecd3 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.318801:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009718d600/0xf1867c21abfa2f0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecd3 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.318816:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009718d600/0xf1867c21abfa2f0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecd3 expref: 35 pid: 3528 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.318827:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984151168:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.318911:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.322450:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982501632 00000100:00100000:0.0:1746066734.322457:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982501632 00000100:00100000:0.0:1746066734.322490:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5738 00000100:00100000:0.0:1746066734.322496:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:32165:x1830882982501632:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066734.323964:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:32165:x1830882982501632:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1462us (1832us total) trans 8589936216 rc 0/0 00000100:00100000:0.0:1746066734.323973:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5738 00000100:00100000:0.0:1746066734.325311:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.325348:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.325580:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3348 00000100:00100000:0.0:1746066734.325588:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982502016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.338671:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.341028:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.348998:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.349044:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.349164:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.349203:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982502912 00000100:00100000:0.0:1746066734.349206:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982502912 00002000:00100000:0.0:1746066734.349233:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a8000 x1830882982502912/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.349243:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882982502912 ext(1048576->2097151) 00002000:00010000:0.0:1746066734.349247:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:0.0:1746066734.349258:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3349 00000100:00100000:0.0:1746066734.349263:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882982502912:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066734.353167:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.354410:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.360682:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882982502912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11415us (11514us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066734.360695:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3349 00002000:00100000:0.0:1746066734.360707:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a8000 x1830882982502912/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/440 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.360717:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882982502912 ext(1048576->2097151) 00002000:00010000:0.0:1746066734.360724:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:0.0:1746066734.360748:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982503424 00000100:00100000:0.0:1746066734.360757:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982503424 00002000:00100000:0.0:1746066734.360787:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1466367) req@ffff8800945d5880 x1830882982503424/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.360795:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5880 with x1830882982503424 ext(1048576->1466367) 00010000:00010000:0.0:1746066734.360803:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa2f31 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecf6 expref: 36 pid: 1893 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.360817:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa2f31 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecf6 expref: 36 pid: 1893 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746066734.360830:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800945d5880 00000100:00100000:0.0:1746066734.360861:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 669 00000100:00100000:0.0:1746066734.360869:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982503424:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066734.375436:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982503552 00000100:00100000:0.0:1746066734.375447:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982503552 00000100:00100000:0.0:1746066734.375485:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982503808 00000100:00100000:0.0:1746066734.375487:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982503808 00000100:00100000:0.0:1746066734.375500:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14111 00000100:00100000:0.0:1746066734.375508:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882982503552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.375528:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.375545:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa2f5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ced19 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.375591:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984151936:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.375688:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.382446:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982503424:12345-192.168.204.16@tcp:4:cat.0 Request processed in 21573us (22007us total) trans 17179874102 rc 0/0 00000100:00100000:0.0:1746066734.382458:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 669 00002000:00100000:0.0:1746066734.382470:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1466367) req@ffff8800945d5880 x1830882982503424/t17179874102(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/448 e 0 to 0 dl 1746066745 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.382480:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5880 with x1830882982503424 ext(1048576->1466367) 00010000:00010000:0.0:1746066734.382489:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa2f31 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecf6 expref: 36 pid: 1893 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.382506:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fa0800/0xf1867c21abfa2f31 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecf6 expref: 36 pid: 1893 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746066734.382513:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800945d5880 00000100:00100000:0.0:1746066734.382558:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984151936:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.382573:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa2f5b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced19 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.382582:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa2f5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced19 expref: 27 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.382613:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898c00, rc 0) 00000100:00100000:0.0:1746066734.382653:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982503552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7145us (7359us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.382659:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14111 00000100:00100000:0.0:1746066734.382709:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.382721:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982504064 00000100:00100000:0.0:1746066734.382726:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982504064 00000100:00100000:0.0:1746066734.382748:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14115 00000100:00100000:0.0:1746066734.382754:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:32169:x1830882982504064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.382769:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.382781:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa2f70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ced35 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.382801:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.382803:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.382811:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa2f70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced35 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.382824:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa2f70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced35 expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.382832:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898400, rc 0) 00000100:00100000:0.0:1746066734.382845:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:32169:x1830882982504064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 92us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.382849:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14115 00002000:00010000:0.0:1746066734.383010:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066734 -> 1746066735 00002000:00010000:0.0:1746066734.383013:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066734 -> 1746066735 00000100:00100000:0.0:1746066734.383024:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984151808:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.383039:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5729000/0xf1867c21abfa2f54 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced20 expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.383047:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5729000/0xf1867c21abfa2f54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced20 expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.383055:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729000, rc 0) 00000100:00100000:0.0:1746066734.383074:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882982503680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7558us (7731us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.383079:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14112 00010000:00010000:0.0:1746066734.383104:0:12233:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa2f1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cece1 expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.383121:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce04e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984152192:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.383134:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfa2f69 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced2e expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.383142:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfa2f69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced2e expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.383148:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729c00, rc 0) 00000100:00100000:0.0:1746066734.383160:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882982503936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7391us (7759us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.383164:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14114 00000100:00100000:0.0:1746066734.391392:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.391483:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.395137:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984152320:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066734.395162:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.395209:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982504192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6626us (7932us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.395220:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6194 00000100:00100000:0.0:1746066734.398988:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.399055:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.399078:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982504832 00000100:00100000:0.0:1746066734.399086:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982504832 00010000:00010000:0.0:1746066734.399122:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a3800/0xf1867c21abfa2f07 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceccc expref: 15 pid: 11630 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.399172:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6195 00000100:00100000:0.0:1746066734.399181:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982504832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.399196:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.399216:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a3800/0xf1867c21abfa2f07 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceccc expref: 15 pid: 11630 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.399227:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a3800/0xf1867c21abfa2f07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceccc expref: 15 pid: 11630 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.399254:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.399257:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.399264:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa2f77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced3c expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.399273:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa2f77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced3c expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.399305:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa2f77 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced3c expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.399318:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984152576:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.399395:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.402295:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982504576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10613us (10799us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066734.402307:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3351 00002000:00100000:0.0:1746066734.402319:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a8700 x1830882982504576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/440 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.402328:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8700 with x1830882982504576 ext(1048576->2097151) 00002000:00010000:0.0:1746066734.402333:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8700 00000100:00100000:0.0:1746066734.403066:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984152576:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066734.403077:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.403111:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982504832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3931us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.403119:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6195 00000100:00100000:0.0:1746066734.404448:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.405505:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982504960 00000100:00100000:0.0:1746066734.405514:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982504960 00010000:00010000:0.0:1746066734.405549:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1600/0xf1867c21abfa2f46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced0b expref: 35 pid: 12255 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.405582:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982505088 00000100:00100000:0.0:1746066734.405584:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982505088 00010000:00010000:0.0:1746066734.405594:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfa2f38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecfd expref: 14 pid: 12255 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.405617:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6196 00000100:00100000:0.0:1746066734.405624:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982504960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.405636:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.405655:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa1600/0xf1867c21abfa2f46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced0b expref: 35 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.405670:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa1600/0xf1867c21abfa2f46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced0b expref: 35 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.405692:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1600/0xf1867c21abfa2f46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced0b expref: 35 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.405708:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.405745:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882982504960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.405751:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6196 00000100:00100000:0.0:1746066734.405764:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6197 00000100:00100000:0.0:1746066734.405768:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982505088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.405774:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.405781:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfa2f38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecfd expref: 14 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.405789:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfa2f38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecfd expref: 14 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.405799:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1c00/0xf1867c21abfa2f38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cecfd expref: 14 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.405806:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.405808:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.405814:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091cb5400/0xf1867c21abfa2f7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced43 expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.405822:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb5400/0xf1867c21abfa2f7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced43 expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.405850:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091cb5400/0xf1867c21abfa2f7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced43 expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.405861:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984152960:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.405943:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.408379:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.408415:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.408440:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.408464:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.408479:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982505600 00000100:00100000:0.0:1746066734.408481:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982505600 00000100:00100000:0.0:1746066734.408500:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982505856 00000100:00100000:0.0:1746066734.408501:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982505856 00000100:00100000:0.0:1746066734.408559:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14119 00000100:00100000:0.0:1746066734.408564:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882982505600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.408577:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.408593:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5729c00/0xf1867c21abfa2f93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ced51 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.408633:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984153216:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.408692:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.409101:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.409139:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.417792:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984152960:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066734.417804:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.417833:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982505088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12064us (12382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.417842:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6197 00000100:00100000:0.0:1746066734.428659:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.428686:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982506240 00000100:00100000:0.0:1746066734.428695:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982506240 00010000:00010000:0.0:1746066734.428733:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa2f70 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced35 expref: 36 pid: 1893 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.428772:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6198 00000100:00100000:0.0:1746066734.428780:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882982506240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.428795:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.428817:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa2f70 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced35 expref: 36 pid: 1893 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.428829:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa2f70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced35 expref: 36 pid: 1893 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.428856:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.428940:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882982506240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 160us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.428946:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6198 00000100:00100000:0.0:1746066734.429035:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.429044:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982506368 00000100:00100000:0.0:1746066734.429047:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982506368 00010000:00010000:0.0:1746066734.429058:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfa2f3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced04 expref: 27 pid: 12255 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.429072:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6199 00000100:00100000:0.0:1746066734.429076:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882982506368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.429084:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.429091:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfa2f3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced04 expref: 27 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.429100:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfa2f3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced04 expref: 27 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.429111:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0400/0xf1867c21abfa2f3f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced04 expref: 27 pid: 12255 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.429541:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.429544:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.429553:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa2fa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced6d expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.429562:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa2fa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced6d expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.429589:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa2fa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced6d expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.429599:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984153856:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.438476:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.441144:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.442316:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.452000:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.453359:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.453453:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.460544:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.460880:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.460946:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982508032 00000100:00100000:0.0:1746066734.460956:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982508032 00002000:00100000:0.0:1746066734.461004:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88009666fb80 x1830882982508032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.461015:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666fb80 with x1830882982508032 ext(2097152->3145727) 00002000:00010000:0.0:1746066734.461021:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666fb80 00000100:00100000:0.0:1746066734.461033:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3354 00000100:00100000:0.0:1746066734.461037:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982508032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.467339:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.478171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.478281:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.481048:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.481079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.481102:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.481115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.481130:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982509056 00000100:00100000:0.0:1746066734.481133:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982509056 00000100:00100000:0.0:1746066734.481158:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982508672 00000100:00100000:0.0:1746066734.481160:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982508672 00000100:00100000:0.0:1746066734.481175:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14131 00000100:00100000:0.0:1746066734.481180:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982509056:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.481296:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066734.481299:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.481301:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.481303:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.481305:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066734.481340:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982509056:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 159us (260us total) trans 21474841515 rc 0/0 00000100:00100000:0.0:1746066734.481352:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14131 00000100:00100000:0.0:1746066734.481365:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14132 00000100:00100000:0.0:1746066734.481370:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982509312:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.481418:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066734.481421:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.481423:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.481424:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.481426:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066734.481442:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982509312:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 72us (340us total) trans 17179874104 rc 0/0 00000100:00100000:0.0:1746066734.481447:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14132 00000100:00100000:0.0:1746066734.481458:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14133 00000100:00100000:0.0:1746066734.481463:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982508672:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.481501:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066734.481503:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066735 -> 1746066734 00002000:00010000:0.0:1746066734.481506:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.481507:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.481509:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:0.0:1746066734.481525:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982508672:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 61us (409us total) trans 21474841516 rc 0/0 00000100:00100000:0.0:1746066734.481530:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14133 00000100:00100000:0.0:1746066734.481555:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.481567:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982508928 00000100:00100000:0.0:1746066734.481570:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982508928 00000100:00100000:0.0:1746066734.481762:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.481776:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982509184 00000100:00100000:0.0:1746066734.481778:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982509184 00000100:00100000:0.0:1746066734.481792:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14135 00000100:00100000:0.0:1746066734.481796:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982509184:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066734.481836:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:0.0:1746066734.481839:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.481840:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066734 -> 1746066734 00002000:00010000:0.0:1746066734.481842:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066735 -> 1746066735 00002000:00010000:0.0:1746066734.481843:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:0.0:1746066734.481859:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982509184:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 61us (96us total) trans 21474841517 rc 0/0 00000100:00100000:0.0:1746066734.481863:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14135 00000100:00100000:0.0:1746066734.485480:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.485541:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.489850:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.493205:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982510208 00000100:00100000:0.0:1746066734.493209:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982510208 00002000:00100000:0.0:1746066734.493237:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012c490a80 x1830882982510208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.493247:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490a80 with x1830882982510208 ext(3145728->4194303) 00002000:00010000:0.0:1746066734.493251:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490a80 00000100:00100000:0.0:1746066734.493264:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3355 00000100:00100000:0.0:1746066734.493269:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982510208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.497120:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.519538:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.520721:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.523930:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.531433:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.534529:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.557874:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.559235:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14140 00000100:00100000:0.0:1746066734.559242:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982511872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.559249:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.559256:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5728e00/0xf1867c21abfa3034 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cedba expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.559279:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984155904:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.559298:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.559313:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14142 00000100:00100000:0.0:1746066734.559317:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982512256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.559323:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.559329:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07a00/0xf1867c21abfa3042 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cedcf expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.559348:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984156160:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.559364:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.561617:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982512384 00000100:00100000:0.0:1746066734.561621:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982512384 00000100:00100000:0.0:1746066734.561652:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982512640 00000100:00100000:0.0:1746066734.561654:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982512640 00000100:00100000:0.0:1746066734.561682:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14145 00000100:00100000:0.0:1746066734.561688:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882982512640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.561696:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.561704:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfa305e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cede4 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.561781:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984156672:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.561803:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.564339:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984155776:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.564355:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d31400/0xf1867c21abfa302d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cedc1 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.564364:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d31400/0xf1867c21abfa302d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cedc1 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.564375:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31400, rc 0) 00000100:00100000:0.0:1746066734.564395:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982512000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5294us (5710us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.564400:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14139 00000100:00100000:0.0:1746066734.565798:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984156672:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.565817:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfa305e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cede4 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.565827:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfa305e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cede4 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.565834:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4000, rc 0) 00000100:00100000:0.0:1746066734.565859:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982512640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4171us (4552us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.565865:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14145 00000100:00100000:0.0:1746066734.567700:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.569323:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982513408 00000100:00100000:0.0:1746066734.569328:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982513408 00002000:00100000:0.0:1746066734.569360:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ce04a80 x1830882982513408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.569369:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04a80 with x1830882982513408 ext(4194304->5033983) 00010000:00010000:0.0:1746066734.569376:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d30800/0xf1867c21abfa2fcb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced90 expref: 26 pid: 11630 timeout: 802 lvb_type: 0 00010000:00010000:0.0:1746066734.569387:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d30800/0xf1867c21abfa2fcb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced90 expref: 26 pid: 11630 timeout: 802 lvb_type: 0 00002000:00010000:0.0:1746066734.569393:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce04a80 00000100:00100000:0.0:1746066734.569427:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 671 00000100:00100000:0.0:1746066734.569436:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982513408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.576036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.583581:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.585289:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982514304 00000100:00100000:0.0:1746066734.585293:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982514304 00000100:00100000:0.0:1746066734.585314:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14148 00000100:00100000:0.0:1746066734.585319:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982514048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.585325:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.585335:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5200/0xf1867c21abfa3073 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee07 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.585545:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984157184:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.587781:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.599011:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984157312:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.599045:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e363600/0xf1867c21abfa3081 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee00 expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.599059:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e363600/0xf1867c21abfa3081 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee00 expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.599075:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e363600, rc 0) 00000100:00100000:0.0:1746066734.599276:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982513920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 12514us (12552us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.599283:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14150 00000100:00100000:0.0:1746066734.600133:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.600162:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.600182:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.600194:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.600206:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.600225:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.600240:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982514816 00000100:00100000:0.0:1746066734.600247:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982514816 00000100:00100000:0.0:1746066734.600276:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982515072 00000100:00100000:0.0:1746066734.600278:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982515072 00000100:00100000:0.0:1746066734.600287:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982514688 00000100:00100000:0.0:1746066734.600289:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982514688 00000100:00100000:0.0:1746066734.600297:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982514944 00000100:00100000:0.0:1746066734.600299:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982514944 00000100:00100000:0.0:1746066734.600308:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982515200 00000100:00100000:0.0:1746066734.600309:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982515200 00000100:00100000:0.0:1746066734.600319:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14152 00000100:00100000:0.0:1746066734.600325:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982514816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.600340:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.600353:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa308f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee23 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.600395:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984157568:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.600450:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.600467:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14153 00000100:00100000:0.0:1746066734.600472:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982515072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.600479:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.600488:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfa3096 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee31 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.600509:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984157696:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.600529:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.600600:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14154 00000100:00100000:0.0:1746066734.600606:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982514688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.600613:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.600620:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfa309d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee1c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.600640:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984157824:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.600659:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.600674:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14155 00000100:00100000:0.0:1746066734.600679:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982514944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.600684:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.600690:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ce1400/0xf1867c21abfa30a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee2a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.600708:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984157952:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.600725:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.600763:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14156 00000100:00100000:0.0:1746066734.600769:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982515200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.600775:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.600781:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa30ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee38 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.600791:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.600797:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa30ab lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee38 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.600806:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa30ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee38 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.600815:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894a00, rc 0) 00000100:00100000:0.0:1746066734.600834:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982515200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (608us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.600838:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14156 00000100:00100000:0.0:1746066734.607507:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984157696:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.607543:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfa3096 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee31 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.607556:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589be00/0xf1867c21abfa3096 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee31 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.607568:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589be00, rc 0) 00000100:00100000:0.0:1746066734.607605:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982515072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7130us (7419us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.607613:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14153 00000100:00100000:0.0:1746066734.607665:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984157824:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.607680:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfa309d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee1c expref: 36 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.607688:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0200/0xf1867c21abfa309d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee1c expref: 36 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.607700:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0200, rc 0) 00000100:00100000:0.0:1746066734.607717:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982514688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7111us (7521us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.607722:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14154 00000100:00100000:0.0:1746066734.610504:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.614127:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.618522:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.618615:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.620308:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984158592 00000100:00100000:0.0:1746066734.620312:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984158592 00000100:00100000:0.0:1746066734.620352:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1746066734.620357:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882984158592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746066734.620371:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1063406912 pending 4349952 free 3912097792 avail 3680575488 00000100:00100000:0.0:1746066734.620408:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882984158592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.620414:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1746066734.627146:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984158336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.627159:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984158464:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066734.627190:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094418600/0xf1867c21abfa30c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->3346431] (req 3145728->3346431) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee4d expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.627211:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418600, rc 0) 00000100:00100000:0.0:1746066734.627303:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+15:32173:x1830882982516096:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7634us (8685us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.627315:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14159 00000100:00100000:0.0:1746066734.633189:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.635024:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.635100:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982516736 00000100:00100000:0.0:1746066734.635103:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982516736 00002000:00100000:0.0:1746066734.635133:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3342336->3346431) req@ffff8800966e2300 x1830882982516736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.635142:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882982516736 ext(3342336->3346431) 00002000:00010000:0.0:1746066734.635146:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:0.0:1746066734.635159:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3359 00000100:00100000:0.0:1746066734.635163:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882982516736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.635272:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882982516736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 108us (249us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066734.635278:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3359 00002000:00100000:0.0:1746066734.635282:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3342336->3346431) req@ffff8800966e2300 x1830882982516736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.635289:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882982516736 ext(3342336->3346431) 00002000:00010000:0.0:1746066734.635292:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:0.0:1746066734.639360:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.639386:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982516992 00000100:00100000:0.0:1746066734.639391:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982516992 00000100:00100000:0.0:1746066734.639683:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14160 00000100:00100000:0.0:1746066734.639692:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+34:32176:x1830882982516992:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066734.639712:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.639730:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895200/0xf1867c21abfa30c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee5b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.639761:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1e00/0xf1867c21abfa2f4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced12 expref: 15 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.639768:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066734.639770:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066734.639773:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895200/0xf1867c21abfa30c7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1921024->2097151] (req 1921024->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee5b expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.639805:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa1e00/0xf1867c21abfa2f4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced12 expref: 15 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.639818:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1e00/0xf1867c21abfa2f4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced12 expref: 15 pid: 12255 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.639830:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984159104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.639913:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.640343:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.641281:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.641305:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.641330:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.641355:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.641376:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982517888 00000100:00100000:0.0:1746066734.641378:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982517888 00000100:00100000:0.0:1746066734.641397:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14164 00000100:00100000:0.0:1746066734.641401:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982517376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.641407:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.641413:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894200/0xf1867c21abfa30e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee70 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.641430:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984159616:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.641779:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.641798:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.641841:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.641912:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14167 00000100:00100000:0.0:1746066734.641918:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882982518016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.641923:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.641928:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfa30f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee85 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.641944:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984160000:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.642362:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.642985:0:3528:0:(service.c:3346:ptlrpc_start_thread()) ost[0] started 10 min 3 max 116 00000100:00100000:0.0:1746066734.642991:0:3528:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost00_010' 00000100:00100000:0.0:1746066734.644966:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984160000:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.644993:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfa30f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee85 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.645004:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894400/0xf1867c21abfa30f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee85 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.645017:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894400, rc 0) 00000100:00100000:0.0:1746066734.645058:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982518016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3139us (3215us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.645064:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14167 00002000:00010000:0.0:1746066734.647433:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066734 -> 1746066735 00002000:00010000:0.0:1746066734.647437:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066734 -> 1746066735 00000100:00100000:0.0:1746066734.647447:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984160384:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.647461:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094419200/0xf1867c21abfa3106 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee93 expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.647469:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094419200/0xf1867c21abfa3106 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee93 expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.647477:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419200, rc 0) 00000100:00100000:0.0:1746066734.647691:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982518272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4705us (5210us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.647697:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14169 00000100:00100000:0.0:1746066734.647717:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982518656 00000100:00100000:0.0:1746066734.647723:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982518656 00002000:00100000:0.0:1746066734.647755:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1921024->1925119) req@ffff8800966e3480 x1830882982518656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.647765:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882982518656 ext(1921024->1925119) 00002000:00010000:0.0:1746066734.647769:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:0.0:1746066734.648499:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3360 00000100:00100000:0.0:1746066734.648509:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982518656:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066734.648669:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982518656:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 160us (1487us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066734.648675:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3360 00002000:00100000:0.0:1746066734.648680:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1921024->1925119) req@ffff8800966e3480 x1830882982518656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.648688:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882982518656 ext(1921024->1925119) 00002000:00010000:0.0:1746066734.648692:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:0.0:1746066734.648948:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982518912 00000100:00100000:0.0:1746066734.648951:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982518912 00002000:00100000:0.0:1746066734.648967:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff880096ec8e00 x1830882982518912/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.648975:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882982518912 ext(5029888->5033983) 00002000:00010000:0.0:1746066734.648978:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec8e00 00000100:00100000:0.0:1746066734.648990:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3361 00000100:00100000:0.0:1746066734.648994:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982518912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.649055:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982518912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 59us (201us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066734.649061:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3361 00002000:00100000:0.0:1746066734.649065:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff880096ec8e00 x1830882982518912/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.649071:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882982518912 ext(5029888->5033983) 00002000:00010000:0.0:1746066734.649074:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec8e00 00000100:00100000:0.0:1746066734.649992:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.653767:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982519808 00000100:00100000:0.0:1746066734.653771:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982519808 00000100:00100000:0.0:1746066734.653795:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14170 00000100:00100000:0.0:1746066734.653799:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:32176:x1830882982519808:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066734.653809:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.654160:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb8200/0xf1867c21abfa310d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cee9a expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.654189:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091cb5400/0xf1867c21abfa2f7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced43 expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.654197:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066734.654199:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066734.654202:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb8200/0xf1867c21abfa310d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->1490943] (req 1048576->1490943) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee9a expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.654234:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091cb5400/0xf1867c21abfa2f7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced43 expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.654245:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091cb5400/0xf1867c21abfa2f7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced43 expref: 14 pid: 20361 timeout: 802 lvb_type: 0 00000100:00100000:0.0:1746066734.654257:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984160512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066734.654318:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.657071:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.662043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.785721:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.790555:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.790591:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.790636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.790674:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982520832 00000100:00100000:0.0:1746066734.790682:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982520832 00000100:00100000:0.0:1746066734.790737:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982520960 00000100:00100000:0.0:1746066734.790739:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982520960 00000100:00100000:0.0:1746066734.790750:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982521088 00000100:00100000:0.0:1746066734.790752:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982521088 00000100:00100000:0.0:1746066734.790768:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14171 00000100:00100000:0.0:1746066734.790776:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982520832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.790801:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.790818:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfa3129 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceea8 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.790874:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984160768:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.790984:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.795698:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984160768:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.795734:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfa3129 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceea8 expref: 38 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.795748:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfa3129 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceea8 expref: 38 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.795777:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8c00, rc 0) 00000100:00100000:0.0:1746066734.795808:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982520832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5032us (5263us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.795817:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14171 00000100:00100000:0.0:1746066734.800084:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.806769:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.825481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.825533:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.825812:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3364 00000100:00100000:0.0:1746066734.825821:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982521728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.829577:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.847227:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.850259:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.861478:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.878186:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.890671:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982523008 00000100:00100000:0.0:1746066734.890677:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982523008 00010000:00010000:0.0:1746066734.890705:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa2fee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced9e expref: 16 pid: 7243 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066734.890735:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982523136 00000100:00100000:0.0:1746066734.890737:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982523136 00010000:00010000:0.0:1746066734.890746:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009718cc00/0xf1867c21abfa2eba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec7f expref: 35 pid: 7243 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066734.890759:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6216 00000100:00100000:0.0:1746066734.890764:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882982523008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.890775:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.890780:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa2fee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced9e expref: 16 pid: 7243 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.890789:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa2fee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced9e expref: 16 pid: 7243 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.890815:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa2fee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ced9e expref: 16 pid: 7243 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.890830:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066734.890833:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa3153 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066734.890840:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa3153 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066734.890845:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.890901:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882982523008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.890907:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6216 00000100:00100000:0.0:1746066734.890921:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6217 00000100:00100000:0.0:1746066734.890925:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882982523136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.890930:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.890933:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009718cc00/0xf1867c21abfa2eba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec7f expref: 35 pid: 7243 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.890940:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009718cc00/0xf1867c21abfa2eba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec7f expref: 35 pid: 7243 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.890949:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009718cc00/0xf1867c21abfa2eba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec7f expref: 35 pid: 7243 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.891252:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066734.891257:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa3153 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066734.891265:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa3153 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066734.891271:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa3153 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066734.891287:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.891306:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882982523136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 380us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.891312:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6217 00000100:00100000:0.0:1746066734.895812:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.895826:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.895842:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982524032 00000100:00100000:0.0:1746066734.895845:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982524032 00000100:00100000:0.0:1746066734.895872:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982524288 00000100:00100000:0.0:1746066734.895874:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982524288 00000100:00100000:0.0:1746066734.895911:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14176 00000100:00100000:0.0:1746066734.895916:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982524032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.895925:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.895936:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa3199 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceee0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.895953:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.895955:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.895964:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa3199 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceee0 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.895977:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa3199 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceee0 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.895988:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9a00, rc 0) 00000100:00100000:0.0:1746066734.896030:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982524032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 114us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.896036:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14176 00000100:00100000:0.0:1746066734.896050:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14177 00000100:00100000:0.0:1746066734.896054:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882982524288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.896062:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.896069:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfa31ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceeee expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.896107:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984161920:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.896163:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.896193:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.896206:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982524160 00000100:00100000:0.0:1746066734.896209:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982524160 00000100:00100000:0.0:1746066734.896225:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14178 00000100:00100000:0.0:1746066734.896229:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982524160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066734.896236:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066734.896242:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa31b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14ceee7 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.896262:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984162048:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066734.896280:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.896374:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882982523392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7681us (7804us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066734.896383:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3368 00002000:00100000:0.0:1746066734.896392:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800966e1500 x1830882982523392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/440 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.896400:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1500 with x1830882982523392 ext(2097152->3145727) 00002000:00010000:0.0:1746066734.896403:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e1500 00002000:00010000:0.0:1746066734.902624:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066734 -> 1746066735 00002000:00010000:0.0:1746066734.902635:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066734 -> 1746066735 00000100:00100000:0.0:1746066734.902665:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984161920:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066734.902708:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfa31ae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceeee expref: 17 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.902724:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9400/0xf1867c21abfa31ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceeee expref: 17 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066734.902737:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9400, rc 0) 00000100:00100000:0.0:1746066734.905026:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982524288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8962us (9190us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066734.905036:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14177 00000100:00100000:0.0:1746066734.907670:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.908213:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.913444:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.913500:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.913523:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.913540:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982524928 00000100:00100000:0.0:1746066734.913547:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982524928 00010000:00010000:0.0:1746066734.913575:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfa30b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee46 expref: 37 pid: 1893 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066734.913602:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982525056 00000100:00100000:0.0:1746066734.913603:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982525056 00010000:00010000:0.0:1746066734.913612:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094419c00/0xf1867c21abfa30b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee3f expref: 29 pid: 12233 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066734.913624:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6218 00000100:00100000:0.0:1746066734.913629:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882982524928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.913642:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.913661:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfa30b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee46 expref: 37 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.913670:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfa30b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee46 expref: 37 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.913691:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8800/0xf1867c21abfa30b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee46 expref: 37 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.913705:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.913732:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982524928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.913738:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6218 00000100:00100000:0.0:1746066734.913749:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6219 00000100:00100000:0.0:1746066734.913753:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982525056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066734.913762:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066734.913768:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094419c00/0xf1867c21abfa30b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee3f expref: 29 pid: 12233 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.913775:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094419c00/0xf1867c21abfa30b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee3f expref: 29 pid: 12233 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.913786:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419c00/0xf1867c21abfa30b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee3f expref: 29 pid: 12233 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.913794:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.913796:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066734.913802:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa31ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->2940927) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef03 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.913809:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa31ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->2940927) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef03 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066734.913836:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa31ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->2940927) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef03 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066734.913847:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984162560:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066734.913935:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066734.913973:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.914060:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982524800 00000100:00100000:0.0:1746066734.914063:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982524800 00002000:00100000:0.0:1746066734.914089:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3346431) req@ffff8801310f0380 x1830882982524800/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.914098:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0380 with x1830882982524800 ext(3145728->3346431) 00010000:00010000:0.0:1746066734.914104:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094418600/0xf1867c21abfa30c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee4d expref: 14 pid: 12233 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.914114:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094418600/0xf1867c21abfa30c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3346431) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee4d expref: 14 pid: 12233 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746066734.914121:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801310f0380 00000100:00100000:0.0:1746066734.915535:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 675 00000100:00100000:0.0:1746066734.915543:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882982524800:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066734.915708:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984162560:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066734.915724:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066734.915740:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982525056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1985us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066734.915747:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6219 00000100:00100000:0.0:1746066734.915839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.915901:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982525568 00000100:00100000:0.0:1746066734.915905:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982525568 00002000:00100000:0.0:1746066734.915919:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2744320->2748415) req@ffff8801310f3800 x1830882982525568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.915926:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f3800 with x1830882982525568 ext(2744320->2748415) 00002000:00010000:0.0:1746066734.915929:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f3800 00000100:00100000:0.0:1746066734.915940:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3370 00000100:00100000:0.0:1746066734.915944:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982525568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066734.916006:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982525568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 61us (167us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066734.916012:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3370 00002000:00100000:0.0:1746066734.916016:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2744320->2748415) req@ffff8801310f3800 x1830882982525568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746066745 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.916022:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f3800 with x1830882982525568 ext(2744320->2748415) 00002000:00010000:0.0:1746066734.916024:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f3800 00000100:00100000:0.0:1746066734.923340:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.931756:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.945163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.956798:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.956850:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.964849:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.964963:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982526848 00000100:00100000:0.0:1746066734.964972:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982526848 00002000:00100000:0.0:1746066734.965024:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2744320->2940927) req@ffff88012b906a00 x1830882982526848/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.965034:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b906a00 with x1830882982526848 ext(2744320->2940927) 00010000:00010000:0.0:1746066734.965044:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa31ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->2940927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef03 expref: 28 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.965059:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa31ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2744320->2940927) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef03 expref: 28 pid: 1893 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746066734.965066:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b906a00 00000100:00100000:0.0:1746066734.965093:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 677 00000100:00100000:0.0:1746066734.965104:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982526848:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066734.966977:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.985048:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.992120:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.992804:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.995787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.995814:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066734.995846:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982527872 00000100:00100000:0.0:1746066734.995852:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982527872 00002000:00100000:0.0:1746066734.995921:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012b905500 x1830882982527872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.995931:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b905500 with x1830882982527872 ext(3145728->4194303) 00010000:00010000:0.0:1746066734.995938:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e0b600/0xf1867c21abfa31c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceefc expref: 39 pid: 20361 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.995949:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e0b600/0xf1867c21abfa31c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceefc expref: 39 pid: 20361 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746066734.995955:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b905500 00000100:00100000:0.0:1746066734.995970:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982528000 00000100:00100000:0.0:1746066734.995973:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982528000 00002000:00100000:0.0:1746066734.995988:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1490943) req@ffff88012b907480 x1830882982528000/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:140/0 lens 488/0 e 0 to 0 dl 1746066745 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066734.995994:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b907480 with x1830882982528000 ext(1048576->1490943) 00010000:00010000:0.0:1746066734.995999:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098bb8200/0xf1867c21abfa310d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee9a expref: 40 pid: 12233 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066734.996010:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098bb8200/0xf1867c21abfa310d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1490943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cee9a expref: 40 pid: 12233 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746066734.996015:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b907480 00000100:00100000:0.0:1746066734.996031:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 678 00000100:00100000:0.0:1746066734.996036:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882982527872:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066735.009208:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.013873:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.014380:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.016590:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.018667:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.018703:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066735.019064:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066735.019067:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066735.030923:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982529792 00000100:00100000:0.0:1746066735.030933:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982529792 00010000:00010000:0.0:1746066735.030963:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093506000/0xf1867c21abfa31d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef11 expref: 39 pid: 1893 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066735.030988:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6225 00000100:00100000:0.0:1746066735.030995:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982529792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.031012:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.031031:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093506000/0xf1867c21abfa31d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef11 expref: 39 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.031046:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093506000/0xf1867c21abfa31d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef11 expref: 39 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.031072:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.031074:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.031080:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfa31f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef2d expref: 39 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.031088:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfa31f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef2d expref: 39 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.031229:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8a00/0xf1867c21abfa31f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4583423) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef2d expref: 39 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.031243:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984164096:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066735.031728:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.033288:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984164096:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066735.033299:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066735.033331:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882982529792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2336us (2544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.033339:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6225 00000100:00100000:0.0:1746066735.044363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.044422:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.047465:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.047515:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.049975:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.050014:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.060397:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.064157:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.068342:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.071057:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.071124:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.071136:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982531584 00000100:00100000:0.0:1746066735.071139:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982531584 00000100:00100000:0.0:1746066735.071161:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982531456 00000100:00100000:0.0:1746066735.071162:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982531456 00000100:00100000:0.0:1746066735.071619:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14192 00000100:00100000:0.0:1746066735.071625:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982531584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066735.071634:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066735.071645:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa3217 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cef57 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.071685:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984164608:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066735.071733:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.077734:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.078419:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.086646:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982532096 00000100:00100000:0.0:1746066735.086653:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982532096 00002000:00100000:0.0:1746066735.086699:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096ec9f80 x1830882982532096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.086709:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9f80 with x1830882982532096 ext(4194304->5033983) 00002000:00010000:0.0:1746066735.086714:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9f80 00000100:00100000:0.0:1746066735.086751:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3379 00000100:00100000:0.0:1746066735.086759:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882982532096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066735.093052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.096987:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.121826:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.136645:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.175498:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.178751:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.180229:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.213234:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.220758:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.242319:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982534272 00000100:00100000:0.0:1746066735.242329:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982534272 00000100:00100000:0.0:1746066735.242369:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982534784 00000100:00100000:0.0:1746066735.242371:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982534784 00000100:00100000:0.0:1746066735.248136:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.263863:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.275868:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982535936 00000100:00100000:0.0:1746066735.275906:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982535936 00000100:00100000:0.0:1746066735.275945:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5748 00000100:00100000:0.0:1746066735.275952:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32199:x1830882982535936:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:0.0:1746066735.276082:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32199:x1830882982535936:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 131us (460us total) trans 8589936235 rc 0/0 00000100:00100000:0.0:1746066735.276089:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5748 00000100:00100000:0.0:1746066735.289605:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.301866:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.351553:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.351622:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.388112:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.388180:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.388249:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.400055:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.400091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.400150:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.400192:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982537728 00000100:00100000:0.0:1746066735.400201:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982537728 00010000:00010000:0.0:1746066735.400241:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa3272 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef88 expref: 19 pid: 20361 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746066735.400268:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982537984 00000100:00100000:0.0:1746066735.400270:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982537984 00010000:00010000:0.0:1746066735.400280:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa31bc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceef5 expref: 32 pid: 1893 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746066735.400293:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982537856 00000100:00100000:0.0:1746066735.400295:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982537856 00010000:00010000:0.0:1746066735.400303:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa3145 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceec4 expref: 41 pid: 1893 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066735.400317:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6230 00000100:00100000:0.0:1746066735.400326:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982537728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.400341:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.400363:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa3272 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef88 expref: 19 pid: 20361 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746066735.400379:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa3272 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef88 expref: 19 pid: 20361 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746066735.400404:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066735.400447:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982537728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.400454:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6230 00000100:00100000:0.0:1746066735.400472:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6232 00000100:00100000:0.0:1746066735.400478:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982537856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.400486:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.400496:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa3145 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceec4 expref: 41 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.400505:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa3145 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceec4 expref: 41 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.400518:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.400520:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.400528:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa32fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefb9 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.400535:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa32fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefb9 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.400576:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa32fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefb9 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.400590:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984165504:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066735.400652:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.407939:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984165504:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066735.407962:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066735.408245:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882982537856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7763us (8090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.408254:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6232 00000100:00100000:0.0:1746066735.409723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.412598:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.417600:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.419556:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.421861:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.421906:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982538880 00000100:00100000:0.0:1746066735.421910:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982538880 00010000:00010000:0.0:1746066735.421935:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa3225 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef5e expref: 40 pid: 12255 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066735.421959:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6233 00000100:00100000:0.0:1746066735.421966:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882982538880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.421983:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.422004:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa3225 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef5e expref: 40 pid: 12255 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.422016:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa3225 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef5e expref: 40 pid: 12255 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.422042:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa3225 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef5e expref: 40 pid: 12255 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.422061:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066735.422099:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982538880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.422105:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6233 00000100:00100000:0.0:1746066735.422173:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.422184:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982538496 00000100:00100000:0.0:1746066735.422186:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982538496 00010000:00010000:0.0:1746066735.422195:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82600/0xf1867c21abfa328e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef8f expref: 18 pid: 20361 timeout: 803 lvb_type: 1 00000100:00100000:0.0:1746066735.422207:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6234 00000100:00100000:0.0:1746066735.422211:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882982538496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.422216:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.422221:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82600/0xf1867c21abfa328e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef8f expref: 18 pid: 20361 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746066735.422228:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82600/0xf1867c21abfa328e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef8f expref: 18 pid: 20361 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746066735.422238:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82600/0xf1867c21abfa328e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef8f expref: 18 pid: 20361 timeout: 803 lvb_type: 1 00010000:00010000:0.0:1746066735.422249:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066735.422260:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982538496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.422264:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6234 00000100:00100000:0.0:1746066735.422317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.422325:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982539008 00000100:00100000:0.0:1746066735.422328:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982539008 00010000:00010000:0.0:1746066735.422338:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfa3209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef42 expref: 31 pid: 11630 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066735.422352:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6235 00000100:00100000:0.0:1746066735.422355:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882982539008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.422360:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.422365:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfa3209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef42 expref: 31 pid: 11630 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.422372:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfa3209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef42 expref: 31 pid: 11630 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.422381:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8400/0xf1867c21abfa3209 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef42 expref: 31 pid: 11630 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.422389:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.422390:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.422396:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130800200/0xf1867c21abfa3305 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3067903) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefc0 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.422408:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130800200/0xf1867c21abfa3305 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3067903) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefc0 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.422436:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130800200/0xf1867c21abfa3305 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3067903) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefc0 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.422447:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984166016:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066735.422490:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00002000:00010000:0.0:1746066735.431743:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066734 -> 1746066736 00002000:00010000:0.0:1746066735.431751:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066734 -> 1746066736 00002000:00010000:0.0:1746066735.431752:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066735 -> 1746066736 00000100:00100000:0.0:1746066735.431776:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984166272:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066735.431811:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa3313 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefc7 expref: 40 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.431824:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa3313 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefc7 expref: 40 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.431835:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:0.0:1746066735.431904:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982538624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8966us (14313us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066735.431913:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14203 00000100:00100000:0.0:1746066735.433628:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.436427:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.436498:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982539264 00000100:00100000:0.0:1746066735.436511:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982539264 00002000:00100000:0.0:1746066735.436567:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3063808->3067903) req@ffff880093ccdf80 x1830882982539264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.436578:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdf80 with x1830882982539264 ext(3063808->3067903) 00002000:00010000:0.0:1746066735.436585:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccdf80 00000100:00100000:0.0:1746066735.439485:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3388 00000100:00100000:0.0:1746066735.439553:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982539264:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066735.439703:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982539264:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 207us (6074us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066735.439709:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3388 00002000:00100000:0.0:1746066735.439717:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3063808->3067903) req@ffff880093ccdf80 x1830882982539264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746066746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.439725:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdf80 with x1830882982539264 ext(3063808->3067903) 00002000:00010000:0.0:1746066735.439731:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccdf80 00000100:00100000:0.0:1746066735.442757:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.447032:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.463765:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.466091:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.466234:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982540288 00000100:00100000:0.0:1746066735.466239:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982540288 00002000:00100000:0.0:1746066735.466272:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3067903) req@ffff880093ccdc00 x1830882982540288/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.466279:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdc00 with x1830882982540288 ext(2097152->3067903) 00010000:00010000:0.0:1746066735.466287:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130800200/0xf1867c21abfa3305 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefc0 expref: 32 pid: 11630 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.466299:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130800200/0xf1867c21abfa3305 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3067903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefc0 expref: 32 pid: 11630 timeout: 803 lvb_type: 0 00002000:00010000:0.0:1746066735.466304:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ccdc00 00000100:00100000:0.0:1746066735.466321:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 683 00000100:00100000:0.0:1746066735.466327:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982540288:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066735.487455:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.487563:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.489954:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.494114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.494538:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.494585:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.494599:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.494629:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.503375:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.511019:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.511321:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.514736:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.515755:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.515808:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.516250:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14210 00000100:00100000:0.0:1746066735.516257:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2014:x1830882982542336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066735.516268:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066735.516284:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa3352 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cefff expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.516327:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984167552:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066735.516372:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.517431:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066735.517522:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066735 -> 1746066736 00002000:00010000:0.0:1746066735.517525:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066735 -> 1746066736 00002000:00010000:0.0:1746066735.517527:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066735 -> 1746066736 00000100:00100000:0.0:1746066735.518015:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984167552:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066735.518039:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa3352 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefff expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.518060:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa3352 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefff expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.518538:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece600, rc 0) 00000100:00100000:0.0:1746066735.518572:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2014:x1830882982542336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2315us (2817us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066735.518577:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14210 00000100:00100000:0.0:1746066735.521573:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.525414:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.531973:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+33:2014:x1830882982542976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6317us (6566us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066735.531983:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3393 00002000:00100000:0.0:1746066735.531991:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012bb74380 x1830882982542976/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/440 e 0 to 0 dl 1746066746 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.532004:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74380 with x1830882982542976 ext(4194304->5033983) 00002000:00010000:0.0:1746066735.532008:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb74380 00000100:00100000:0.0:1746066735.536054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.536103:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.536205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.536236:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982543744 00000100:00100000:0.0:1746066735.536245:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982543744 00000100:00100000:0.0:1746066735.536309:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5751 00000100:00100000:0.0:1746066735.536317:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:32203:x1830882982543744:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066735.536531:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:32203:x1830882982543744:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 214us (325us total) trans 8589936240 rc 0/0 00000100:00100000:0.0:1746066735.536538:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5751 00000100:00100000:0.0:1746066735.544119:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.544173:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.663441:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.684694:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.684751:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.708459:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.708508:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.716777:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.720561:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.720609:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.725832:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.725909:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982545664 00000100:00100000:0.0:1746066735.725917:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982545664 00000100:00100000:0.0:1746066735.725964:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15973 00000100:00100000:0.0:1746066735.725971:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32224:x1830882982545664:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066735.725992:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066735.726008:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa33d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf05a expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.726071:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066735.726084:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a600/0xf1867c21abfa33d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066735.726090:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066735.726106:0:7243:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a600/0xf1867c21abfa33d0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066735.726115:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066735.745329:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982545920 00000100:00100000:0.0:1746066735.745340:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982545920 00010000:00010000:0.0:1746066735.745381:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa333d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefea expref: 45 pid: 1893 timeout: 803 lvb_type: 0 00000100:00100000:0.0:1746066735.745423:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6245 00000100:00100000:0.0:1746066735.745431:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882982545920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.745445:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.745466:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa333d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefea expref: 45 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.745480:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa333d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefea expref: 45 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.745504:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa333d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1650688->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cefea expref: 45 pid: 1893 timeout: 803 lvb_type: 0 00010000:00010000:0.0:1746066735.748128:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.748134:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.748157:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa33a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf045 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.748168:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa33a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf045 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.748215:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa33a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf045 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.748227:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984169344:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066735.748329:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.752094:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.752148:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066735.753452:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066735.753462:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066735.753516:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:0.0:1746066735.753520:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066735.753536:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066735.753546:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066735.753572:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa33d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf05a expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.753582:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa33de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf05a expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.753588:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066735.753591:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066735.753592:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf000, rc 0) 00000100:00100000:0.0:1746066735.754459:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32224:x1830882982545664:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 28485us (28633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.754466:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15973 00000100:00100000:0.0:1746066735.760999:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984169344:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066735.761018:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066735.763376:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882982545920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 17934us (18115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.763390:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6245 00000100:00100000:0.0:1746066735.775492:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982546688 00000100:00100000:0.0:1746066735.775498:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982546688 00000100:00100000:0.0:1746066735.775537:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982546816 00000100:00100000:0.0:1746066735.775539:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982546816 00000100:00100000:0.0:1746066735.775555:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14222 00000100:00100000:0.0:1746066735.775560:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2013:x1830882982546688:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066735.775570:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066735.775587:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecee00/0xf1867c21abfa33fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf06f expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.775636:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984169472:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066735.775736:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.775757:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14223 00000100:00100000:0.0:1746066735.775762:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982546816:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066735.775768:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066735.775775:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfa3401 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf076 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.775786:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.775788:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066735.775793:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfa3401 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf076 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.775802:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfa3401 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf076 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.775809:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf800, rc 0) 00000100:00100000:0.0:1746066735.776540:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882982546816:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 775us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.776546:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14223 00000100:00100000:0.0:1746066735.777111:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982547328 00000100:00100000:0.0:1746066735.777115:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982547328 00002000:00100000:0.0:1746066735.777132:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1597440->2097151) req@ffff880093ccd500 x1830882982547328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.777139:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd500 with x1830882982547328 ext(1597440->2097151) 00002000:00010000:0.0:1746066735.777143:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccd500 00000100:00100000:0.0:1746066735.777155:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3397 00000100:00100000:0.0:1746066735.777160:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982547328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066735.793448:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.801801:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984169600:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066735.804803:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984169856:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066735.805253:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982547584 00000100:00100000:0.0:1746066735.805258:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982547584 00010000:00010000:0.0:1746066735.805279:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfa31fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef3b expref: 20 pid: 11630 timeout: 804 lvb_type: 1 00000100:00100000:0.0:1746066735.805310:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6247 00000100:00100000:0.0:1746066735.805316:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882982547584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066735.805326:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066735.805340:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfa31fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef3b expref: 20 pid: 11630 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746066735.805349:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfa31fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef3b expref: 20 pid: 11630 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746066735.805369:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8e00/0xf1867c21abfa31fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cef3b expref: 20 pid: 11630 timeout: 804 lvb_type: 1 00010000:00010000:0.0:1746066735.805383:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066735.805404:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982547584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.805409:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6247 00000100:00100000:0.0:1746066735.808562:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.808597:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984169728:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066735.808619:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa3408 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3743744->4100095] (req 3743744->4100095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf07d expref: 18 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066735.808628:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8400, rc 0) 00000100:00100000:0.0:1746066735.808644:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:32223:x1830882982547456:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 15070us (15198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066735.808649:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14224 00000100:00100000:0.0:1746066735.809132:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.812915:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.813752:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.814484:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.816121:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982549376 00000100:00100000:0.0:1746066735.816125:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982549376 00002000:00100000:0.0:1746066735.816146:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3743744->3747839) req@ffff88012bb74a80 x1830882982549376/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.816152:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74a80 with x1830882982549376 ext(3743744->3747839) 00002000:00010000:0.0:1746066735.816156:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74a80 00000100:00100000:0.0:1746066735.816386:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3398 00000100:00100000:0.0:1746066735.816392:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982549376:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066735.816477:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982549376:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 84us (727us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066735.816482:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3398 00002000:00100000:0.0:1746066735.816487:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3743744->3747839) req@ffff88012bb74a80 x1830882982549376/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746066746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.816494:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74a80 with x1830882982549376 ext(3743744->3747839) 00002000:00010000:0.0:1746066735.816497:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74a80 00000100:00100000:0.0:1746066735.827208:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.827294:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.832085:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.837485:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982550272 00000100:00100000:0.0:1746066735.837493:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982550272 00002000:00100000:0.0:1746066735.837529:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012bb76300 x1830882982550272/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.837539:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76300 with x1830882982550272 ext(1048576->2097151) 00002000:00010000:0.0:1746066735.837543:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb76300 00000100:00100000:0.0:1746066735.837708:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3401 00000100:00100000:0.0:1746066735.837720:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982550272:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066735.855451:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.855777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.890283:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.890311:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.890330:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.890343:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.890368:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982551424 00000100:00100000:0.0:1746066735.890376:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982551424 00002000:00100000:0.0:1746066735.890419:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095cc9880 x1830882982551424/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 504/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.890429:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cc9880 with x1830882982551424 ext(2097152->4194303) 00002000:00010000:0.0:1746066735.890434:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cc9880 00000100:00100000:0.0:1746066735.890448:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982551680 00000100:00100000:0.0:1746066735.890449:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982551680 00002000:00100000:0.0:1746066735.890459:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3067903) req@ffff880098fbed80 x1830882982551680/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.890465:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbed80 with x1830882982551680 ext(2097152->3067903) 00002000:00010000:0.0:1746066735.890468:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbed80 00000100:00100000:0.0:1746066735.890477:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3403 00000100:00100000:0.0:1746066735.890483:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882982551424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066735.912968:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.913157:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.926120:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982552320:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12542us (12961us total) trans 17179874111 rc 0/0 00000100:00100000:0.0:1746066735.926133:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 687 00002000:00100000:0.0:1746066735.926146:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3743744->4100095) req@ffff880098fbf100 x1830882982552320/t17179874111(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/448 e 0 to 0 dl 1746066746 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.926154:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882982552320 ext(3743744->4100095) 00010000:00010000:0.0:1746066735.926166:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa3408 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3743744->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf07d expref: 20 pid: 12255 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066735.926179:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa3408 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3743744->4100095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf07d expref: 20 pid: 12255 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746066735.926187:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbf100 00000100:00100000:0.0:1746066735.934114:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.934525:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.934721:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.935334:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.935352:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.935364:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.935391:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.940569:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.940597:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982553856 00000100:00100000:0.0:1746066735.940604:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982553856 00002000:00100000:0.0:1746066735.940644:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095dd7480 x1830882982553856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/0 e 0 to 0 dl 1746066746 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.940655:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882982553856 ext(3145728->4194303) 00002000:00010000:0.0:1746066735.940660:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd7480 00000100:00100000:0.0:1746066735.940679:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3406 00000100:00100000:0.0:1746066735.940687:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982553856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066735.951564:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.951605:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.951636:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.951850:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982553856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11162us (11287us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066735.951859:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3406 00002000:00100000:0.0:1746066735.951880:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095dd7480 x1830882982553856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:141/0 lens 488/440 e 0 to 0 dl 1746066746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.951914:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882982553856 ext(3145728->4194303) 00002000:00010000:0.0:1746066735.951918:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd7480 00000100:00100000:0.0:1746066735.951947:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3408 00000100:00100000:0.0:1746066735.951953:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982554368:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066735.952687:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3409 00000100:00100000:0.0:1746066735.952694:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982554624:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066735.952755:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982554624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 61us (1117us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066735.952760:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3409 00002000:00100000:0.0:1746066735.952765:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1183744->1187839) req@ffff880095dd6d80 x1830882982554624/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746066746 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.952773:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6d80 with x1830882982554624 ext(1183744->1187839) 00002000:00010000:0.0:1746066735.952776:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6d80 00000100:00100000:0.0:1746066735.952917:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.959758:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.959799:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.959822:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982555008 00000100:00100000:0.0:1746066735.959828:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982555008 00000100:00100000:0.0:1746066735.959878:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982555136 00000100:00100000:0.0:1746066735.959880:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982555136 00000100:00100000:0.0:1746066735.959931:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14235 00000100:00100000:0.0:1746066735.959938:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982555008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066735.959953:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066735.959968:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a000/0xf1867c21abfa3494 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf0df expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.960011:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984172160:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066735.960074:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.960143:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.960239:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982554368:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8285us (8632us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066735.960248:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3408 00002000:00100000:0.0:1746066735.960256:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095dd4000 x1830882982554368/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:141/0 lens 488/440 e 0 to 0 dl 1746066746 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066735.960265:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4000 with x1830882982554368 ext(3145728->4194303) 00002000:00010000:0.0:1746066735.960269:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4000 00000100:00100000:0.0:1746066735.960327:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984172032:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066735.960343:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa348d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066735.968087:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.976964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.981794:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.981846:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.988318:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066735.989263:0:1893:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066736 -> 1746066737 00000100:00100000:0.0:1746066735.989282:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984172544:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066735.989309:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b33e00/0xf1867c21abfa34c5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf0f4 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.989319:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b33e00/0xf1867c21abfa34c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf0f4 expref: 21 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.989330:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33e00, rc 0) 00000100:00100000:0.0:1746066735.989359:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882982555776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6943us (7576us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066735.989365:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14237 00000100:00100000:0.0:1746066735.991987:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.992036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.993357:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.993384:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.993405:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066735.993420:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982556672 00000100:00100000:0.0:1746066735.993423:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982556672 00000100:00100000:0.0:1746066735.993449:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14241 00000100:00100000:0.0:1746066735.993455:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882982556672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066735.993464:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066735.993471:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfa34e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf117 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066735.993496:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984173056:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066735.993542:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066735.996025:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984173056:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066735.996046:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfa34e1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf117 expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.996055:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629ae00/0xf1867c21abfa34e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf117 expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066735.996164:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ae00, rc 0) 00000100:00100000:0.0:1746066735.997346:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982556672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3884us (3953us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066735.997355:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14241 00000100:00100000:0.0:1746066736.001089:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.009014:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.057073:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.061713:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.061802:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.064022:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.067452:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.071762:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.082100:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.082765:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.084533:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.090064:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982559104 00000100:00100000:0.0:1746066736.090072:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982559104 00002000:00100000:0.0:1746066736.090111:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (4644864->4648959) req@ffff88012faf3b80 x1830882982559104/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.090120:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3b80 with x1830882982559104 ext(4644864->4648959) 00002000:00010000:0.0:1746066736.090125:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf3b80 00000100:00100000:0.0:1746066736.090152:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3411 00000100:00100000:0.0:1746066736.090159:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882982559104:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066736.090279:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882982559104:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 119us (835us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066736.090285:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3411 00002000:00100000:0.0:1746066736.090290:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (4644864->4648959) req@ffff88012faf3b80 x1830882982559104/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746066747 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.090296:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3b80 with x1830882982559104 ext(4644864->4648959) 00002000:00010000:0.0:1746066736.090299:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf3b80 00000100:00100000:0.0:1746066736.100838:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.111192:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.131687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.136868:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984174464:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066736.137502:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b32400/0xf1867c21abfa3527 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4087808->4194303] (req 4087808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf141 expref: 41 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.137524:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32400, rc 0) 00000001:00080000:0.0:1746066736.146965:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841523 is committed 00000001:00080000:0.0:1746066736.146975:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841522 is committed 00000001:00080000:0.0:1746066736.147012:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841517 is committed 00000001:00080000:0.0:1746066736.147029:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841509 is committed 00000100:00100000:0.0:1746066736.151622:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.159609:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.159660:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984174720:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066736.159681:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d800/0xf1867c21abfa352e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf148 expref: 45 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.159697:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d800, rc 0) 00000100:00100000:0.0:1746066736.159718:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+45:32240:x1830882982560128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2503us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.159725:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14246 00000100:00100000:0.0:1746066736.167807:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.223339:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.223721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.223754:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.223768:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.223789:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.224540:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.224564:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982561408 00000100:00100000:0.0:1746066736.224567:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982561408 00002000:00100000:0.0:1746066736.224595:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1347583) req@ffff880135d62300 x1830882982561408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.224603:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62300 with x1830882982561408 ext(1048576->1347583) 00002000:00010000:0.0:1746066736.224606:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d62300 00000100:00100000:0.0:1746066736.224616:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982561664 00000100:00100000:0.0:1746066736.224618:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982561664 00002000:00100000:0.0:1746066736.224626:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1187840->2097151) req@ffff880135d60a80 x1830882982561664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.224632:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d60a80 with x1830882982561664 ext(1187840->2097151) 00002000:00010000:0.0:1746066736.224635:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d60a80 00000100:00100000:0.0:1746066736.224645:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3413 00000100:00100000:0.0:1746066736.224649:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882982561408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066736.232622:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066736.237536:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066735 -> 1746066737 00000100:00100000:0.0:1746066736.237546:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984175360:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066736.237562:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b33e00/0xf1867c21abfa354a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf164 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066736.237570:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b33e00/0xf1867c21abfa354a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf164 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066736.237581:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33e00, rc 0) 00000100:00100000:0.0:1746066736.237603:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882982561280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 13197us (13833us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066736.237609:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14250 00000100:00100000:0.0:1746066736.240405:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.251080:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.251122:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.254738:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.260230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.260251:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982562688 00000100:00100000:0.0:1746066736.260259:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982562688 00002000:00100000:0.0:1746066736.260296:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1347584->2097151) req@ffff880135d60000 x1830882982562688/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.260304:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d60000 with x1830882982562688 ext(1347584->2097151) 00010000:00010000:0.0:1746066736.260313:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9200/0xf1867c21abfa344e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf0a0 expref: 45 pid: 1893 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.260323:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c9200/0xf1867c21abfa344e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf0a0 expref: 45 pid: 1893 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746066736.260329:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135d60000 00000100:00100000:0.0:1746066736.271465:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982563328 00000100:00100000:0.0:1746066736.271475:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982563328 00010000:00010000:0.0:1746066736.271509:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa3566 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf16b expref: 17 pid: 7244 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746066736.271533:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6271 00000100:00100000:0.0:1746066736.271540:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982563328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066736.271552:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066736.271557:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa3566 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf16b expref: 17 pid: 7244 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.271567:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa3566 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf16b expref: 17 pid: 7244 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.271587:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa3566 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf16b expref: 17 pid: 7244 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.271605:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066736.271610:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066736.271620:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066736.271630:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066736.271649:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066736.271673:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982563328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (5999us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.271680:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6271 00010000:00010000:0.0:1746066736.271721:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066736.271727:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066736.271745:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066736.271901:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa3574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf179 expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.271916:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf179 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.271922:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066736.271924:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066736.271926:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2800, rc 0) 00000100:00100000:0.0:1746066736.271947:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:32251:x1830882982562560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11731us (17219us total) trans 8589936253 rc 0/0 00000100:00100000:0.0:1746066736.271953:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15982 00000100:00100000:0.0:1746066736.273793:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984176000:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066736.273819:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a4b000/0xf1867c21abfa3582 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf195 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066736.273831:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a4b000/0xf1867c21abfa3582 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf195 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066736.273840:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a4b000, rc 0) 00000100:00100000:0.0:1746066736.273881:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982563200:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 11730us (11760us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066736.273902:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14253 00000100:00100000:0.0:1746066736.288257:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882982562688:12345-192.168.204.16@tcp:4:cat.0 Request processed in 26511us (28024us total) trans 17179874113 rc 0/0 00000100:00100000:0.0:1746066736.289555:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 690 00002000:00100000:0.0:1746066736.289580:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1347584->2097151) req@ffff880135d60000 x1830882982562688/t17179874113(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:142/0 lens 488/448 e 0 to 0 dl 1746066747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.289590:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d60000 with x1830882982562688 ext(1347584->2097151) 00010000:00010000:0.0:1746066736.289599:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9200/0xf1867c21abfa344e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf0a0 expref: 49 pid: 1893 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.289613:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c9200/0xf1867c21abfa344e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1347584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf0a0 expref: 49 pid: 1893 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746066736.289619:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135d60000 00000100:00100000:0.0:1746066736.299068:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.299622:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982564480 00000100:00100000:0.0:1746066736.299626:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982564480 00000100:00100000:0.0:1746066736.299655:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15984 00000100:00100000:0.0:1746066736.299660:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32249:x1830882982564480:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066736.299681:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066736.299697:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b800/0xf1867c21abfa35c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf1a3 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.299792:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfa35cf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066736.299807:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf179 expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.299813:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfa35cf lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066736.299831:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf179 expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.299842:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2800/0xf1867c21abfa357b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf179 expref: 29 pid: 7243 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746066736.299851:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984176512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066736.300102:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066736.303548:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.305228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.309440:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.313928:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982565504 00000100:00100000:0.0:1746066736.313933:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982565504 00002000:00100000:0.0:1746066736.313957:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096ecaa00 x1830882982565504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.313967:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecaa00 with x1830882982565504 ext(4194304->5033983) 00002000:00010000:0.0:1746066736.313973:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecaa00 00000100:00100000:0.0:1746066736.313996:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3418 00000100:00100000:0.0:1746066736.314000:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882982565504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066736.332267:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.333967:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.335488:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.348367:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.355038:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.356568:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.370686:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.370730:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.370771:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.371119:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14262 00000100:00100000:0.0:1746066736.371126:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882982566784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066736.371132:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066736.371140:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5e00/0xf1867c21abfa3600 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf1d4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066736.371163:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984177280:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066736.371417:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066736.371746:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982566912 00000100:00100000:0.0:1746066736.371749:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982566912 00010000:00010000:0.0:1746066736.371766:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfa35dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1b1 expref: 24 pid: 11630 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746066736.371787:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6275 00000100:00100000:0.0:1746066736.371792:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982566912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066736.371801:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066736.371821:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfa35dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1b1 expref: 24 pid: 11630 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.371830:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfa35dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1b1 expref: 24 pid: 11630 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.371847:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2a00/0xf1867c21abfa35dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1b1 expref: 24 pid: 11630 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.371873:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.371874:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.371899:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.371907:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.371929:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066736.371938:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984177408:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066736.372276:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066736.374199:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984177408:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066736.374209:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066736.374224:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982566912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2432us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.374231:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6275 00000100:00100000:0.0:1746066736.374589:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.375579:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.378445:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.381079:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.385866:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.385955:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.388169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.393967:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.394010:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.400713:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.405849:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.409753:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.420362:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.454290:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.454349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.502188:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.533283:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.544966:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.555078:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.566426:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.575954:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.577941:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.578091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.588090:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.606143:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.610356:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.619823:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882982572032:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8568us (9460us total) trans 17179874116 rc 0/0 00000100:00100000:0.0:1746066736.619837:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 695 00002000:00100000:0.0:1746066736.619863:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1617920->2097151) req@ffff8800936cd180 x1830882982572032/t17179874116(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:142/0 lens 488/448 e 0 to 0 dl 1746066747 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.619872:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936cd180 with x1830882982572032 ext(1617920->2097151) 00010000:00010000:0.0:1746066736.620125:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.620142:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746066736.620149:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936cd180 00000100:00100000:0.0:1746066736.622447:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.622490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.622526:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982572416 00000100:00100000:0.0:1746066736.622534:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982572416 00010000:00010000:0.0:1746066736.622568:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746066736.622592:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6283 00000100:00100000:0.0:1746066736.622599:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882982572416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066736.622611:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066736.622632:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.622649:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.622673:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa35eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1bf expref: 23 pid: 11630 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.622706:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.622708:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.622715:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa364d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf213 expref: 50 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.622723:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa364d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf213 expref: 50 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.622756:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa364d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf213 expref: 50 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066736.622768:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984179456:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066736.622846:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066736.628572:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.629366:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.640761:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.640789:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982572928 00000100:00100000:0.0:1746066736.640795:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982572928 00002000:00100000:0.0:1746066736.640828:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4055039) req@ffff8800936ce300 x1830882982572928/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.640843:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ce300 with x1830882982572928 ext(3145728->4055039) 00010000:00010000:0.0:1746066736.640866:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfa3638 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1fe expref: 20 pid: 12237 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.640878:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfa3638 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1fe expref: 20 pid: 12237 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746066736.640911:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936ce300 00000100:00100000:0.0:1746066736.640928:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 696 00000100:00100000:0.0:1746066736.640937:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+20:2013:x1830882982572928:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066736.644636:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.649522:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982573184 00000100:00100000:0.0:1746066736.649530:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982573184 00002000:00100000:0.0:1746066736.649567:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1224703) req@ffff880095dd6300 x1830882982573184/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.649575:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6300 with x1830882982573184 ext(1048576->1224703) 00010000:00010000:0.0:1746066736.649582:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa360e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1e2 expref: 10 pid: 12237 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.649591:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa360e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1e2 expref: 10 pid: 12237 timeout: 804 lvb_type: 0 00002000:00010000:0.0:1746066736.649597:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd6300 00000100:00100000:0.0:1746066736.649632:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 697 00000100:00100000:0.0:1746066736.649639:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882982573184:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066736.665261:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066736.665721:0:12233:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff88012ce05c00 x1830882984180096) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfa3638 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1fe expref: 22 pid: 12237 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.665740:0:12233:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfa3638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4055039) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1fe expref: 22 pid: 12237 timeout: 804 lvb_type: 0 00010000:00010000:0.0:1746066736.665758:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bce00/0xf1867c21abfa3638 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4055039) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1fe expref: 22 pid: 12237 timeout: 804 lvb_type: 0 00000100:00100000:0.0:1746066736.665770:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce05c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984180096:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066736.665790:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.665792:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.665798:0:12233:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa3669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3092479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf221 expref: 14 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.665806:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa3669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3092479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf221 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.665838:0:12233:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa3669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3092479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf221 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066736.665872:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984180224:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066736.665961:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066736.667864:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.669692:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.673490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.673535:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.687088:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.688775:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.695426:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.695997:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.712678:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.717276:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982576256 00000100:00100000:0.0:1746066736.717289:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982576256 00002000:00100000:0.0:1746066736.717336:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d9b0700 x1830882982576256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:142/0 lens 504/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.717346:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882982576256 ext(2097152->4194303) 00002000:00010000:0.0:1746066736.717352:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:0.0:1746066736.718025:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3435 00000100:00100000:0.0:1746066736.718034:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882982576256:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066736.734715:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.753556:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982576768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17564us (18838us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066736.753570:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3436 00002000:00100000:0.0:1746066736.753584:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095ce1880 x1830882982576768/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:142/0 lens 488/440 e 0 to 0 dl 1746066747 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.753594:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1880 with x1830882982576768 ext(2097152->3145727) 00002000:00010000:0.0:1746066736.753600:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce1880 00000100:00100000:0.0:1746066736.759158:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.760624:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.760873:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984180864:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066736.760908:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa36af lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf267 expref: 24 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.760921:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155ce00, rc 0) 00000100:00100000:0.0:1746066736.760951:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:32266:x1830882982576896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1605us (1804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.760957:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14281 00000100:00100000:0.0:1746066736.761731:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.771937:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.774293:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.774334:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.780668:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984183040 00000100:00100000:0.0:1746066736.780672:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984183040 00000100:00100000:0.0:1746066736.780692:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984182656 00000100:00100000:0.0:1746066736.780693:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984182656 00000100:00100000:0.0:1746066736.780717:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984182272 00000100:00100000:0.0:1746066736.780719:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984182272 00000100:00100000:0.0:1746066736.780733:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984181888 00000100:00100000:0.0:1746066736.780734:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984181888 00000100:00100000:0.0:1746066736.780741:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984182400 00000100:00100000:0.0:1746066736.780742:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984182400 00000100:00100000:0.0:1746066736.780752:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1746066736.780756:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882984183040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066736.780785:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882984183040:12345-0@lo:400:kworker.0 Request processed in 29us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.780790:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1746066736.780800:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1746066736.780805:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3776:x1830882984182656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066736.780824:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3776:x1830882984182656:12345-0@lo:400:kworker.0 Request processed in 18us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.780829:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1746066736.780837:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1746066736.780841:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882984182272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066736.780873:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882984182272:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.780992:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1746066736.781001:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1746066736.781005:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830882984181888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066736.781029:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3774:x1830882984181888:12345-0@lo:400:kworker.0 Request processed in 23us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.781033:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1746066736.781039:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1746066736.781043:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830882984182400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066736.781242:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3774:x1830882984182400:12345-0@lo:400:kworker.0 Request processed in 18us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.781247:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1746066736.781386:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.781480:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.781507:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.781517:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982578048 00000100:00100000:0.0:1746066736.781519:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982578048 00000100:00100000:0.0:1746066736.781534:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14284 00000100:00100000:0.0:1746066736.781543:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882982578048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066736.781552:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066736.781565:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa36c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf27c expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.781583:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.781592:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa36c4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf27c expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066736.781600:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa36c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf27c expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066736.781612:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1e00, rc 0) 00000100:00100000:0.0:1746066736.781633:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882982578048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 94us (125us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066736.781637:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14284 00000100:00100000:0.0:1746066736.781666:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.783659:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.783693:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.783930:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3439 00000100:00100000:0.0:1746066736.783937:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982578560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066736.788752:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.795893:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.796088:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.796267:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6291 00000100:00100000:0.0:1746066736.796273:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982579200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066736.796280:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066736.796289:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfa356d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf172 expref: 26 pid: 12255 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066736.796297:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfa356d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf172 expref: 26 pid: 12255 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066736.796308:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a4b600/0xf1867c21abfa356d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf172 expref: 26 pid: 12255 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066736.796328:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.796330:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066736.796337:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfa36cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf283 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.796344:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfa36cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf283 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066736.796373:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009357a000/0xf1867c21abfa36cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1548287) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf283 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066736.796385:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984183552:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066736.796451:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066736.801906:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.801993:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.802610:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.807987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.816671:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.816730:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.823811:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.824587:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.828517:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984184576 00000100:00100000:0.0:1746066736.828524:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984184576 00000100:00100000:0.0:1746066736.828570:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1746066736.828704:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984184576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746066736.828729:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1067507008 pending 8450048 free 3912097792 avail 3680575488 00000100:00100000:0.0:1746066736.828776:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984184576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066736.828782:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1746066736.914293:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.924089:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.924573:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.926055:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.938102:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.938157:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.939661:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3445 00000100:00100000:0.0:1746066736.939670:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882982581888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066736.954558:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.961874:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.961926:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.961995:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.962011:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982582784 00000100:00100000:0.0:1746066736.962014:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982582784 00000100:00100000:0.0:1746066736.962976:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14296 00000100:00100000:0.0:1746066736.962984:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:2013:x1830882982582784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066736.962993:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066736.963002:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa1a00/0xf1867c21abfa3718 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf2d0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066736.963029:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984185600:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066736.963082:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066736.972489:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.976996:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.977040:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982583040 00000100:00100000:0.0:1746066736.977046:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982583040 00002000:00100000:0.0:1746066736.977084:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2965504->3145727) req@ffff8800a4d09500 x1830882982583040/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:142/0 lens 488/0 e 0 to 0 dl 1746066747 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066736.977093:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d09500 with x1830882982583040 ext(2965504->3145727) 00010000:00010000:0.0:1746066736.977099:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa36fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf2b4 expref: 13 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066736.977112:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa36fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf2b4 expref: 13 pid: 12233 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746066736.977118:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d09500 00000100:00100000:0.0:1746066736.977145:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 700 00000100:00100000:0.0:1746066736.977152:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982583040:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066736.985287:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066736.992006:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.005821:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.008108:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.017655:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.029208:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.033304:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982584320 00000100:00100000:0.0:1746066737.033314:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982584320 00002000:00100000:0.0:1746066737.033378:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095dd5c00 x1830882982584320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.033389:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5c00 with x1830882982584320 ext(3145728->4194303) 00002000:00010000:0.0:1746066737.033395:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd5c00 00000100:00100000:0.0:1746066737.033417:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3449 00000100:00100000:0.0:1746066737.033425:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882982584320:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.046734:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.046758:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982584448 00000100:00100000:0.0:1746066737.046765:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982584448 00000100:00100000:0.0:1746066737.046797:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15987 00000100:00100000:0.0:1746066737.046808:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:32282:x1830882982584448:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066737.046826:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.046854:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa372d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf2e5 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.046915:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa3734 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.046926:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa3734 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.046936:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa3734 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.046945:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa373b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.046951:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa373b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.046956:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa373b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.047009:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa3742 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.047018:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009718ca00/0xf1867c21abfa361c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1e9 expref: 44 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.047025:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa365b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf21a expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.047031:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa3742 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 16 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.047054:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa365b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf21a expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.047063:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa365b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf21a expref: 31 pid: 7243 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.047073:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984186240:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.047976:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009718ca00/0xf1867c21abfa361c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1e9 expref: 44 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.047986:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009718ca00/0xf1867c21abfa361c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf1e9 expref: 44 pid: 7243 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.047999:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984186368:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.048027:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.053063:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.053205:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882982584320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19779us (19968us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066737.053215:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3449 00002000:00100000:0.0:1746066737.053227:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095dd5c00 x1830882982584320/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/440 e 0 to 0 dl 1746066748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.053236:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5c00 with x1830882982584320 ext(3145728->4194303) 00002000:00010000:0.0:1746066737.053241:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd5c00 00000100:00100000:0.0:1746066737.053297:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.057135:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.057181:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.057223:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.058247:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.058262:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982585344 00000100:00100000:0.0:1746066737.058265:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982585344 00000100:00100000:0.0:1746066737.059937:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14301 00000100:00100000:0.0:1746066737.059947:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982585344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.059965:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.059979:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa3757 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf2fa expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.059996:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.059999:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.060008:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa3757 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf2fa expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.060020:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa3757 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf2fa expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.060030:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895800, rc 0) 00000100:00100000:0.0:1746066737.060058:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882982585344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 113us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.060063:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14301 00000100:00100000:0.0:1746066737.060768:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.062942:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.062956:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.062979:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.062993:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.063007:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.063030:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.068863:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.077482:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.078954:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.080668:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.082059:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.088873:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.089026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.089077:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.090129:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.090147:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982588032 00000100:00100000:0.0:1746066737.090151:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982588032 00000100:00100000:0.0:1746066737.090175:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15989 00000100:00100000:0.0:1746066737.090180:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:32287:x1830882982588032:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066737.090199:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.090211:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa37b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf34e expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.091990:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa37c0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.092005:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa37c0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.092015:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa37c0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066737.092066:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066737.092177:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa37b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf34e expref: 35 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.092195:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa37c0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf34e expref: 34 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.092201:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066737.092203:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066737.092205:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894000, rc 0) 00000100:00100000:0.0:1746066737.092242:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:32287:x1830882982588032:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2061us (2113us total) trans 8589936261 rc 0/0 00000100:00100000:0.0:1746066737.092249:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15989 00000100:00100000:0.0:1746066737.097919:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.097944:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.098095:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.098548:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.099468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.100383:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3452 00000100:00100000:0.0:1746066737.100391:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882982589184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.109349:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.109382:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982590080 00000100:00100000:0.0:1746066737.109391:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982590080 00000100:00100000:0.0:1746066737.109441:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15990 00000100:00100000:0.0:1746066737.109449:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:32282:x1830882982590080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066737.109479:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.109482:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746066737.109511:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428400/0xf1867c21abfa379d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf339 expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.109531:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066737.109536:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066737.109547:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa37f1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf378 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.109643:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.109656:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa37c0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf34e expref: 33 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.109663:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.109694:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa37c0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf34e expref: 33 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.109704:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894000/0xf1867c21abfa37c0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf34e expref: 33 pid: 17253 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.109716:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984188800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.109792:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.109925:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.109938:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.109953:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982589568 00000100:00100000:0.0:1746066737.109956:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982589568 00010000:00010000:0.0:1746066737.109975:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009575a800/0xf1867c21abfa375e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf301 expref: 25 pid: 12233 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.109991:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982589824 00000100:00100000:0.0:1746066737.109993:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982589824 00010000:00010000:0.0:1746066737.110001:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009575b200/0xf1867c21abfa3726 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf2de expref: 55 pid: 12233 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.110014:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6305 00000100:00100000:0.0:1746066737.110019:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882982589568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.110028:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.110044:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009575a800/0xf1867c21abfa375e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf301 expref: 25 pid: 12233 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.110052:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009575a800/0xf1867c21abfa375e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf301 expref: 25 pid: 12233 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.110066:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.110084:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882982589568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 64us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.110090:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6305 00000100:00100000:0.0:1746066737.110103:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6306 00000100:00100000:0.0:1746066737.110107:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882982589824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.110113:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.110118:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009575b200/0xf1867c21abfa3726 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf2de expref: 55 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.110124:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009575b200/0xf1867c21abfa3726 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf2de expref: 55 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.110135:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.110146:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882982589824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 39us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.110151:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6306 00000100:00100000:0.0:1746066737.110183:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.110193:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982589696 00000100:00100000:0.0:1746066737.110195:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982589696 00010000:00010000:0.0:1746066737.110207:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa3781 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf32b expref: 16 pid: 12237 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.110221:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6307 00000100:00100000:0.0:1746066737.110225:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982589696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.110231:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.110987:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa3781 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf32b expref: 16 pid: 12237 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.110996:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa3781 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf32b expref: 16 pid: 12237 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.111007:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa3781 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf32b expref: 16 pid: 12237 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.111015:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.111017:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.111023:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0b400/0xf1867c21abfa37ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf371 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.111030:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0b400/0xf1867c21abfa37ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf371 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.111051:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0b400/0xf1867c21abfa37ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf371 expref: 52 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066737.111060:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984188928:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066737.114702:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.115049:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984188800:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.115068:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115747:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115754:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115771:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115776:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115782:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115787:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066737.115790:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115796:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115805:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066737.115808:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066737.115811:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115815:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa37f8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066737.115860:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa37f1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf378 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.115872:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa37f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf378 expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.115879:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894600, rc 0) 00000100:00100000:0.0:1746066737.115916:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:32282:x1830882982590080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6467us (6578us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066737.115922:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15990 00000100:00100000:0.0:1746066737.115949:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984188928:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066737.115957:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.115971:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982589696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5745us (5788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.115977:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6307 00000100:00100000:0.0:1746066737.118009:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.118037:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.118098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.121730:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.121819:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.121904:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.123866:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.124875:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.125104:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.125615:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.125640:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.126053:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6311 00000100:00100000:0.0:1746066737.126060:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982592000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.126068:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.126079:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfa37dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf35c expref: 11 pid: 20361 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.126092:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfa37dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf35c expref: 11 pid: 20361 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.126111:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2000/0xf1867c21abfa37dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf35c expref: 11 pid: 20361 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.126126:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.126141:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982592000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.126147:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6311 00000100:00100000:0.0:1746066737.131511:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.135538:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.141085:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3456 00000100:00100000:0.0:1746066737.141095:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982592896:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066737.141242:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982592896:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 149us (531us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066737.141248:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3456 00002000:00100000:0.0:1746066737.141252:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (282624->286719) req@ffff8800a5d7df80 x1830882982592896/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/4536 e 0 to 0 dl 1746066748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.141258:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7df80 with x1830882982592896 ext(282624->286719) 00002000:00010000:0.0:1746066737.141260:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7df80 00000100:00100000:0.0:1746066737.143735:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.156478:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.156535:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.169161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.181426:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.186553:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.194290:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.204409:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.205036:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.221411:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982594560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16150us (16999us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066737.221422:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3459 00002000:00100000:0.0:1746066737.221433:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012e3e5180 x1830882982594560/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/440 e 0 to 0 dl 1746066748 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.221442:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e3e5180 with x1830882982594560 ext(2097152->4194303) 00002000:00010000:0.0:1746066737.221448:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e3e5180 00000100:00100000:0.0:1746066737.221695:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982594816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15080us (16659us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066737.221702:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3460 00002000:00100000:0.0:1746066737.221708:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012e3e6300 x1830882982594816/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/440 e 0 to 0 dl 1746066748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.221714:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e3e6300 with x1830882982594816 ext(3145728->4194303) 00002000:00010000:0.0:1746066737.221717:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e3e6300 00000100:00100000:0.0:1746066737.229514:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.252489:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.263124:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.263228:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.264404:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.275488:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.278847:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.279244:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.283980:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.284012:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982596352 00000100:00100000:0.0:1746066737.284017:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982596352 00002000:00100000:0.0:1746066737.284050:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (65536->286719) req@ffff88012e3e5c00 x1830882982596352/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.284060:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e3e5c00 with x1830882982596352 ext(65536->286719) 00010000:00010000:0.0:1746066737.284067:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0a600/0xf1867c21abfa380d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->286719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf38d expref: 16 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.284078:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0a600/0xf1867c21abfa380d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 65536->286719) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf38d expref: 16 pid: 12233 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746066737.284084:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e3e5c00 00000100:00100000:0.0:1746066737.284106:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 706 00000100:00100000:0.0:1746066737.284112:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882982596352:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066737.288552:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.293520:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.293548:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982596480 00000100:00100000:0.0:1746066737.293557:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982596480 00010000:00010000:0.0:1746066737.293592:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa377a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf31d expref: 10 pid: 13363 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.293624:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6315 00000100:00100000:0.0:1746066737.293630:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982596480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.293645:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.293663:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa377a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf31d expref: 10 pid: 13363 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.293679:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa377a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf31d expref: 10 pid: 13363 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.293704:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa377a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf31d expref: 10 pid: 13363 timeout: 805 lvb_type: 1 00010000:00010000:0.0:1746066737.293726:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.293766:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982596480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (5229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.293772:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6315 00000100:00100000:0.0:1746066737.293810:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6316 00000100:00100000:0.0:1746066737.293813:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982596608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.293819:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.293824:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfa369a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf252 expref: 20 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.293844:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfa369a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf252 expref: 20 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.293859:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1800/0xf1867c21abfa369a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf252 expref: 20 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.293866:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.293877:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982596608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.293897:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6316 00000100:00100000:0.0:1746066737.294684:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.312606:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.316541:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.323817:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.323873:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.323910:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.323935:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982597376 00000100:00100000:0.0:1746066737.323943:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982597376 00002000:00100000:0.0:1746066737.323986:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1781760->1785855) req@ffff8800967a9180 x1830882982597376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.323996:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9180 with x1830882982597376 ext(1781760->1785855) 00002000:00010000:0.0:1746066737.324001:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a9180 00000100:00100000:0.0:1746066737.325346:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982597888 00000100:00100000:0.0:1746066737.325351:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982597888 00002000:00100000:0.0:1746066737.325371:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800958a5880 x1830882982597888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.325380:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5880 with x1830882982597888 ext(1048576->2097151) 00002000:00010000:0.0:1746066737.325383:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5880 00000100:00100000:0.0:1746066737.325744:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982598144 00000100:00100000:0.0:1746066737.325747:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982598144 00002000:00100000:0.0:1746066737.325760:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1437695) req@ffff88012ce04700 x1830882982598144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.325766:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04700 with x1830882982598144 ext(1048576->1437695) 00002000:00010000:0.0:1746066737.325769:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce04700 00000100:00100000:0.0:1746066737.325779:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3466 00000100:00100000:0.0:1746066737.325783:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882982598144:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066737.349278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.349389:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.353033:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.357026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.360372:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.360408:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.360430:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982598912 00000100:00100000:0.0:1746066737.360437:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982598912 00000100:00100000:0.0:1746066737.360468:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982599040 00000100:00100000:0.0:1746066737.360470:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982599040 00000100:00100000:0.0:1746066737.360485:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14329 00000100:00100000:0.0:1746066737.360492:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982598912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.360508:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.360523:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095dd0000/0xf1867c21abfa387d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf3e1 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.360543:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.360544:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.360551:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095dd0000/0xf1867c21abfa387d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3e1 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.360565:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095dd0000/0xf1867c21abfa387d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3e1 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.360576:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095dd0000, rc 0) 00000100:00100000:0.0:1746066737.360607:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982598912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 116us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.360614:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14329 00000100:00100000:0.0:1746066737.360628:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14330 00000100:00100000:0.0:1746066737.360632:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982599040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.360637:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.360643:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095dd0c00/0xf1867c21abfa3884 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf3e8 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066737.360672:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984191616:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066737.360711:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.361311:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.364175:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.366953:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.367253:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.386225:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.397851:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.403139:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982600832 00000100:00100000:0.0:1746066737.403144:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982600832 00002000:00100000:0.0:1746066737.403166:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3706880->3710975) req@ffff88009d8c9c00 x1830882982600832/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.403179:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9c00 with x1830882982600832 ext(3706880->3710975) 00002000:00010000:0.0:1746066737.403183:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9c00 00000100:00100000:0.0:1746066737.403207:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3471 00000100:00100000:0.0:1746066737.403214:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982600832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.403333:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982600832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 117us (553us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066737.403338:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3471 00002000:00100000:0.0:1746066737.403344:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3706880->3710975) req@ffff88009d8c9c00 x1830882982600832/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/4536 e 0 to 0 dl 1746066748 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.403350:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9c00 with x1830882982600832 ext(3706880->3710975) 00002000:00010000:0.0:1746066737.403353:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9c00 00000100:00100000:0.0:1746066737.418640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.422987:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.427484:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.430449:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.430479:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982601472 00000100:00100000:0.0:1746066737.430486:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982601472 00002000:00100000:0.0:1746066737.430518:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88009c7ffb80 x1830882982601472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.430527:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ffb80 with x1830882982601472 ext(2097152->3145727) 00002000:00010000:0.0:1746066737.430532:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ffb80 00000100:00100000:0.0:1746066737.430562:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3472 00000100:00100000:0.0:1746066737.430568:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+57:2016:x1830882982601472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.444638:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.455216:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.455443:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+57:2016:x1830882982601472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24873us (24997us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066737.455454:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3472 00002000:00100000:0.0:1746066737.455466:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88009c7ffb80 x1830882982601472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/440 e 0 to 0 dl 1746066748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.455475:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ffb80 with x1830882982601472 ext(2097152->3145727) 00002000:00010000:0.0:1746066737.455481:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ffb80 00000100:00100000:0.0:1746066737.458915:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982601984 00000100:00100000:0.0:1746066737.458924:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982601984 00000100:00100000:0.0:1746066737.458969:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5764 00000100:00100000:0.0:1746066737.458976:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+36:30847:x1830882982601984:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066737.459183:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+37:30847:x1830882982601984:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 206us (573us total) trans 8589936267 rc 0/0 00000100:00100000:0.0:1746066737.459189:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5764 00000100:00100000:0.0:1746066737.459675:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.462256:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982602368 00000100:00100000:0.0:1746066737.462261:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982602368 00000100:00100000:0.0:1746066737.462295:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14335 00000100:00100000:0.0:1746066737.462302:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+27:32299:x1830882982602368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.462316:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.462334:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf412 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.462363:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa3892 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3710975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3f6 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.462370:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066737.462372:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066737.462376:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.462397:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa3892 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3710975) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3f6 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.462405:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa3892 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3710975) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3f6 expref: 19 pid: 20361 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.462414:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984193024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.462449:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.468043:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.469286:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984193024:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.469317:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.469338:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83c00, rc 0) 00000100:00100000:0.0:1746066737.470300:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+28:32299:x1830882982602368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7998us (8153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.470307:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14335 00000100:00100000:0.0:1746066737.479015:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982602880:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8514us (8659us total) trans 21474841534 rc 0/0 00000100:00100000:0.0:1746066737.479025:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 709 00002000:00100000:0.0:1746066737.479034:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3710975) req@ffff880095dd5f80 x1830882982602880/t21474841534(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/448 e 0 to 0 dl 1746066748 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.479043:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5f80 with x1830882982602880 ext(3145728->3710975) 00010000:00010000:0.0:1746066737.479051:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa3892 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3f6 expref: 20 pid: 20361 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.479062:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa3892 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3f6 expref: 20 pid: 20361 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746066737.479067:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd5f80 00000100:00100000:0.0:1746066737.479354:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982603136 00000100:00100000:0.0:1746066737.479359:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982603136 00000100:00100000:0.0:1746066737.479394:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14336 00000100:00100000:0.0:1746066737.479400:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+20:32304:x1830882982603136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.479413:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.479423:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa38ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf419 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.479533:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066737.479535:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066737.479540:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa38ca lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf419 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.479549:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa38ca lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf419 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.479557:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82c00, rc 0) 00000100:00100000:0.0:1746066737.479655:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+21:32304:x1830882982603136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 255us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.479660:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14336 00000100:00100000:0.0:1746066737.481798:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.481849:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.481876:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.481922:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.481934:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.481952:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982603392 00000100:00100000:0.0:1746066737.481959:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982603392 00000100:00100000:0.0:1746066737.481988:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982603520 00000100:00100000:0.0:1746066737.481990:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982603520 00000100:00100000:0.0:1746066737.481999:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982603648 00000100:00100000:0.0:1746066737.482000:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982603648 00000100:00100000:0.0:1746066737.482008:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982603776 00000100:00100000:0.0:1746066737.482010:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982603776 00000100:00100000:0.0:1746066737.482020:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14337 00000100:00100000:0.0:1746066737.482027:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982603392:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066737.482042:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.482056:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfa38d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf420 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.482074:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482076:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482084:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfa38d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf420 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482103:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfa38d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf420 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482112:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83000, rc 0) 00000100:00100000:0.0:1746066737.482144:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982603392:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.482150:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14337 00000100:00100000:0.0:1746066737.482162:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14338 00000100:00100000:0.0:1746066737.482166:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982603520:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066737.482171:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.482179:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82e00/0xf1867c21abfa38d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf427 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.482188:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482189:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482193:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82e00/0xf1867c21abfa38d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf427 expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482202:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82e00/0xf1867c21abfa38d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf427 expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482209:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82e00, rc 0) 00000100:00100000:0.0:1746066737.482220:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982603520:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 55us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.482225:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14338 00000100:00100000:0.0:1746066737.482232:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14339 00000100:00100000:0.0:1746066737.482236:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982603648:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066737.482240:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.482245:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82400/0xf1867c21abfa38df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf42e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.482253:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482254:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482257:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82400/0xf1867c21abfa38df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf42e expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482265:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82400/0xf1867c21abfa38df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf42e expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482270:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82400, rc 0) 00000100:00100000:0.0:1746066737.482280:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982603648:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 44us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.482284:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14339 00000100:00100000:0.0:1746066737.482290:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14340 00000100:00100000:0.0:1746066737.482294:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982603776:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066737.482298:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.482303:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83e00/0xf1867c21abfa38e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf435 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066737.482335:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984193152:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066737.482388:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.482431:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.482444:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982603904 00000100:00100000:0.0:1746066737.482447:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982603904 00000100:00100000:0.0:1746066737.482462:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14341 00000100:00100000:0.0:1746066737.482466:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882982603904:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066737.482472:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.482478:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa38ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf43c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.482489:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482490:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.482494:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa38ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf43c expref: 17 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482502:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83a00/0xf1867c21abfa38ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf43c expref: 17 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.482508:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e83a00, rc 0) 00000100:00100000:0.0:1746066737.482521:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882982603904:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 56us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.482526:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14341 00000100:00100000:0.0:1746066737.489403:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.489426:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982604416 00000100:00100000:0.0:1746066737.489430:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982604416 00002000:00100000:0.0:1746066737.489739:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88006e211c00 x1830882982604416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.489748:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211c00 with x1830882982604416 ext(2097152->3145727) 00002000:00010000:0.0:1746066737.489753:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211c00 00000100:00100000:0.0:1746066737.489770:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3474 00000100:00100000:0.0:1746066737.489776:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982604416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.493260:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3476 00000100:00100000:0.0:1746066737.493268:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982604928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.509347:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.509858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.516553:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.520183:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.520218:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.520247:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.520261:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.520287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.520312:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.520334:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982605824 00000100:00100000:0.0:1746066737.520343:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982605824 00000100:00100000:0.0:1746066737.520376:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982606080 00000100:00100000:0.0:1746066737.520378:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982606080 00000100:00100000:0.0:1746066737.520390:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982606336 00000100:00100000:0.0:1746066737.520392:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982606336 00000100:00100000:0.0:1746066737.520400:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982605952 00000100:00100000:0.0:1746066737.520401:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982605952 00000100:00100000:0.0:1746066737.520408:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982606208 00000100:00100000:0.0:1746066737.520410:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982606208 00000100:00100000:0.0:1746066737.520417:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982606464 00000100:00100000:0.0:1746066737.520418:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982606464 00000100:00100000:0.0:1746066737.520429:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14345 00000100:00100000:0.0:1746066737.520436:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982605824:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066737.520479:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfa3933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520496:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc200/0xf1867c21abfa3868 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3cc expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520503:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfa38d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf420 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520510:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095dd0000/0xf1867c21abfa387d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3e1 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520517:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.520518:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.520521:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfa3933 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520550:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095dd0000/0xf1867c21abfa387d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3e1 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520562:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095dd0000/0xf1867c21abfa387d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3e1 expref: 19 pid: 12255 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.520576:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984193664:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.520666:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfa38d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf420 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520674:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83000/0xf1867c21abfa38d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf420 expref: 14 pid: 12233 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.520686:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea26a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984193792:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.520710:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc200/0xf1867c21abfa3868 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3cc expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520717:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc200/0xf1867c21abfa3868 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf3cc expref: 28 pid: 12255 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.520724:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea26680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984193920:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.520739:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362c3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.520760:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14346 00000100:00100000:0.0:1746066737.520766:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982606080:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066737.520784:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6600/0xf1867c21abfa393a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520795:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa364d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf213 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520802:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa3773 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf316 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520809:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992800/0xf1867c21abfa367e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf22f expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520813:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.520815:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.520817:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6600/0xf1867c21abfa393a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520840:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5992800/0xf1867c21abfa367e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf22f expref: 7 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520848:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992800/0xf1867c21abfa367e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf22f expref: 7 pid: 9592 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.520858:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984194048:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.520906:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa3773 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf316 expref: 12 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.520914:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa3773 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf316 expref: 12 pid: 12237 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.520922:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984194176:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.520959:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa364d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf213 expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.520966:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa364d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf213 expref: 26 pid: 12255 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.520973:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984194304:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.520985:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801362c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.521001:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14347 00000100:00100000:0.0:1746066737.521005:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982606336:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066737.521020:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfa3941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.521028:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.521034:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa3910 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf451 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.521041:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa38ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf419 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.521046:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.521047:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.521049:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfa3941 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.521064:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa38ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf419 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.521071:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82c00/0xf1867c21abfa38ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf419 expref: 19 pid: 13363 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.521078:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984194432:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.521096:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa3910 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf451 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.521103:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa3910 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf451 expref: 14 pid: 12233 timeout: 805 lvb_type: 1 00000100:00100000:0.0:1746066737.521109:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984194560:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066737.521122:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.521127:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 28 pid: 13363 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.521133:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984194688:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.521142:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.531176:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.531222:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.531262:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982606720 00000100:00100000:0.0:1746066737.531271:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982606720 00002000:00100000:0.0:1746066737.531317:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012ea25f80 x1830882982606720/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.531327:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25f80 with x1830882982606720 ext(2097152->4194303) 00010000:00010000:0.0:1746066737.531335:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa3909 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf44a expref: 8 pid: 12233 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.531347:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa3909 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf44a expref: 8 pid: 12233 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746066737.531357:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ea25f80 00000100:00100000:0.0:1746066737.531373:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982606976 00000100:00100000:0.0:1746066737.531375:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982606976 00002000:00100000:0.0:1746066737.531387:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ea27100 x1830882982606976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.531393:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea27100 with x1830882982606976 ext(4194304->5033983) 00010000:00010000:0.0:1746066737.531401:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 29 pid: 13363 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.531408:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 29 pid: 13363 timeout: 805 lvb_type: 0 00002000:00010000:0.0:1746066737.531413:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea27100 00000100:00100000:0.0:1746066737.531422:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 710 00000100:00100000:0.0:1746066737.531429:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882982606720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.541759:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984194432:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.541784:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984194560:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.574685:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.574739:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.574780:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.574849:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6344 00000100:00100000:0.0:1746066737.574858:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982609280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.574873:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.574916:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 27 pid: 13363 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.575614:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 29 pid: 13363 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.576202:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e83c00/0xf1867c21abfa38c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf412 expref: 29 pid: 13363 timeout: 805 lvb_type: 0 00010000:00010000:0.0:1746066737.576218:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.576220:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.576224:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfa3941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.576231:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfa3941 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.576265:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.576290:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982609280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1434us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.576297:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6344 00000100:00100000:0.0:1746066737.576411:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982609792 00000100:00100000:0.0:1746066737.576414:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982609792 00000100:00100000:0.0:1746066737.576439:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15996 00000100:00100000:0.0:1746066737.576443:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:32308:x1830882982609792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066737.576456:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.576466:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa396b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf46d expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.576561:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa3972 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.576573:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfa391e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf458 expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.576578:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa3972 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066737.576596:0:10125:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfa391e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf458 expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.576606:0:10125:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356ac00/0xf1867c21abfa391e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf458 expref: 23 pid: 17253 timeout: 805 lvb_type: 0 00000100:00100000:0.0:1746066737.576614:0:10125:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea26300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10125:1830882984196096:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066737.576633:0:10125:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.578573:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.581079:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.581481:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.581496:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.581536:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.581551:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982610304 00000100:00100000:0.0:1746066737.581553:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982610304 00000100:00100000:0.0:1746066737.581571:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982610432 00000100:00100000:0.0:1746066737.581572:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982610432 00000100:00100000:0.0:1746066737.581584:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982610560 00000100:00100000:0.0:1746066737.581585:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982610560 00000100:00100000:0.0:1746066737.581598:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14353 00000100:00100000:0.0:1746066737.581604:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982610304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.581620:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.581635:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0c400/0xf1867c21abfa3979 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf47b expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066737.581656:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd32, atime: 0x6812dd32, ctime: 0x6812dd32, blocks: 0x7b0 00010000:00010000:0.0:1746066737.581670:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.581672:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.581678:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c400/0xf1867c21abfa3979 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf47b expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.581691:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c400/0xf1867c21abfa3979 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf47b expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.581699:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c400, rc 0) 00000100:00100000:0.0:1746066737.581717:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882982610304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.581722:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14353 00000100:00100000:0.0:1746066737.581732:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14354 00000100:00100000:0.0:1746066737.581736:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982610432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.581742:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.581753:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0c600/0xf1867c21abfa3980 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf482 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066737.581766:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd32, atime: 0x6812dd31, ctime: 0x6812dd31, blocks: 0x808 00010000:00010000:0.0:1746066737.581774:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.581776:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.581779:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c600/0xf1867c21abfa3980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf482 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.581787:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c600/0xf1867c21abfa3980 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf482 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.581793:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c600, rc 0) 00000100:00100000:0.0:1746066737.581806:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882982610432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.581810:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14354 00000100:00100000:0.0:1746066737.581818:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14355 00000100:00100000:0.0:1746066737.581822:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882982610560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066737.581826:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066737.581845:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0ce00/0xf1867c21abfa3987 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf489 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066737.581854:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd31, atime: 0x6812dd31, ctime: 0x6812dd31, blocks: 0x800 00010000:00010000:0.0:1746066737.581861:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.581862:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.581866:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0ce00/0xf1867c21abfa3987 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf489 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.581873:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0ce00/0xf1867c21abfa3987 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf489 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066737.581878:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0ce00, rc 0) 00000100:00100000:0.0:1746066737.581911:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882982610560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.581915:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14355 00000100:00100000:0.0:1746066737.585858:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.585912:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.587436:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982611072 00000100:00100000:0.0:1746066737.587439:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982611072 00002000:00100000:0.0:1746066737.587462:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095803480 x1830882982611072/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.587470:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803480 with x1830882982611072 ext(3145728->4194303) 00002000:00010000:0.0:1746066737.587475:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095803480 00000100:00100000:0.0:1746066737.587485:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3477 00000100:00100000:0.0:1746066737.587489:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982611072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.589979:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.591743:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.597631:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982612096 00000100:00100000:0.0:1746066737.597641:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982612096 00000100:00100000:0.0:1746066737.597695:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5767 00000100:00100000:0.0:1746066737.597702:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:32306:x1830882982612096:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746066737.598045:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d653450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:32306:x1830882982612096:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 342us (615us total) trans 8589936273 rc 0/0 00000100:00100000:0.0:1746066737.598051:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5767 00000100:00100000:0.0:1746066737.611575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.617078:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.643771:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.643810:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.643865:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.645379:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.648684:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.738559:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.745493:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.747905:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.750874:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.763439:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.770822:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.774546:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.776359:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.778573:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.780725:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.790535:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.795354:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.803583:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.829622:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.844401:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.864805:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.867180:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.878187:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982616320:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9856us (11000us total) trans 17179874122 rc 0/0 00000100:00100000:0.0:1746066737.878200:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 713 00002000:00100000:0.0:1746066737.878213:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1167360->2047999) req@ffff8800958afb80 x1830882982616320/t17179874122(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/448 e 0 to 0 dl 1746066748 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.878222:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882982616320 ext(1167360->2047999) 00010000:00010000:0.0:1746066737.878233:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82a00/0xf1867c21abfa39e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf4d6 expref: 9 pid: 1893 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746066737.878250:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82a00/0xf1867c21abfa39e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf4d6 expref: 9 pid: 1893 timeout: 806 lvb_type: 0 00002000:00010000:0.0:1746066737.878258:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958afb80 00000100:00100000:0.0:1746066737.880242:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.897037:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.904170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.904216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.920521:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.935572:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.937660:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.938594:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882982617216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 32064us (34374us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066737.938604:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3488 00002000:00100000:0.0:1746066737.938615:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880098fb4a80 x1830882982617216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:143/0 lens 488/440 e 0 to 0 dl 1746066748 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.938624:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4a80 with x1830882982617216 ext(1048576->2097151) 00002000:00010000:0.0:1746066737.938630:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb4a80 00000100:00100000:0.0:1746066737.944549:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.948582:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.948611:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.948653:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982617856 00000100:00100000:0.0:1746066737.948660:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982617856 00010000:00010000:0.0:1746066737.948692:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5770600/0xf1867c21abfa3995 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf490 expref: 31 pid: 3528 timeout: 806 lvb_type: 1 00000100:00100000:0.0:1746066737.948718:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982617984 00000100:00100000:0.0:1746066737.948720:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982617984 00010000:00010000:0.0:1746066737.948728:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5770200/0xf1867c21abfa39b8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf4ba expref: 19 pid: 12233 timeout: 806 lvb_type: 1 00000100:00100000:0.0:1746066737.948740:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6355 00000100:00100000:0.0:1746066737.948746:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982617856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.948760:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.948779:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5770600/0xf1867c21abfa3995 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf490 expref: 31 pid: 3528 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746066737.948790:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5770600/0xf1867c21abfa3995 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf490 expref: 31 pid: 3528 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746066737.948818:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066737.948898:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982617856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066737.948904:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6355 00000100:00100000:0.0:1746066737.948917:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6356 00000100:00100000:0.0:1746066737.948920:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982617984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066737.948926:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066737.948932:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5770200/0xf1867c21abfa39b8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf4ba expref: 19 pid: 12233 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746066737.948945:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5770200/0xf1867c21abfa39b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf4ba expref: 19 pid: 12233 timeout: 806 lvb_type: 1 00010000:00010000:0.0:1746066737.948955:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.948957:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066737.948963:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629aa00/0xf1867c21abfa3a13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2027520->2039807) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf500 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.948970:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629aa00/0xf1867c21abfa3a13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2027520->2039807) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf500 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066737.948998:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009629aa00/0xf1867c21abfa3a13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2027520->2039807) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf500 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066737.949009:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984198272:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066737.949063:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066737.952753:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.952789:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.952812:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.953315:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.965002:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.969750:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.978634:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.978664:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.978692:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.978806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066737.978845:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982619520 00000100:00100000:0.0:1746066737.978853:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982619520 00002000:00100000:0.0:1746066737.978904:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880096e6a300 x1830882982619520/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.978912:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6a300 with x1830882982619520 ext(0->1048575) 00002000:00010000:0.0:1746066737.978917:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e6a300 00000100:00100000:0.0:1746066737.979908:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982619776 00000100:00100000:0.0:1746066737.979912:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982619776 00002000:00100000:0.0:1746066737.979938:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096e69880 x1830882982619776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:143/0 lens 488/0 e 0 to 0 dl 1746066748 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066737.979945:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69880 with x1830882982619776 ext(1048576->2097151) 00002000:00010000:0.0:1746066737.979947:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e69880 00000100:00100000:0.0:1746066737.979963:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3489 00000100:00100000:0.0:1746066737.979969:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982619520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066737.992262:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.017182:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.028053:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.028083:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.028105:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.029358:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3494 00000100:00100000:0.0:1746066738.029371:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982621056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066738.056935:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.058793:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.075760:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.083417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.087595:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.104134:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.104475:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.106850:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.108919:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.110673:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.112363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.114033:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.126688:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.131636:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982624000 00000100:00100000:0.0:1746066738.131651:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982624000 00002000:00100000:0.0:1746066738.131701:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1662976->1667071) req@ffff880095801f80 x1830882982624000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:144/0 lens 488/0 e 0 to 0 dl 1746066749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066738.131711:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882982624000 ext(1662976->1667071) 00002000:00010000:0.0:1746066738.131716:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801f80 00000100:00100000:0.0:1746066738.131748:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3499 00000100:00100000:0.0:1746066738.131755:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982624000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066738.131952:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982624000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 196us (1899us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066738.131959:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3499 00002000:00100000:0.0:1746066738.131964:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1662976->1667071) req@ffff880095801f80 x1830882982624000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:144/0 lens 488/4536 e 0 to 0 dl 1746066749 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066738.131971:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882982624000 ext(1662976->1667071) 00002000:00010000:0.0:1746066738.131973:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801f80 00000100:00100000:0.0:1746066738.136157:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.150595:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 719 00000100:00100000:0.0:1746066738.150609:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982624256:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066738.194059:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.194121:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.201680:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.201734:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.204897:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.223760:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882982624896:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 21759us (22092us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066738.223768:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3500 00002000:00100000:0.0:1746066738.223774:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095ce0e00 x1830882982624896/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:144/0 lens 488/440 e 0 to 0 dl 1746066749 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066738.223782:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0e00 with x1830882982624896 ext(2097152->4194303) 00002000:00010000:0.0:1746066738.223785:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce0e00 00000100:00100000:0.0:1746066738.230571:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.232725:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.235023:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.238740:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.243044:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.244507:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982626176 00000100:00100000:0.0:1746066738.244513:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982626176 00002000:00100000:0.0:1746066738.244549:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009d9b2d80 x1830882982626176/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:144/0 lens 488/0 e 0 to 0 dl 1746066749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066738.244559:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2d80 with x1830882982626176 ext(4194304->5033983) 00010000:00010000:0.0:1746066738.244566:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfa3a4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf538 expref: 21 pid: 1893 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746066738.244583:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf800/0xf1867c21abfa3a4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf538 expref: 21 pid: 1893 timeout: 806 lvb_type: 0 00002000:00010000:0.0:1746066738.244590:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d9b2d80 00000100:00100000:0.0:1746066738.244604:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 721 00000100:00100000:0.0:1746066738.244609:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982626176:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066738.268266:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.268325:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.269754:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.270504:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.273696:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.277723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.283550:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.284038:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.285174:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.285197:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982627328 00000100:00100000:0.0:1746066738.285200:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982627328 00010000:00010000:0.0:1746066738.285222:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097018e00/0xf1867c21abfa3a98 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf585 expref: 31 pid: 12233 timeout: 806 lvb_type: 1 00000100:00100000:0.0:1746066738.285966:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.295727:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.297128:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.303162:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.309972:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.323673:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.327057:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.342214:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.351497:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.351545:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.388304:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.423812:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.427986:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.428770:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.432388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.435157:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.435185:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.435209:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.435245:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.435850:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982631296 00000100:00100000:0.0:1746066738.435854:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982631296 00000100:00100000:0.0:1746066738.435875:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14396 00000100:00100000:0.0:1746066738.435901:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982630912:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066738.435920:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066738.435936:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a2800/0xf1867c21abfa3ade lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf5b6 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066738.435956:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.435958:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.435967:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2800/0xf1867c21abfa3ade lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5b6 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.435981:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2800/0xf1867c21abfa3ade lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5b6 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.435992:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2800, rc 0) 00000100:00100000:0.0:1746066738.436025:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982630912:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 144us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.436030:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14396 00000100:00100000:0.0:1746066738.436043:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14397 00000100:00100000:0.0:1746066738.436047:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2014:x1830882982631040:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066738.436053:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066738.436061:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a3c00/0xf1867c21abfa3ae5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf5bd expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066738.436070:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.436072:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.436075:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a3c00/0xf1867c21abfa3ae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5bd expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.436084:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a3c00/0xf1867c21abfa3ae5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5bd expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.436090:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a3c00, rc 0) 00000100:00100000:0.0:1746066738.436100:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882982631040:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 53us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.436105:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14397 00000100:00100000:0.0:1746066738.436111:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14398 00000100:00100000:0.0:1746066738.436115:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2014:x1830882982631168:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066738.436121:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066738.436126:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa3aec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf5c4 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066738.436134:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.436135:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.436139:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa3aec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5c4 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.436146:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa3aec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5c4 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.436152:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2000, rc 0) 00000100:00100000:0.0:1746066738.436161:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882982631168:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 46us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.436165:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14398 00000100:00100000:0.0:1746066738.436287:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14399 00000100:00100000:0.0:1746066738.436291:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982631296:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066738.436295:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066738.436301:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfa3af3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf5cb expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066738.436309:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.436311:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.436314:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfa3af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5cb expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.436326:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a2400/0xf1867c21abfa3af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf5cb expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.436333:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2400, rc 0) 00000100:00100000:0.0:1746066738.436342:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982631296:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 51us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.436346:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14399 00000100:00100000:0.0:1746066738.438040:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.438608:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.446041:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.453057:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.457682:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.464231:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.508114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.523349:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.523798:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.524185:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.526048:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982633472 00000100:00100000:0.0:1746066738.526054:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982633472 00000100:00100000:0.0:1746066738.529435:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.529461:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.537717:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.537763:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.541613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.551082:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.557705:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.572140:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.578140:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.598623:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.611494:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.615128:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.625830:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982635648:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 10020us (10683us total) trans 17179874124 rc 0/0 00000100:00100000:0.0:1746066738.625844:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 727 00002000:00100000:0.0:1746066738.625858:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2351104->3579903) req@ffff8800a03d6a00 x1830882982635648/t17179874124(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:144/0 lens 504/448 e 0 to 0 dl 1746066749 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066738.625867:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6a00 with x1830882982635648 ext(2351104->3579903) 00010000:00010000:0.0:1746066738.625878:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa3aa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3477504->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf593 expref: 31 pid: 1893 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746066738.625911:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa3aa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3477504->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf593 expref: 31 pid: 1893 timeout: 806 lvb_type: 0 00002000:00010000:0.0:1746066738.625918:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d6a00 00000100:00100000:0.0:1746066738.626176:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982635904 00000100:00100000:0.0:1746066738.626184:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982635904 00000100:00100000:0.0:1746066738.626283:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14409 00000100:00100000:0.0:1746066738.626288:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982635904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066738.626294:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066738.626301:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa3b71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf626 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066738.626339:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984204416:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066738.630457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.631103:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6376 00000100:00100000:0.0:1746066738.631113:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982636032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066738.631129:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066738.631147:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa3aa6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3477504->3579903) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf593 expref: 31 pid: 1893 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746066738.631160:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa3aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3477504->3579903) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf593 expref: 31 pid: 1893 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746066738.631185:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa3aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3477504->3579903) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf593 expref: 31 pid: 1893 timeout: 806 lvb_type: 0 00010000:00010000:0.0:1746066738.631206:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.631208:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.631215:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6200/0xf1867c21abfa3b63 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf618 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066738.631224:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a6200/0xf1867c21abfa3b63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf618 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066738.631260:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800979a6200/0xf1867c21abfa3b63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf618 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066738.631271:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984204544:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066738.631355:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066738.636937:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984204544:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066738.636963:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066738.637016:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882982636032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5904us (6565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.637027:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6376 00000100:00100000:0.0:1746066738.637260:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982636288 00000100:00100000:0.0:1746066738.637266:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982636288 00002000:00100000:0.0:1746066738.637308:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d9b0380 x1830882982636288/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:144/0 lens 488/0 e 0 to 0 dl 1746066749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066738.637318:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0380 with x1830882982636288 ext(1048576->2097151) 00002000:00010000:0.0:1746066738.637322:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0380 00000100:00100000:0.0:1746066738.637340:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3513 00000100:00100000:0.0:1746066738.637346:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982636288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066738.642186:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.642231:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.673587:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.676396:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982637440 00000100:00100000:0.0:1746066738.676406:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982637440 00002000:00100000:0.0:1746066738.676449:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012bb75500 x1830882982637440/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:144/0 lens 488/0 e 0 to 0 dl 1746066749 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066738.676459:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75500 with x1830882982637440 ext(4194304->5033983) 00002000:00010000:0.0:1746066738.676465:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb75500 00000100:00100000:0.0:1746066738.676501:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3517 00000100:00100000:0.0:1746066738.676508:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982637440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066738.683213:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.694335:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.700390:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.700919:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.701343:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.703430:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.705337:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.750645:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.754650:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.755138:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.756014:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.770324:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.774197:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.775131:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.776673:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.779737:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.946308:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.946353:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.946388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.946417:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.946439:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.946468:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982640640 00000100:00100000:0.0:1746066738.946477:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982640640 00000100:00100000:0.0:1746066738.946523:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 177 00000100:00100000:0.0:1746066738.946532:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882982640640:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066738.946600:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882982640640:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.946607:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 177 00000100:00100000:0.0:1746066738.946662:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.946682:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982640768 00000100:00100000:0.0:1746066738.946685:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982640768 00000100:00100000:0.0:1746066738.946714:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982641024 00000100:00100000:0.0:1746066738.946716:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982641024 00000100:00100000:0.0:1746066738.946728:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982640896 00000100:00100000:0.0:1746066738.946729:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982640896 00000100:00100000:0.0:1746066738.946740:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 874 00000100:00100000:0.0:1746066738.946744:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882982640768:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066738.946770:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882982640768:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.946775:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 874 00000100:00100000:0.0:1746066738.946783:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 875 00000100:00100000:0.0:1746066738.946786:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882982641024:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066738.946803:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882982641024:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 16us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.946839:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 875 00000100:00100000:0.0:1746066738.946848:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 876 00000100:00100000:0.0:1746066738.946852:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882982640896:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066738.946869:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882982640896:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 17us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.946873:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 876 00000100:00080000:0.0:1746066738.947050:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066738.949526:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.963930:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.967362:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.969557:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.983507:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.984344:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.984976:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.988073:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.988275:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.992829:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.997233:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.997270:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.997284:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.997304:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.997326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.997351:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066738.997773:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982643456 00000100:00100000:0.0:1746066738.997777:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982643456 00000100:00100000:0.0:1746066738.997815:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14421 00000100:00100000:0.0:1746066738.997821:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982643200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066738.997829:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066738.997840:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfa3bf6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf68f expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066738.997854:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.997856:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066738.997864:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfa3bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf68f expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.997879:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a400/0xf1867c21abfa3bf6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf68f expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066738.997910:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a400, rc 0) 00000100:00100000:0.0:1746066738.997935:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982643200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 114us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066738.997939:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14421 00000100:00100000:0.0:1746066739.006419:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066739.007836:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746066739.008286:0:3528:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880095802300 x1830882984207488) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa3b9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf642 expref: 12 pid: 11630 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.008305:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa3b9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf642 expref: 12 pid: 11630 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.008318:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984207488:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066739.008337:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cb5200/0xf1867c21abfa3c04 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf681 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.008344:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb5200/0xf1867c21abfa3c04 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf681 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.008350:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb5200, rc 0) 00000100:00100000:0.0:1746066739.008366:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982642944:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 10255us (11061us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066739.008371:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14423 00000100:00100000:0.0:1746066739.014302:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.014592:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.016649:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.017234:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066739.018571:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066739.019444:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.020385:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.020417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.028195:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.029597:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882982644352:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11682us (12948us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066739.029605:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3524 00002000:00100000:0.0:1746066739.029615:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf7100 x1830882982644352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/440 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.029625:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7100 with x1830882982644352 ext(1048576->2097151) 00002000:00010000:0.0:1746066739.029629:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf7100 00000100:00100000:0.0:1746066739.036041:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.040155:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982645760 00000100:00100000:0.0:1746066739.040164:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982645760 00000100:00100000:0.0:1746066739.040199:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982646016 00000100:00100000:0.0:1746066739.040201:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982646016 00000100:00100000:0.0:1746066739.040214:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14427 00000100:00100000:0.0:1746066739.040219:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:32370:x1830882982645760:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066739.040232:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.040247:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa3c35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf6b9 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040270:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.040277:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3362816->4136959] (req 3362816->4136959) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040283:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066739.040287:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa3c35 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->3403775] (req 3145728->3403775) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b9 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040317:0:3528:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3362816->4136959] (req 3362816->4136959) gid 0 flags: 0x60000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040330:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa3c35 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->3403775] (req 3145728->3403775) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b9 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040340:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a000, rc 0) 00000100:00100000:0.0:1746066739.040799:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:32370:x1830882982645760:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 578us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.040812:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14427 00000100:00100000:0.0:1746066739.040827:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14428 00000100:00100000:0.0:1746066739.040831:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:32371:x1830882982646016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066739.040837:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.040844:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576bc00/0xf1867c21abfa3c4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf6c7 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040857:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa3ba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf649 expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040862:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066739.040864:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066739.040866:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576bc00/0xf1867c21abfa3c4a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6c7 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040877:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa3ba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf649 expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.040901:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa3ba2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf649 expref: 15 pid: 11630 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.040909:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984208896:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066739.040928:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.042990:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984208896:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066739.043013:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576bc00/0xf1867c21abfa3c4a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6c7 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.043025:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576bc00, rc 0) 00000100:00100000:0.0:1746066739.043059:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:32371:x1830882982646016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2226us (3107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.043066:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14428 00000100:00100000:0.0:1746066739.044640:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.044721:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.044739:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.044765:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.047073:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982646784 00000100:00100000:0.0:1746066739.047077:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982646784 00000100:00100000:0.0:1746066739.047110:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14429 00000100:00100000:0.0:1746066739.047115:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:32374:x1830882982646784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066739.047126:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.047136:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa3c51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf6ce expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.047150:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066739.047154:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa3c51 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ce expref: 17 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.047161:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa3c51 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ce expref: 17 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.047168:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b400, rc 0) 00000100:00100000:0.0:1746066739.047393:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:32374:x1830882982646784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.047398:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14429 00000100:00100000:0.0:1746066739.048154:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984209024:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066739.048169:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.048201:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882982646272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2465us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.048208:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6397 00000100:00100000:0.0:1746066739.052525:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.052563:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.052572:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.052589:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.052627:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.052644:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982647168 00000100:00100000:0.0:1746066739.052647:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982647168 00000100:00100000:0.0:1746066739.052670:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14430 00000100:00100000:0.0:1746066739.052678:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982647040:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066739.052695:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.052714:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576b200/0xf1867c21abfa3c5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf6d5 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.052734:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.052736:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.052745:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b200/0xf1867c21abfa3c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6d5 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.052758:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b200/0xf1867c21abfa3c5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6d5 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.052768:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b200, rc 0) 00000100:00100000:0.0:1746066739.053002:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982647040:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 324us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.053007:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14430 00000100:00100000:0.0:1746066739.056240:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.056264:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982647680 00000100:00100000:0.0:1746066739.056270:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982647680 00010000:00010000:0.0:1746066739.056299:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa3ba2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf649 expref: 15 pid: 11630 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.056322:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6398 00000100:00100000:0.0:1746066739.056329:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882982647680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.056343:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.056358:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa3ba2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf649 expref: 15 pid: 11630 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.056368:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa3ba2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf649 expref: 15 pid: 11630 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.056391:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.056393:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.056400:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576bc00/0xf1867c21abfa3c4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6c7 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.056408:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576bc00/0xf1867c21abfa3c4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6c7 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.056416:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.056417:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.056420:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa3c51 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ce expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.056425:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa3c51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ce expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.056454:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa3c51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ce expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.057031:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984209536:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066739.057092:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576bc00/0xf1867c21abfa3c4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6c7 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.057101:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984209664:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066739.057123:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.064488:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984209536:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066739.066341:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984209664:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066739.066366:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.066410:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882982647680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 10081us (10174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.066421:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6398 00000100:00100000:0.0:1746066739.070302:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.071430:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.071447:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982648704 00000100:00100000:0.0:1746066739.071451:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982648704 00002000:00100000:0.0:1746066739.071471:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (4132864->4136959) req@ffff880097a8a300 x1830882982648704/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.071478:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a300 with x1830882982648704 ext(4132864->4136959) 00010000:00010000:0.0:1746066739.071486:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->4136959) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 16 pid: 20361 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.071499:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->4136959) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 16 pid: 20361 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746066739.071504:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a8a300 00000100:00100000:0.0:1746066739.071523:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 732 00000100:00100000:0.0:1746066739.071529:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882982648704:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066739.071626:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882982648704:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 96us (196us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066739.071632:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 732 00002000:00100000:0.0:1746066739.071637:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (4132864->4136959) req@ffff880097a8a300 x1830882982648704/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746066750 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.071644:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a300 with x1830882982648704 ext(4132864->4136959) 00010000:00010000:0.0:1746066739.071648:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->4136959) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 16 pid: 20361 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.071656:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->4136959) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 16 pid: 20361 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746066739.071662:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a8a300 00000100:00100000:0.0:1746066739.071725:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982648448 00000100:00100000:0.0:1746066739.071728:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982648448 00000100:00100000:0.0:1746066739.071769:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16007 00000100:00100000:0.0:1746066739.071774:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+27:32375:x1830882982648448:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066739.071786:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.071811:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa3c74 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf6f1 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.071919:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071933:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071944:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071954:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071959:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071964:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071969:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094418a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066739.071972:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071978:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071987:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066739.071989:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066739.071993:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.071997:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418a00/0xf1867c21abfa3c7b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.072021:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa3c74 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6f1 expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.072026:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa3c74 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6f1 expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.072036:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418800, rc 0) 00000100:00100000:0.0:1746066739.072052:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+27:32375:x1830882982648448:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 278us (548us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066739.072057:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16007 00000100:00100000:0.0:1746066739.081220:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.081306:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.081743:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5771 00000100:00100000:0.0:1746066739.081753:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+27:32375:x1830882982648960:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746066739.104507:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+28:32375:x1830882982648960:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 22744us (23286us total) trans 8589936282 rc 0/0 00000100:00100000:0.0:1746066739.104519:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5771 00000100:00100000:0.0:1746066739.120530:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982649472:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 15755us (15879us total) trans 17179874127 rc 0/0 00000100:00100000:0.0:1746066739.120541:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 733 00002000:00100000:0.0:1746066739.120551:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3362816->4136959) req@ffff8800958aca80 x1830882982649472/t17179874127(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/448 e 0 to 0 dl 1746066750 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.120559:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aca80 with x1830882982649472 ext(3362816->4136959) 00010000:00010000:0.0:1746066739.120569:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->4136959) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 16 pid: 20361 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.120580:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f9d400/0xf1867c21abfa3c2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3362816->4136959) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6b2 expref: 16 pid: 20361 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746066739.120591:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958aca80 00000100:00100000:0.0:1746066739.121335:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.125181:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.126945:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982650112 00000100:00100000:0.0:1746066739.126950:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982650112 00010000:00010000:0.0:1746066739.126971:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfa3bfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3821568->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf69d expref: 39 pid: 12237 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.126997:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6400 00000100:00100000:0.0:1746066739.127003:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982650112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.127012:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.127026:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfa3bfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3821568->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf69d expref: 39 pid: 12237 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.127034:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfa3bfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3821568->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf69d expref: 39 pid: 12237 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.127047:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3e00/0xf1867c21abfa3bfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3821568->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf69d expref: 39 pid: 12237 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.127058:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.127059:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.127064:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098496400/0xf1867c21abfa3c82 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6f8 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.127069:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098496400/0xf1867c21abfa3c82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6f8 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.127076:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.127077:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.127081:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfa3c89 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ff expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.127086:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfa3c89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ff expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.127101:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfa3c89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ff expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.127108:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984210048:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066739.127158:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098496400/0xf1867c21abfa3c82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6f8 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.127165:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984210176:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066739.127179:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.132701:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.132781:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.132819:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982650368 00000100:00100000:0.0:1746066739.132828:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982650368 00002000:00100000:0.0:1746066739.132880:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3399680->3403775) req@ffff880098483800 x1830882982650368/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.132913:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098483800 with x1830882982650368 ext(3399680->3403775) 00002000:00010000:0.0:1746066739.132918:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098483800 00000100:00100000:0.0:1746066739.132946:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3530 00000100:00100000:0.0:1746066739.133244:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982650368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066739.133496:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982650368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 543us (804us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066739.133502:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3530 00002000:00100000:0.0:1746066739.133507:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3399680->3403775) req@ffff880098483800 x1830882982650368/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.133514:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098483800 with x1830882982650368 ext(3399680->3403775) 00002000:00010000:0.0:1746066739.133518:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098483800 00000100:00100000:0.0:1746066739.135391:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.135437:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066739.140405:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066739.157181:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.163042:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.163099:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.171929:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.183850:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982652160 00000100:00100000:0.0:1746066739.183858:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982652160 00002000:00100000:0.0:1746066739.183917:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012b167800 x1830882982652160/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.183927:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167800 with x1830882982652160 ext(2097152->4194303) 00002000:00010000:0.0:1746066739.183932:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b167800 00000100:00100000:0.0:1746066739.183945:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982652416 00000100:00100000:0.0:1746066739.183948:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982652416 00002000:00100000:0.0:1746066739.183959:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012bb76a00 x1830882982652416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.183971:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76a00 with x1830882982652416 ext(3145728->4194303) 00002000:00010000:0.0:1746066739.183974:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb76a00 00000100:00100000:0.0:1746066739.183982:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982652672 00000100:00100000:0.0:1746066739.183984:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982652672 00002000:00100000:0.0:1746066739.183992:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800b40b4700 x1830882982652672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.183999:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b4700 with x1830882982652672 ext(2097152->4194303) 00002000:00010000:0.0:1746066739.184001:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b40b4700 00000100:00100000:0.0:1746066739.184011:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3534 00000100:00100000:0.0:1746066739.184017:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982652160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066739.227716:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.236462:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.236513:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.249686:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.256363:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.289516:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.298672:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.299435:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.299450:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982654080 00000100:00100000:0.0:1746066739.299453:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982654080 00010000:00010000:0.0:1746066739.299468:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfa3c89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ff expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.299496:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6404 00000100:00100000:0.0:1746066739.299502:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982654080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.299510:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.299518:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfa3c89 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ff expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.299527:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfa3c89 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ff expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.299539:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497800/0xf1867c21abfa3c89 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf6ff expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.299556:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.299558:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.299564:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.299570:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.299601:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.299613:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea25c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984211072:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066739.299691:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.302776:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982654336 00000100:00100000:0.0:1746066739.302783:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982654336 00002000:00100000:0.0:1746066739.302840:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2215936->2220031) req@ffff8800958adf80 x1830882982654336/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.302855:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adf80 with x1830882982654336 ext(2215936->2220031) 00002000:00010000:0.0:1746066739.302860:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958adf80 00000100:00100000:0.0:1746066739.302877:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3539 00000100:00100000:0.0:1746066739.302907:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982654336:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066739.304115:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982654336:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1227us (1609us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066739.304123:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3539 00002000:00100000:0.0:1746066739.304130:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2215936->2220031) req@ffff8800958adf80 x1830882982654336/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.304138:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adf80 with x1830882982654336 ext(2215936->2220031) 00002000:00010000:0.0:1746066739.304142:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958adf80 00000100:00100000:0.0:1746066739.310438:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982654592 00000100:00100000:0.0:1746066739.310448:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982654592 00002000:00100000:0.0:1746066739.310497:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2654208->2658303) req@ffff8800958a7480 x1830882982654592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.310507:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7480 with x1830882982654592 ext(2654208->2658303) 00002000:00010000:0.0:1746066739.310513:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7480 00000100:00100000:0.0:1746066739.310683:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3540 00000100:00100000:0.0:1746066739.310691:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982654592:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066739.311159:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982654592:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 467us (812us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066739.311165:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3540 00002000:00100000:0.0:1746066739.311172:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2654208->2658303) req@ffff8800958a7480 x1830882982654592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.311179:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7480 with x1830882982654592 ext(2654208->2658303) 00002000:00010000:0.0:1746066739.311181:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7480 00000100:00100000:0.0:1746066739.406563:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.409869:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.430139:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982655488 00000100:00100000:0.0:1746066739.430149:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982655488 00000100:00100000:0.0:1746066739.430198:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16010 00000100:00100000:0.0:1746066739.430206:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:32389:x1830882982655488:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066739.430232:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.430250:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa3cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf737 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.430310:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751800/0xf1867c21abfa3ce4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430323:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751800/0xf1867c21abfa3ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430333:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751800/0xf1867c21abfa3ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430344:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa3ceb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430350:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa3ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430355:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa3ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430425:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa3cf2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430435:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3c00/0xf1867c21abfa3cac lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf71b expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.430442:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa3cc8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf729 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.430448:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa3cf2 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.430477:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa3cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf729 expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.430486:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa3cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf729 expref: 30 pid: 10125 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.430497:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984211328:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066739.430581:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3c00/0xf1867c21abfa3cac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf71b expref: 11 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.430588:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3c00/0xf1867c21abfa3cac lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf71b expref: 11 pid: 10125 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.430596:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984211456:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066739.430610:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.439702:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.439857:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882982655872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8990us (9133us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066739.439869:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 737 00002000:00100000:0.0:1746066739.439880:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800967a9f80 x1830882982655872/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/440 e 0 to 0 dl 1746066750 ref 1 fl Complete:H/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.439910:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882982655872 ext(4194304->5033983) 00010000:00010000:0.0:1746066739.439920:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 29 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.439933:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 29 pid: 3528 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746066739.439939:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9f80 00000100:00100000:0.0:1746066739.441065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.441095:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982656000 00000100:00100000:0.0:1746066739.441098:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982656000 00010000:00010000:0.0:1746066739.441119:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa3cc8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf729 expref: 31 pid: 10125 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.441139:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6405 00000100:00100000:0.0:1746066739.441143:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982656000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.441152:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.441157:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa3cc8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf729 expref: 31 pid: 10125 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.441166:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa3cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf729 expref: 31 pid: 10125 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.441190:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066739.441195:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa3cf2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.441203:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa3cf2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.441208:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa3cf2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.441213:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.441231:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982656000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.441236:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6405 00000100:00100000:0.0:1746066739.442760:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.449807:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.451572:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982656640 00000100:00100000:0.0:1746066739.451576:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982656640 00010000:00010000:0.0:1746066739.451593:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 29 pid: 3528 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.451612:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6407 00000100:00100000:0.0:1746066739.451617:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982656640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.451625:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.451642:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 29 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.451653:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fac600/0xf1867c21abfa3cba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2215936->2658303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf722 expref: 29 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.451667:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.451669:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.451673:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.451681:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.451700:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.451710:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 38 pid: 3528 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.451719:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984211840:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066739.451752:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.457478:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982657152 00000100:00100000:0.0:1746066739.457482:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982657152 00002000:00100000:0.0:1746066739.457509:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3162112->3166207) req@ffff88012b907800 x1830882982657152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.457518:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b907800 with x1830882982657152 ext(3162112->3166207) 00010000:00010000:0.0:1746066739.457525:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.457533:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746066739.457540:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b907800 00000100:00100000:0.0:1746066739.457554:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 738 00000100:00100000:0.0:1746066739.457560:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982657152:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066739.457685:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982657152:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 125us (251us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066739.457690:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 738 00002000:00100000:0.0:1746066739.457695:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3162112->3166207) req@ffff88012b907800 x1830882982657152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746066750 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.457702:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b907800 with x1830882982657152 ext(3162112->3166207) 00010000:00010000:0.0:1746066739.457707:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.457714:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0a800/0xf1867c21abfa3cd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3162112->3583999) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf730 expref: 39 pid: 3528 timeout: 807 lvb_type: 0 00002000:00010000:0.0:1746066739.457719:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b907800 00000100:00100000:0.0:1746066739.458947:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.462107:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.463580:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.465029:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.470127:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.476980:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982658688 00000100:00100000:0.0:1746066739.476990:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982658688 00000100:00100000:0.0:1746066739.477418:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5775 00000100:00100000:0.0:1746066739.477428:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:32385:x1830882982658688:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066739.477645:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:32385:x1830882982658688:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 218us (963us total) trans 8589936289 rc 0/0 00000100:00100000:0.0:1746066739.477652:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5775 00000100:00100000:0.0:1746066739.491491:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.491583:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.491613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.496715:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.503407:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.503447:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.503478:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.503503:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.503529:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.505332:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.509545:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.509564:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530752:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530805:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530818:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530844:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530856:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530867:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530923:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530933:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530943:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530952:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.530974:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.532843:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.532864:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.532875:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.532906:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982662784 00000100:00100000:0.0:1746066739.532913:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982662784 00000100:00100000:0.0:1746066739.532935:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982663040 00000100:00100000:0.0:1746066739.532936:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982663040 00000100:00100000:0.0:1746066739.532947:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14453 00000100:00100000:0.0:1746066739.532951:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982662784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066739.532964:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.532973:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa3d85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf784 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.532999:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa3d85 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf784 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.533008:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa3d85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf784 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.533019:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b600, rc 0) 00000100:00100000:0.0:1746066739.533029:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982662784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 78us (164us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066739.533033:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14453 00000100:00100000:0.0:1746066739.533042:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14454 00000100:00100000:0.0:1746066739.533046:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882982663040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066739.533052:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.533059:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa3d8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf792 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.533068:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.533839:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa3d8c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf792 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.533848:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa3d8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf792 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.533859:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:0.0:1746066739.533873:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882982663040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 827us (997us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066739.533878:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14454 00000100:00100000:0.0:1746066739.538633:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982663424 00000100:00100000:0.0:1746066739.538637:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982663424 00010000:00010000:0.0:1746066739.538659:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfa3c90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf706 expref: 15 pid: 12237 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.538685:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6426 00000100:00100000:0.0:1746066739.538692:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982663424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.538703:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.538721:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfa3c90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf706 expref: 15 pid: 12237 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.538732:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfa3c90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf706 expref: 15 pid: 12237 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.538758:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfa3c90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf706 expref: 15 pid: 12237 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.538773:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.538775:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.538780:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfa3d7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.538787:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfa3d7e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.538816:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.538851:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982663424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 159us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.538856:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6426 00000100:00100000:0.0:1746066739.547472:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.550235:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.551311:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.558214:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.558261:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.563045:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982664832 00000100:00100000:0.0:1746066739.563053:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982664832 00000100:00100000:0.0:1746066739.563091:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16015 00000100:00100000:0.0:1746066739.563099:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:32395:x1830882982664832:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066739.563119:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.563132:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a400/0xf1867c21abfa3dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf7b5 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.573477:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984214656:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066739.573605:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982664320:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15242us (15403us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066739.573616:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3544 00002000:00100000:0.0:1746066739.573626:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88006e210000 x1830882982664320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/440 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.573634:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882982664320 ext(4194304->5033983) 00002000:00010000:0.0:1746066739.573639:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210000 00000100:00100000:0.0:1746066739.573676:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.573691:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982665728 00000100:00100000:0.0:1746066739.573693:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982665728 00010000:00010000:0.0:1746066739.573703:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093506200/0xf1867c21abfa311b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ceea1 expref: 32 pid: 7243 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.573713:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6429 00000100:00100000:0.0:1746066739.573716:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982665216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.573721:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.573723:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfa2e74 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec5c expref: 15 pid: 7244 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.573827:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096a59600/0xf1867c21abfa2e74 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec5c expref: 15 pid: 7244 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.573846:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066739.573851:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.573861:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.573876:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982665216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 159us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.573899:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6429 00000100:00100000:0.0:1746066739.573942:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.573952:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982665088 00000100:00100000:0.0:1746066739.573954:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982665088 00010000:00010000:0.0:1746066739.573964:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa2ea5 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cec71 expref: 33 pid: 17253 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.577668:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.585811:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14468 00000100:00100000:0.0:1746066739.585819:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882984216192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066739.585865:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:0.0:1746066739.585867:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066739.585869:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066739.585871:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066739.585872:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:0.0:1746066739.589067:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3774:x1830882984216192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3240us (4217us total) trans 21474841551 rc 0/0 00000100:00100000:0.0:1746066739.589081:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14468 00000004:00080000:0.0:1746066739.589256:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b905180/2, rc 0, transno 21474841551 00000100:00100000:0.0:1746066739.589278:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984216192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066739.589293:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b907100/2, rc 0, transno 21474841550 00000100:00100000:0.0:1746066739.589296:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984216576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.589404:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984217216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589442:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589464:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984217728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589479:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589493:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066739.589498:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984217088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589513:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589520:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984217600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589532:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589547:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984216832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589562:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589569:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984217344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589582:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589589:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066739.589593:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984216960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589607:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589614:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984217472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.589626:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.589642:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984217856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.590633:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066739.591170:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e211500/2, rc 0, transno 17179874136 00000100:00100000:0.0:1746066739.591175:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984216960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066739.591191:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e210e00/2, rc 0, transno 17179874134 00000100:00100000:0.0:1746066739.591194:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984217472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066739.591209:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e213100/2, rc 0, transno 17179874130 00000100:00100000:0.0:1746066739.591212:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984216832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066739.591221:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e210a80/2, rc 0, transno 17179874135 00000100:00100000:0.0:1746066739.591225:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984217344:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066739.591242:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ff100/2, rc 0, transno 21474841553 00000100:00100000:0.0:1746066739.591245:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984217856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066739.591438:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 32 done 00010000:00010000:0.0:1746066739.591456:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.591464:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.591471:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.591476:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984bb000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066739.591480:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.591487:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.591501:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066739.591504:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066739.591507:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066739.591512:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb000/0xf1867c21abfa3dbd lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066739.593839:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.598609:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.599464:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.600820:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.602028:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.609402:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.611256:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.618748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.627586:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.658119:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.658157:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.658197:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.658227:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982668928 00000100:00100000:0.0:1746066739.658230:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982668928 00000100:00100000:0.0:1746066739.658251:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14484 00000100:00100000:0.0:1746066739.658258:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882982669056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066739.658278:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.658296:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfa3e18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf802 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.658318:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.658319:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.658327:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfa3e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf802 expref: 42 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.658341:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984ba800/0xf1867c21abfa3e18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf802 expref: 42 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.658354:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba800, rc 0) 00000100:00100000:0.0:1746066739.658532:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982669056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 273us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.658539:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14484 00000100:00100000:0.0:1746066739.688156:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.696749:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.697908:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982670208 00000100:00100000:0.0:1746066739.697912:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982670208 00010000:00010000:0.0:1746066739.697932:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32400/0xf1867c21abfa3dd2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7c3 expref: 29 pid: 7243 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.698091:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6437 00000100:00100000:0.0:1746066739.698097:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982670080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.698104:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.698108:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3000/0xf1867c21abfa3e03 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7ed expref: 10 pid: 7245 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.698116:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3000/0xf1867c21abfa3e03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7ed expref: 10 pid: 7245 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.698127:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3000/0xf1867c21abfa3e03 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7ed expref: 10 pid: 7245 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.698147:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066739.698150:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0de00/0xf1867c21abfa3e34 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066739.698161:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0de00/0xf1867c21abfa3e34 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066739.698167:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0de00/0xf1867c21abfa3e34 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066739.698188:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.698202:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982670080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.698207:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6437 00000100:00100000:0.0:1746066739.704445:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984219136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.705431:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14491 00000100:00100000:0.0:1746066739.705438:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3776:x1830882984219392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.705502:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3776:x1830882984219392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (964us total) trans 17179874140 rc 0/0 00000100:00100000:0.0:1746066739.705506:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14491 00000100:00100000:0.0:1746066739.706760:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.706778:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.706808:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984219776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.706826:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.706836:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984220288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.706849:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.706869:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.706897:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984219648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.706913:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.706921:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984220160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.706933:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066739.706946:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b7480/2, rc 0, transno 17179874138 00000100:00100000:0.0:1746066739.706949:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984218624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066739.706956:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b7100/2, rc 0, transno 17179874137 00000100:00100000:0.0:1746066739.706958:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984218496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.707593:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14500 00000100:00100000:0.0:1746066739.707598:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984219520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.707642:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14502 00000100:00100000:0.0:1746066739.707646:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3777:x1830882984220544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066739.707703:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984220544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (154us total) trans 17179874144 rc 0/0 00000100:00100000:0.0:1746066739.707707:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14502 00000004:00080000:0.0:1746066739.707724:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096fd4a80/2, rc 0, transno 17179874143 00000100:00100000:0.0:1746066739.707727:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984219136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066739.707733:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e212d80/2, rc 0, transno 21474841558 00000100:00100000:0.0:1746066739.707736:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984219648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066739.707740:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d8cbb80/2, rc 0, transno 21474841559 00000100:00100000:0.0:1746066739.707742:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984220160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.707748:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984220672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.707764:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066739.707779:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984220672 00000100:00100000:0.0:1746066739.707781:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984220672 00000100:00100000:0.0:1746066739.707808:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14503 00000100:00100000:0.0:1746066739.707812:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984220672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.707873:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882984220672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (108us total) trans 21474841562 rc 0/0 00000100:00100000:0.0:1746066739.707878:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14503 00000004:00080000:0.0:1746066739.707909:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012faf2680/2, rc 0, transno 21474841562 00000100:00100000:0.0:1746066739.707912:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984220672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066739.708416:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.712047:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.715448:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984220800:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066739.715458:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa3db6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7ae expref: 29 pid: 3528 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.715482:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984220928:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066739.715506:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8e00/0xf1867c21abfa3e65 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2473984->3145727] (req 2473984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf825 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.715518:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8e00, rc 0) 00000100:00100000:0.0:1746066739.715543:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:32395:x1830882982670848:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3320us (3504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.715548:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14504 00000100:00100000:0.0:1746066739.717157:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.722437:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982671488 00000100:00100000:0.0:1746066739.722444:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982671488 00002000:00100000:0.0:1746066739.722484:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2473984->2478079) req@ffff880096fd6680 x1830882982671488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.722493:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd6680 with x1830882982671488 ext(2473984->2478079) 00002000:00010000:0.0:1746066739.722499:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd6680 00000100:00100000:0.0:1746066739.722529:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3550 00000100:00100000:0.0:1746066739.722536:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982671488:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066739.723378:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982671488:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 843us (1092us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066739.723384:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3550 00002000:00100000:0.0:1746066739.723389:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2473984->2478079) req@ffff880096fd6680 x1830882982671488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.723396:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd6680 with x1830882982671488 ext(2473984->2478079) 00002000:00010000:0.0:1746066739.723399:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd6680 00000100:00100000:0.0:1746066739.723407:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982671744 00000100:00100000:0.0:1746066739.723409:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982671744 00002000:00100000:0.0:1746066739.723419:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff880096fd7100 x1830882982671744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.723425:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7100 with x1830882982671744 ext(2097152->3145727) 00002000:00010000:0.0:1746066739.723428:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd7100 00000100:00100000:0.0:1746066739.723436:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3551 00000100:00100000:0.0:1746066739.723440:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882982671744:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066739.731720:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.735402:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.740696:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.740775:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.740829:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.740868:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.740922:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982672640 00000100:00100000:0.0:1746066739.740930:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982672640 00010000:00010000:0.0:1746066739.740965:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa3e11 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7f4 expref: 42 pid: 9592 timeout: 807 lvb_type: 0 00000100:00100000:0.0:1746066739.740991:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982672768 00000100:00100000:0.0:1746066739.740993:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982672768 00010000:00010000:0.0:1746066739.741003:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf56c00/0xf1867c21abfa3dee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7df expref: 28 pid: 11630 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746066739.741015:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982673024 00000100:00100000:0.0:1746066739.741017:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982673024 00010000:00010000:0.0:1746066739.741027:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfa3dfc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7e6 expref: 17 pid: 11630 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746066739.741040:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6442 00000100:00100000:0.0:1746066739.741045:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982672640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.741058:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.741081:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa3e11 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7f4 expref: 42 pid: 9592 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.741093:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa3e11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7f4 expref: 42 pid: 9592 timeout: 807 lvb_type: 0 00010000:00010000:0.0:1746066739.741120:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.741207:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982672640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 159us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.741213:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6442 00000100:00100000:0.0:1746066739.741229:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6443 00000100:00100000:0.0:1746066739.741233:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982672768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.741240:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.741246:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf56c00/0xf1867c21abfa3dee lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7df expref: 28 pid: 11630 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746066739.741254:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf56c00/0xf1867c21abfa3dee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7df expref: 28 pid: 11630 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746066739.741265:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.741267:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.741274:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf57000/0xf1867c21abfa3e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf833 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.741283:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf57000/0xf1867c21abfa3e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf833 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.741325:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf57000/0xf1867c21abfa3e73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf833 expref: 43 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.741338:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984222080:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066739.741388:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011f486540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.741408:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6444 00000100:00100000:0.0:1746066739.741414:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982673024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.741421:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.741433:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfa3dfc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7e6 expref: 17 pid: 11630 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746066739.741441:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed800/0xf1867c21abfa3dfc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7e6 expref: 17 pid: 11630 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746066739.741453:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066739.741465:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982673024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.741470:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6444 00000100:00100000:0.0:1746066739.741499:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.741511:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982673152 00000100:00100000:0.0:1746066739.741514:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982673152 00010000:00010000:0.0:1746066739.741522:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c400/0xf1867c21abfa3e26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf809 expref: 33 pid: 12233 timeout: 807 lvb_type: 1 00000100:00100000:0.0:1746066739.741531:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6445 00000100:00100000:0.0:1746066739.741535:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982673152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066739.741542:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066739.741546:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c400/0xf1867c21abfa3e26 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf809 expref: 33 pid: 12233 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746066739.741554:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c400/0xf1867c21abfa3e26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf809 expref: 33 pid: 12233 timeout: 807 lvb_type: 1 00010000:00010000:0.0:1746066739.741564:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.741565:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.741568:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa3e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf83a expref: 16 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.741579:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa3e7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf83a expref: 16 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.741594:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa3e7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2281471) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf83a expref: 16 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066739.741600:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984222208:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066739.741615:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011f4869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066739.746131:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.748463:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.761001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.764236:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.771843:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.789015:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.792419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.801101:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.807049:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.822276:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.836588:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.844580:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.848543:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.849123:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.849147:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.849184:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.849431:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14512 00000100:00100000:0.0:1746066739.849438:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882982676608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066739.849444:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066739.849450:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f6a00/0xf1867c21abfa3ec0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf86b expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066739.849461:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.849463:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066739.849471:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6a00/0xf1867c21abfa3ec0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf86b expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.849484:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6a00/0xf1867c21abfa3ec0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf86b expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066739.849494:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6a00, rc 0) 00000100:00100000:0.0:1746066739.850435:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982676608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 997us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066739.850441:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14512 00000100:00100000:0.0:1746066739.858557:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.858852:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.867710:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2014:x1830882982677120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8659us (8844us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066739.867723:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3559 00002000:00100000:0.0:1746066739.867738:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a4d0c380 x1830882982677120/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:145/0 lens 488/440 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.867748:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0c380 with x1830882982677120 ext(1048576->2097151) 00002000:00010000:0.0:1746066739.867755:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d0c380 00000100:00100000:0.0:1746066739.880215:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.887839:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.887964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.892404:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.894424:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.902166:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.909093:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982678784 00000100:00100000:0.0:1746066739.909103:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982678784 00002000:00100000:0.0:1746066739.909149:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1449984->1454079) req@ffff8800967aad80 x1830882982678784/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/0 e 0 to 0 dl 1746066750 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.909159:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882982678784 ext(1449984->1454079) 00002000:00010000:0.0:1746066739.909165:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:0.0:1746066739.909308:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3561 00000100:00100000:0.0:1746066739.909318:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882982678784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066739.910191:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882982678784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 789us (1237us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066739.910199:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3561 00002000:00100000:0.0:1746066739.910206:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1449984->1454079) req@ffff8800967aad80 x1830882982678784/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:145/0 lens 488/4536 e 0 to 0 dl 1746066750 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066739.910214:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882982678784 ext(1449984->1454079) 00002000:00010000:0.0:1746066739.910218:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:0.0:1746066739.918943:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.920057:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.924151:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.936308:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.941960:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.959706:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.962329:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.963282:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.968623:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.972435:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.977900:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066739.980062:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3566 00000100:00100000:0.0:1746066739.980076:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882982681216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066739.996364:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.003069:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.003128:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.009289:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.018366:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.024941:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.024995:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.042139:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.061194:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.076536:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.076579:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.076600:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.076631:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.076667:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982683520 00000100:00100000:0.0:1746066740.076676:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982683520 00000100:00100000:0.0:1746066740.076710:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982683648 00000100:00100000:0.0:1746066740.076712:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982683648 00000100:00100000:0.0:1746066740.076721:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982683776 00000100:00100000:0.0:1746066740.076722:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982683776 00000100:00100000:0.0:1746066740.076735:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14519 00000100:00100000:0.0:1746066740.076740:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882982683520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066740.076760:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.076777:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfa3f4c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf8aa expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.076811:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.076813:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.076821:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfa3f4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8aa expref: 35 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.076835:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c000/0xf1867c21abfa3f4c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8aa expref: 35 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.076845:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c000, rc 0) 00000100:00100000:0.0:1746066740.076916:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882982683520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 174us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.076922:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14519 00000100:00100000:0.0:1746066740.076936:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14520 00000100:00100000:0.0:1746066740.076940:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982683648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066740.076947:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.076957:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa3f53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf8b1 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.076967:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.076969:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.076972:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa3f53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8b1 expref: 45 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.076985:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa3f53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8b1 expref: 45 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.076991:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2ca00, rc 0) 00000100:00100000:0.0:1746066740.077004:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882982683648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.077008:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14520 00000100:00100000:0.0:1746066740.077016:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14521 00000100:00100000:0.0:1746066740.077020:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982683776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066740.077025:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.077031:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa3f5a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf8b8 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.077040:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.077041:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.077045:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa3f5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8b8 expref: 45 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.077053:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa3f5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8b8 expref: 45 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.077059:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2da00, rc 0) 00000100:00100000:0.0:1746066740.077071:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882982683776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 51us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.077076:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14521 00000100:00100000:0.0:1746066740.088207:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.088249:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.088417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.088461:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.088505:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982684032 00000100:00100000:0.0:1746066740.088513:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982684032 00002000:00100000:0.0:1746066740.088564:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d7100 x1830882982684032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:146/0 lens 488/0 e 0 to 0 dl 1746066751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.088574:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7100 with x1830882982684032 ext(0->1048575) 00002000:00010000:0.0:1746066740.088580:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d7100 00000100:00100000:0.0:1746066740.088598:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982684288 00000100:00100000:0.0:1746066740.088600:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982684288 00002000:00100000:0.0:1746066740.088612:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800945d7480 x1830882982684288/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:146/0 lens 488/0 e 0 to 0 dl 1746066751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.088619:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7480 with x1830882982684288 ext(1048576->2097151) 00002000:00010000:0.0:1746066740.088622:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d7480 00000100:00100000:0.0:1746066740.088630:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982684544 00000100:00100000:0.0:1746066740.088632:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982684544 00002000:00100000:0.0:1746066740.088641:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800945d5500 x1830882982684544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:146/0 lens 488/0 e 0 to 0 dl 1746066751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.088647:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5500 with x1830882982684544 ext(1048576->2097151) 00002000:00010000:0.0:1746066740.088649:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d5500 00000100:00100000:0.0:1746066740.088657:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982684800 00000100:00100000:0.0:1746066740.088658:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982684800 00002000:00100000:0.0:1746066740.088666:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800945d6680 x1830882982684800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:146/0 lens 488/0 e 0 to 0 dl 1746066751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.088672:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d6680 with x1830882982684800 ext(1048576->2097151) 00002000:00010000:0.0:1746066740.088676:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d6680 00000100:00100000:0.0:1746066740.088686:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3571 00000100:00100000:0.0:1746066740.088694:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:2013:x1830882982684032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066740.092349:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3574 00000100:00100000:0.0:1746066740.092363:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882982684800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066740.118255:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882982684800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25883us (29780us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066740.118268:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3574 00002000:00100000:0.0:1746066740.118281:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800945d6680 x1830882982684800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:146/0 lens 488/440 e 0 to 0 dl 1746066751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.118289:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d6680 with x1830882982684800 ext(1048576->2097151) 00002000:00010000:0.0:1746066740.118295:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d6680 00000100:00100000:0.0:1746066740.124054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.128474:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.138651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.140857:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.146435:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982685952 00000100:00100000:0.0:1746066740.146447:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982685952 00000100:00100000:0.0:1746066740.146529:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16027 00000100:00100000:0.0:1746066740.146538:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:32422:x1830882982685952:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066740.146573:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.146595:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa3f84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf8c6 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.146676:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146690:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146701:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146712:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146718:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146723:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146834:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa3f99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146844:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa3f99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146850:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa3f99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066740.146859:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066740.146950:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146956:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146962:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146967:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146974:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629ac00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066740.146978:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146985:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.146995:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066740.146998:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066740.147001:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147006:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ac00/0xf1867c21abfa3f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147024:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147029:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147034:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147038:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629b000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066740.147040:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147045:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147051:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20400) 00010000:00010000:0.0:1746066740.147054:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066740.147056:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147061:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa3f92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.147099:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa3f84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8c6 expref: 37 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.147111:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa3f99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8c6 expref: 36 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.147117:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066740.147119:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066740.147121:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:0.0:1746066740.147166:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:32422:x1830882982685952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 628us (1820us total) trans 8589936308 rc 0/0 00000100:00100000:0.0:1746066740.147173:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16027 00000100:00100000:0.0:1746066740.161584:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.171258:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.183826:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.185032:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.193020:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.197736:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.203234:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.212494:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.216731:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.216775:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.218091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.218398:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.219371:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6459 00000100:00100000:0.0:1746066740.219380:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982688128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066740.219389:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066740.219405:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa3f5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8b8 expref: 46 pid: 12237 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746066740.219414:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa3f5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8b8 expref: 46 pid: 12237 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746066740.219431:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa3f5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8b8 expref: 46 pid: 12237 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746066740.219448:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.219449:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.219456:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa3fae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8d4 expref: 45 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.219463:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa3fae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8d4 expref: 45 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.219494:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa3fae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8d4 expref: 45 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.219505:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984225280:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066740.219564:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011f486540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066740.219599:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.221614:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.224431:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984225280:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066740.224442:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066740.225541:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982688128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6162us (7141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.225548:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6459 00002000:00010000:0.0:1746066740.225977:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066740 -> 1746066741 00002000:00010000:0.0:1746066740.225980:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066740 -> 1746066741 00002000:00010000:0.0:1746066740.225982:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066740 -> 1746066741 00000100:00100000:0.0:1746066740.225992:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984225536:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066740.226011:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa3fdf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8e2 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.226021:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa3fdf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8e2 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.226033:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1e00, rc 0) 00000100:00100000:0.0:1746066740.226054:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982688512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4314us (4441us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066740.226060:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14525 00000100:00100000:0.0:1746066740.234248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.240230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.246797:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.254284:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.270867:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.276349:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.288712:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.288830:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.293821:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.296477:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.302647:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982690304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8164us (8836us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066740.302654:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3581 00002000:00100000:0.0:1746066740.302659:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88009666dc00 x1830882982690304/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:146/0 lens 488/440 e 0 to 0 dl 1746066751 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.302667:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666dc00 with x1830882982690304 ext(2097152->3145727) 00002000:00010000:0.0:1746066740.302670:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666dc00 00000100:00100000:0.0:1746066740.311099:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.311133:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.311159:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.311195:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.312616:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3584 00000100:00100000:0.0:1746066740.312623:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882982691584:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066740.313267:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3585 00000100:00100000:0.0:1746066740.313273:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982691328:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066740.330170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.333463:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.343364:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.350249:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.350754:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.372221:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.378578:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.413624:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.418323:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.440677:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.461189:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.464856:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.473125:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.473166:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.486831:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.486910:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.509493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.533390:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.566877:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.567762:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.576349:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.590193:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.593591:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.638768:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.638825:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.648751:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.650656:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982699008 00000100:00100000:0.0:1746066740.650662:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982699008 00000100:00100000:0.0:1746066740.650695:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14537 00000100:00100000:0.0:1746066740.650701:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+34:32436:x1830882982699008:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066740.650716:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.650731:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa40bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf959 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.650900:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b33000/0xf1867c21abfa3de7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7d1 expref: 35 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.650911:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa3e1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7fb expref: 48 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.650917:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.650919:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.650922:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa40bf lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [983040->1048575] (req 983040->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf959 expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.650949:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa3e1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7fb expref: 48 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.650958:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa3e1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7fb expref: 48 pid: 12233 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746066740.650969:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984227712:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066740.651074:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b33000/0xf1867c21abfa3de7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7d1 expref: 35 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.651082:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b33000/0xf1867c21abfa3de7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7d1 expref: 35 pid: 9591 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746066740.651090:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984227840:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066740.651107:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011f4869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066740.654715:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.656081:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6470 00000100:00100000:0.0:1746066740.656089:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882982699648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066740.656097:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066740.656109:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b33000/0xf1867c21abfa3de7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7d1 expref: 35 pid: 9591 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746066740.656144:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b33000/0xf1867c21abfa3de7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7d1 expref: 35 pid: 9591 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746066740.656156:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b33000/0xf1867c21abfa3de7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf7d1 expref: 35 pid: 9591 timeout: 808 lvb_type: 1 00010000:00010000:0.0:1746066740.656175:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.656177:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.656184:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa40bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf959 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.656192:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa40bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf959 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.656222:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa40bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf959 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.656235:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984228096:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066740.656351:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011f486f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066740.658247:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.661851:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.661951:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.664106:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.666167:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.673313:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.677946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.688037:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.692144:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.700429:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.704713:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.707219:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066740.707593:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095675e00/0xf1867c21abfa40e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707600:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095675e00/0xf1867c21abfa40e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066740.707645:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:0.0:1746066740.707650:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066740.707666:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095675e00/0xf1867c21abfa40e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707676:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095675e00/0xf1867c21abfa40e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707687:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707693:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707697:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707701:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707705:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066740.707708:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707713:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707719:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066740.707720:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066740.707722:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707725:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa40db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707789:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa40e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707795:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa40e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707799:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa40e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707803:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066740.707805:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa40e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707809:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa40e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707815:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800957eac00) 00010000:00010000:0.0:1746066740.707817:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066740.707820:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa40e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707824:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa40e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.707856:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05400/0xf1867c21abfa40d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf96e expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.707868:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095675e00/0xf1867c21abfa40e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf96e expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.707873:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066740.707876:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066740.707878:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095675e00, rc 0) 00000100:00100000:0.0:1746066740.708026:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32444:x1830882982701568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7263us (7609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.708033:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16033 00000100:00100000:0.0:1746066740.709847:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.709982:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.710212:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14542 00000100:00100000:0.0:1746066740.710217:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982702592:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066740.710223:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.710238:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a6c00/0xf1867c21abfa40f7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf991 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.710256:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.710258:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.710267:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6c00/0xf1867c21abfa40f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf991 expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.710281:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a6c00/0xf1867c21abfa40f7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf991 expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.710290:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6c00, rc 0) 00000100:00100000:0.0:1746066740.710397:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982702592:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 179us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.710403:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14542 00000100:00100000:0.0:1746066740.712589:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.712622:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.713059:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.720960:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.723394:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.725747:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.727870:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066740.728280:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa4136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.728286:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa4136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066740.728329:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:0.0:1746066740.728334:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066740.728349:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa4136 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.728375:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae000/0xf1867c21abfa412f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9a6 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.728406:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa4136 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9a6 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.728412:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066740.728414:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066740.728416:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae400, rc 0) 00000100:00100000:0.0:1746066740.731035:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.731065:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.731128:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.731146:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982703488 00000100:00100000:0.0:1746066740.731152:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982703488 00000100:00100000:0.0:1746066740.732010:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982703616 00000100:00100000:0.0:1746066740.732015:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982703616 00000100:00100000:0.0:1746066740.732036:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14547 00000100:00100000:0.0:1746066740.732041:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982703616:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066740.732049:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.732063:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a7c00/0xf1867c21abfa4144 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf9b4 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.732112:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984229632:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066740.732402:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011f486f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066740.737765:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.744550:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.745136:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.745173:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.745186:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.746681:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14553 00000100:00100000:0.0:1746066740.746687:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982704768:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066740.746708:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.746721:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfa4087 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf93d expref: 35 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.746727:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfa410c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf998 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.746738:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05000/0xf1867c21abfa40b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf94b expref: 18 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.746743:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.746744:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.746748:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.746760:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d05000/0xf1867c21abfa40b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf94b expref: 18 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.746766:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d05000/0xf1867c21abfa40b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf94b expref: 18 pid: 13363 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746066740.746781:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984230912:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066740.746803:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfa410c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf998 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.746810:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fafc00/0xf1867c21abfa410c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf998 expref: 9 pid: 9590 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746066740.746816:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984231040:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066740.746835:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfa4087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf93d expref: 35 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.746841:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfa4087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf93d expref: 35 pid: 13363 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746066740.746846:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984231168:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066740.746856:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011f4869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066740.746905:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.753767:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.754454:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984230912:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066740.754485:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea24a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984231040:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066740.754507:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984231168:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066740.754524:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.754579:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.754598:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982704896 00000100:00100000:0.0:1746066740.754604:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982704896 00002000:00100000:0.0:1746066740.754650:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (983040->1048575) req@ffff88012ea25500 x1830882982704896/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:146/0 lens 488/0 e 0 to 0 dl 1746066751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.754659:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25500 with x1830882982704896 ext(983040->1048575) 00010000:00010000:0.0:1746066740.754666:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa40bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf959 expref: 34 pid: 12233 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.754676:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa40bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 983040->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf959 expref: 34 pid: 12233 timeout: 808 lvb_type: 0 00002000:00010000:0.0:1746066740.754681:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea25500 00000100:00100000:0.0:1746066740.754698:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982705280 00000100:00100000:0.0:1746066740.754700:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982705280 00002000:00100000:0.0:1746066740.754712:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1839103) req@ffff88012ea24e00 x1830882982705280/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:146/0 lens 488/0 e 0 to 0 dl 1746066751 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066740.754718:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea24e00 with x1830882982705280 ext(1048576->1839103) 00010000:00010000:0.0:1746066740.754723:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d04800/0xf1867c21abfa40c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf960 expref: 19 pid: 9591 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.754730:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d04800/0xf1867c21abfa40c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf960 expref: 19 pid: 9591 timeout: 808 lvb_type: 0 00002000:00010000:0.0:1746066740.754735:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ea24e00 00000100:00100000:0.0:1746066740.754747:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 754 00000100:00100000:0.0:1746066740.754754:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982704896:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066740.758250:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982705152 00000100:00100000:0.0:1746066740.758259:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982705152 00010000:00010000:0.0:1746066740.758295:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097017c00/0xf1867c21abfa402c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf91a expref: 48 pid: 13363 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746066740.758334:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982705536 00000100:00100000:0.0:1746066740.758337:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982705536 00010000:00010000:0.0:1746066740.758348:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6c00/0xf1867c21abfa40f7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf991 expref: 14 pid: 12237 timeout: 808 lvb_type: 1 00000100:00100000:0.0:1746066740.762117:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982706304 00000100:00100000:0.0:1746066740.762121:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982706304 00010000:00010000:0.0:1746066740.762134:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfa4087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf93d expref: 38 pid: 13363 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746066740.762211:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6485 00000100:00100000:0.0:1746066740.762217:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982706304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066740.762223:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066740.762230:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfa4087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf93d expref: 38 pid: 13363 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.762238:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfa4087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf93d expref: 38 pid: 13363 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.762248:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589b800/0xf1867c21abfa4087 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf93d expref: 38 pid: 13363 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.762262:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.762263:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.762266:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762272:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762290:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066740.762299:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762305:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762314:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762320:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762325:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762330:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066740.762332:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762338:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762345:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.762350:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d05400/0xf1867c21abfa4183 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.762386:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982704768:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 15700us (16107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.762392:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14553 00000100:00100000:0.0:1746066740.762412:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882982706304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 195us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.762416:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6485 00000100:00100000:0.0:1746066740.786258:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.790216:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.790248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.790797:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.790809:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982707328 00000100:00100000:0.0:1746066740.790812:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982707328 00010000:00010000:0.0:1746066740.790825:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa3f3e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8a3 expref: 42 pid: 7245 timeout: 808 lvb_type: 0 00000100:00100000:0.0:1746066740.790841:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6491 00000100:00100000:0.0:1746066740.790846:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882982707328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066740.790853:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066740.790857:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa3f3e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8a3 expref: 42 pid: 7245 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.792246:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa3f3e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8a3 expref: 40 pid: 7245 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.792850:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa3f3e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf8a3 expref: 40 pid: 7245 timeout: 808 lvb_type: 0 00010000:00010000:0.0:1746066740.792872:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066740.792876:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa4191 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.792894:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa4191 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.792900:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa4191 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066740.792928:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066740.792951:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982707328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2104us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.792958:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6491 00000001:00080000:0.0:1746066740.797288:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936325 is committed 00000004:00080000:0.0:1746066740.797303:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 398 committed 00000004:00080000:0.0:1746066740.797324:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 443 committed 00000004:00080000:0.0:1746066740.797337:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 442 committed 00000004:00080000:0.0:1746066740.797339:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 441 committed 00000004:00080000:0.0:1746066740.797340:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 440 committed 00000004:00080000:0.0:1746066740.797342:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 397 committed 00000004:00080000:0.0:1746066740.797344:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 439 committed 00000004:00080000:0.0:1746066740.797345:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 396 committed 00000004:00080000:0.0:1746066740.797347:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 438 committed 00000004:00080000:0.0:1746066740.797349:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 395 committed 00000004:00080000:0.0:1746066740.797350:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 394 committed 00000004:00080000:0.0:1746066740.797352:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 393 committed 00000004:00080000:0.0:1746066740.797355:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 437 committed 00000004:00080000:0.0:1746066740.797356:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 436 committed 00000004:00080000:0.0:1746066740.797358:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 392 committed 00000004:00080000:0.0:1746066740.797360:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 391 committed 00000004:00080000:0.0:1746066740.797361:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 435 committed 00000001:00080000:0.0:1746066740.797370:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936322 is committed 00000001:00080000:0.0:1746066740.797374:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936321 is committed 00000100:00100000:0.0:1746066740.798393:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984232320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066740.798461:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066740.798497:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066740.798502:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984232192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066740.799055:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066740.799068:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984232832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066740.799081:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066740.799092:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984233344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066740.799117:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984232320 00000100:00100000:0.0:1746066740.799124:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984232320 00000100:00100000:0.0:1746066740.799157:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984232064 00000100:00100000:0.0:1746066740.799159:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984232064 00000100:00100000:0.0:1746066740.799167:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984232576 00000100:00100000:0.0:1746066740.799168:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984232576 00000100:00100000:0.0:1746066740.799173:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984233600 00000100:00100000:0.0:1746066740.799175:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984233600 00000100:00100000:0.0:1746066740.799179:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984232448 00000100:00100000:0.0:1746066740.799181:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984232448 00000100:00100000:0.0:1746066740.799186:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984232960 00000100:00100000:0.0:1746066740.799187:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984232960 00000100:00100000:0.0:1746066740.799193:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984233216 00000100:00100000:0.0:1746066740.799194:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984233216 00000100:00100000:0.0:1746066740.799203:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14555 00000100:00100000:0.0:1746066740.799210:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3777:x1830882984232320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066740.799345:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3777:x1830882984232320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (884us total) trans 21474841571 rc 0/0 00000100:00100000:0.0:1746066740.799394:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14555 00000100:00100000:0.0:1746066740.800503:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14557 00000100:00100000:0.0:1746066740.800511:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882984232576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066740.800576:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14559 00000100:00100000:0.0:1746066740.800581:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882984233600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066740.800631:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066740.800634:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.800636:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066740.800638:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.800640:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:0.0:1746066740.800659:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984233600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (1653us total) trans 21474841572 rc 0/0 00000100:00100000:0.0:1746066740.800665:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14559 00000100:00100000:0.0:1746066740.800673:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14561 00000100:00100000:0.0:1746066740.800677:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3777:x1830882984232192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066740.800721:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3777:x1830882984232192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (1666us total) trans 21474841574 rc 0/0 00000100:00100000:0.0:1746066740.800726:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14561 00000100:00100000:0.0:1746066740.800735:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14563 00000100:00100000:0.0:1746066740.800739:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984232960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066740.800784:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066740.800787:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.800789:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066740.800791:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.800793:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066740.800809:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882984232960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1744us total) trans 17179874155 rc 0/0 00000100:00100000:0.0:1746066740.800814:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14563 00000100:00100000:0.0:1746066740.800823:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14565 00000100:00100000:0.0:1746066740.800826:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882984233216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066740.800875:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3776:x1830882984233216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (1744us total) trans 17179874157 rc 0/0 00000100:00100000:0.0:1746066740.800880:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14565 00000100:00100000:0.0:1746066740.800910:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066740.800932:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984233856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066740.800953:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066740.800978:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d0a680/2, rc 0, transno 21474841574 00000100:00100000:0.0:1746066740.800987:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984232192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066740.800996:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d08700/2, rc 0, transno 21474841571 00000100:00100000:0.0:1746066740.800999:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984232320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066740.801011:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d5c00/2, rc 0, transno 17179874154 00000100:00100000:0.0:1746066740.801014:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984232832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066740.801020:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a03d4700/2, rc 0, transno 17179874158 00000100:00100000:0.0:1746066740.801023:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984233344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066740.801058:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984232576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 549us (2100us total) trans 17179874153 rc 0/0 00000100:00100000:0.0:1746066740.801066:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14557 00000004:00080000:0.0:1746066740.801104:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d09880/2, rc 0, transno 21474841576 00000100:00100000:0.0:1746066740.801107:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984233856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066740.805514:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.809338:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.815127:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.815661:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.815871:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.815964:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.817218:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.817293:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.817328:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982708224 00000100:00100000:0.0:1746066740.817331:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982708224 00000100:00100000:0.0:1746066740.817351:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982708352 00000100:00100000:0.0:1746066740.817353:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982708352 00000100:00100000:0.0:1746066740.817362:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982708480 00000100:00100000:0.0:1746066740.817363:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982708480 00000100:00100000:0.0:1746066740.817374:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14575 00000100:00100000:0.0:1746066740.817378:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982708224:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066740.817386:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.817396:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc0e800/0xf1867c21abfa41c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf9ec expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066740.817409:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd35, atime: 0x6812dd34, ctime: 0x6812dd35, blocks: 0x800 00010000:00010000:0.0:1746066740.817416:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.817417:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.817421:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc0e800/0xf1867c21abfa41c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9ec expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.817430:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc0e800/0xf1867c21abfa41c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9ec expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.817437:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc0e800, rc 0) 00000100:00100000:0.0:1746066740.817455:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982708224:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 77us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.817459:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14575 00000100:00100000:0.0:1746066740.817468:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14576 00000100:00100000:0.0:1746066740.817472:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982708352:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066740.817476:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.817482:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa41c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf9f3 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066740.817491:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd35, atime: 0x6812dd35, ctime: 0x6812dd35, blocks: 0x1668 00010000:00010000:0.0:1746066740.817496:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.817497:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.817500:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa41c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9f3 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.817508:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa41c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9f3 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.817514:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a000, rc 0) 00000100:00100000:0.0:1746066740.817526:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982708352:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.817533:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14576 00000100:00100000:0.0:1746066740.817540:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14577 00000100:00100000:0.0:1746066740.817543:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982708480:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066740.817548:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.817555:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa41d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cf9fa expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066740.817564:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd35, atime: 0x6812dd35, ctime: 0x6812dd35, blocks: 0x1000 00010000:00010000:0.0:1746066740.817569:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.817570:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.817573:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa41d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9fa expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.817580:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa41d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9fa expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066740.817586:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a400, rc 0) 00000100:00100000:0.0:1746066740.817596:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982708480:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 53us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.817600:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14577 00000100:00100000:0.0:1746066740.823036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.823158:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.823463:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.823666:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.824122:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.824150:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.824162:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982708864 00000100:00100000:0.0:1746066740.824165:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982708864 00000100:00100000:0.0:1746066740.824182:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982709120 00000100:00100000:0.0:1746066740.824184:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982709120 00000100:00100000:0.0:1746066740.824196:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14580 00000100:00100000:0.0:1746066740.824200:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982709248:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066740.824233:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982709248:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.824238:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14580 00000100:00100000:0.0:1746066740.824247:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14582 00000100:00100000:0.0:1746066740.824252:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982709120:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066740.824275:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982709120:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 23us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.824280:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14582 00000100:00100000:0.0:1746066740.831521:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.832668:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14588 00000100:00100000:0.0:1746066740.832676:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982709760:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066740.832713:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982709760:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.832718:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14588 00000100:00100000:0.0:1746066740.835978:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.839784:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.849973:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3601 00000100:00100000:0.0:1746066740.849982:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982711040:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066740.850003:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa41e5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.850014:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.850015:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.850018:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa41e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.850026:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa41e5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.856197:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.856241:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.856279:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.857187:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3603 00000100:00100000:0.0:1746066740.857194:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982711552:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066740.857215:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094d05400/0xf1867c21abfa41f3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.857223:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.857224:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.857227:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05400/0xf1867c21abfa41f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.857236:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d05400/0xf1867c21abfa41f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.861030:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.861088:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.864224:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3606 00000100:00100000:0.0:1746066740.864233:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982712320:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066740.864251:0:20357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094d05000/0xf1867c21abfa4208 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.864259:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.864260:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.864264:0:20357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05000/0xf1867c21abfa4208 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.864272:0:20357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05000/0xf1867c21abfa4208 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066740.903180:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.906608:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.906955:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.907004:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.907303:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.907535:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.907937:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14594 00000100:00100000:0.0:1746066740.907946:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982713216:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:0.0:1746066740.908015:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:0.0:1746066740.908018:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.908020:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.908021:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.908023:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:0.0:1746066740.908040:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982713216:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 96us (1035us total) trans 21474841582 rc 0/0 00000100:00100000:0.0:1746066740.908049:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14594 00000100:00100000:0.0:1746066740.910183:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.914432:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000001:00080000:0.0:1746066740.918143:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936327 is committed 00000004:00080000:0.0:1746066740.918158:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 406 committed 00000004:00080000:0.0:1746066740.918176:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 452 committed 00000004:00080000:0.0:1746066740.918182:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 451 committed 00000004:00080000:0.0:1746066740.918184:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 450 committed 00000004:00080000:0.0:1746066740.918186:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 449 committed 00000004:00080000:0.0:1746066740.918187:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 405 committed 00000004:00080000:0.0:1746066740.918189:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 448 committed 00000004:00080000:0.0:1746066740.918191:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 404 committed 00000004:00080000:0.0:1746066740.918192:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 447 committed 00000004:00080000:0.0:1746066740.918193:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 403 committed 00000004:00080000:0.0:1746066740.918194:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 402 committed 00000004:00080000:0.0:1746066740.918196:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 401 committed 00000004:00080000:0.0:1746066740.918197:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 446 committed 00000004:00080000:0.0:1746066740.918199:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 445 committed 00000004:00080000:0.0:1746066740.918200:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 400 committed 00000004:00080000:0.0:1746066740.918201:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 399 committed 00000004:00080000:0.0:1746066740.918202:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 444 committed 00010000:00010000:0.0:1746066740.918825:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfa4216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066740.918832:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfa4216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066740.918837:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfa4216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066740.918842:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066740.918846:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfa4216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066740.918851:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfa4216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066740.918859:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066740.918861:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066740.918864:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfa4216 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00010000:00010000:0.0:1746066740.918868:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0a00/0xf1867c21abfa4216 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000100:00100000:0.0:1746066740.918904:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984235264 00000100:00100000:0.0:1746066740.918907:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984235264 00000100:00100000:0.0:1746066740.918923:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984235136 00000100:00100000:0.0:1746066740.918925:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984235136 00000100:00100000:0.0:1746066740.918935:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984234880 00000100:00100000:0.0:1746066740.918937:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984234880 00000100:00100000:0.0:1746066740.918944:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14599 00000100:00100000:0.0:1746066740.918948:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984235264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066740.919063:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:0.0:1746066740.919066:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.919069:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066740.919071:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.919073:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:0.0:1746066740.919097:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3775:x1830882984235264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (330us total) trans 21474841585 rc 0/0 00000100:00100000:0.0:1746066740.919102:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14599 00000100:00100000:0.0:1746066740.919113:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14602 00000100:00100000:0.0:1746066740.919117:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882984234368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066740.919154:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066740.919156:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919158:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919160:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919161:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:0.0:1746066740.919176:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882984234368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (313us total) trans 21474841587 rc 0/0 00000100:00100000:0.0:1746066740.919181:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14602 00000100:00100000:0.0:1746066740.919191:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984235648 00000100:00100000:0.0:1746066740.919194:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984235648 00000100:00100000:0.0:1746066740.919202:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984236160 00000100:00100000:0.0:1746066740.919204:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984236160 00000100:00100000:0.0:1746066740.919210:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984236288 00000100:00100000:0.0:1746066740.919212:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984236288 00000100:00100000:0.0:1746066740.919220:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14604 00000100:00100000:0.0:1746066740.919224:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882984234496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066740.919259:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066740.919261:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919263:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919264:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919266:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066740.919285:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882984234496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (334us total) trans 21474841589 rc 0/0 00000100:00100000:0.0:1746066740.919290:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14604 00000100:00100000:0.0:1746066740.919301:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14606 00000100:00100000:0.0:1746066740.919304:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3774:x1830882984235648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066740.919363:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066740.919365:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919367:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919368:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919370:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066740.919391:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3774:x1830882984235648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (258us total) trans 17179874163 rc 0/0 00000100:00100000:0.0:1746066740.919396:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14606 00000100:00100000:0.0:1746066740.919404:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984235392 00000100:00100000:0.0:1746066740.919406:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984235392 00000100:00100000:0.0:1746066740.919414:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984235904 00000100:00100000:0.0:1746066740.919415:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984235904 00000100:00100000:0.0:1746066740.919422:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14608 00000100:00100000:0.0:1746066740.919426:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+35:3774:x1830882984235776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066740.919465:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066740.919467:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.919469:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:0.0:1746066740.919470:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066740.919472:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:0.0:1746066740.919489:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984235776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (311us total) trans 17179874165 rc 0/0 00000100:00100000:0.0:1746066740.919494:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14608 00000100:00100000:0.0:1746066740.919502:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14609 00000100:00100000:0.0:1746066740.919506:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984236288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066740.919555:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882984236288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (358us total) trans 17179874166 rc 0/0 00000100:00100000:0.0:1746066740.919564:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14609 00000100:00100000:0.0:1746066740.919572:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14612 00000100:00100000:0.0:1746066740.919576:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984235520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066740.919611:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066740.919613:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919615:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919617:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066740.919618:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066740.919637:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984235520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (163us total) trans 17179874168 rc 0/0 00000100:00100000:0.0:1746066740.919642:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14612 00000100:00100000:0.0:1746066740.921861:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.958869:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.958967:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.963006:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.966983:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.967025:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.967070:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982715264 00000100:00100000:0.0:1746066740.967078:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982715264 00000100:00100000:0.0:1746066740.967123:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14615 00000100:00100000:0.0:1746066740.967131:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:32457:x1830882982715264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066740.967151:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066740.967169:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130801e00/0xf1867c21abfa427f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfa1d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.967193:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.967195:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066740.967202:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130801e00/0xf1867c21abfa427f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa1d expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.967215:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130801e00/0xf1867c21abfa427f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa1d expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066740.967225:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130801e00, rc 0) 00000100:00100000:0.0:1746066740.967274:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+47:32457:x1830882982715264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 144us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.967280:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14615 00000100:00100000:0.0:1746066740.968102:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066740.969503:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982715648 00000100:00100000:0.0:1746066740.969509:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982715648 00010000:00010000:0.0:1746066740.969535:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfa4239 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa0f expref: 30 pid: 7243 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746066740.969579:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6495 00000100:00100000:0.0:1746066740.969587:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982715520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066740.969597:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066740.969603:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009575aa00/0xf1867c21abfa425c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa08 expref: 11 pid: 10125 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066740.969633:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009575aa00/0xf1867c21abfa425c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa08 expref: 11 pid: 10125 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066740.969648:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066740.969651:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066740.969659:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066740.969666:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066740.969681:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066740.970001:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982715520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 412us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066740.970009:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6495 00000100:00100000:0.0:1746066740.977346:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3608 00000100:00100000:0.0:1746066740.977354:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882982716160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066741.003195:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.003413:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066741.004101:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066741.005111:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066741.006693:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066741.007079:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.007116:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066741.007717:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066741.017921:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984237568 00000100:00100000:0.0:1746066741.017925:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984237568 00000100:00100000:0.0:1746066741.017956:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984237184 00000100:00100000:0.0:1746066741.017958:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984237184 00000100:00100000:0.0:1746066741.017968:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984237696 00000100:00100000:0.0:1746066741.017969:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984237696 00000100:00100000:0.0:1746066741.017981:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14619 00000100:00100000:0.0:1746066741.017988:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3774:x1830882984237568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066741.018120:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3774:x1830882984237568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (317us total) trans 17179874171 rc 0/0 00000100:00100000:0.0:1746066741.018126:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14619 00000100:00100000:0.0:1746066741.018139:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14620 00000100:00100000:0.0:1746066741.018143:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3774:x1830882984237184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066741.018185:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066741.018188:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066741.018190:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066741.018191:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066741 -> 1746066741 00002000:00010000:0.0:1746066741.018193:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066741.018210:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3774:x1830882984237184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (378us total) trans 17179874172 rc 0/0 00000100:00100000:0.0:1746066741.018215:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14620 00000100:00100000:0.0:1746066741.018224:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14621 00000100:00100000:0.0:1746066741.018228:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3774:x1830882984237696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066741.018277:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3774:x1830882984237696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (423us total) trans 17179874173 rc 0/0 00000100:00100000:0.0:1746066741.018281:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14621 00000100:00080000:0.0:1746066741.018294:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066741.027437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.027476:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.033777:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.033857:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.039516:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.043026:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.043133:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.054445:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.054478:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066741.056275:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066741.063051:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.063092:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.063490:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.074431:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982719744 00000100:00100000:0.0:1746066741.074440:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982719744 00002000:00100000:0.0:1746066741.074489:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4612096->4616191) req@ffff880135d61880 x1830882982719744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.074500:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d61880 with x1830882982719744 ext(4612096->4616191) 00002000:00010000:0.0:1746066741.074506:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d61880 00000100:00100000:0.0:1746066741.074531:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3613 00000100:00100000:0.0:1746066741.074540:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+35:2014:x1830882982719744:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066741.074696:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+35:2014:x1830882982719744:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 156us (356us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066741.074974:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3613 00002000:00100000:0.0:1746066741.074981:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4612096->4616191) req@ffff880135d61880 x1830882982719744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/4536 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.074988:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d61880 with x1830882982719744 ext(4612096->4616191) 00002000:00010000:0.0:1746066741.074990:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d61880 00000100:00100000:0.0:1746066741.078161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.087345:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.091549:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.097640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066741.097797:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066741.098467:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.101501:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.112276:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.112356:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.112675:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.112700:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982721152 00000100:00100000:0.0:1746066741.112704:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982721152 00002000:00100000:0.0:1746066741.112735:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012faf7b80 x1830882982721152/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.112744:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7b80 with x1830882982721152 ext(2097152->4194303) 00002000:00010000:0.0:1746066741.112748:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf7b80 00000100:00100000:0.0:1746066741.112774:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982721408 00000100:00100000:0.0:1746066741.112777:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982721408 00002000:00100000:0.0:1746066741.112789:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4030463) req@ffff88012faf4380 x1830882982721408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.112795:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4380 with x1830882982721408 ext(2097152->4030463) 00002000:00010000:0.0:1746066741.112798:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf4380 00000100:00100000:0.0:1746066741.112808:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3616 00000100:00100000:0.0:1746066741.112813:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882982721152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066741.125390:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.138320:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.138380:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.143552:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982722304 00000100:00100000:0.0:1746066741.143556:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982722304 00002000:00100000:0.0:1746066741.143581:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4616191) req@ffff8800a5d7f100 x1830882982722304/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.143595:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830882982722304 ext(4194304->4616191) 00010000:00010000:0.0:1746066741.143602:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa42d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4616191) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa5c expref: 36 pid: 9592 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.143612:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa42d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4616191) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa5c expref: 36 pid: 9592 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746066741.143617:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7f100 00000100:00100000:0.0:1746066741.143637:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 759 00000100:00100000:0.0:1746066741.143641:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882982722304:12345-192.168.204.16@tcp:4:cat.0 00002000:00010000:0.0:1746066741.146530:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066741 -> 1746066742 00002000:00010000:0.0:1746066741.146533:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066741 -> 1746066742 00002000:00010000:0.0:1746066741.146536:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066741 -> 1746066742 00000100:00100000:0.0:1746066741.146550:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984240512:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066741.146583:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095751c00/0xf1867c21abfa4304 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa8d expref: 38 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066741.146594:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095751c00/0xf1867c21abfa4304 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa8d expref: 38 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066741.146620:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751c00, rc 0) 00000100:00100000:0.0:1746066741.146654:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+37:2014:x1830882982722176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3269us (3608us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066741.146660:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14644 00000001:00080000:0.0:1746066741.149141:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841602 is committed 00000001:00080000:0.0:1746066741.149158:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841601 is committed 00000001:00080000:0.0:1746066741.149190:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841583 is committed 00000001:00080000:0.0:1746066741.149209:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841570 is committed 00000100:00100000:0.0:1746066741.150142:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982722688 00000100:00100000:0.0:1746066741.150146:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982722688 00000100:00100000:0.0:1746066741.150169:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14645 00000100:00100000:0.0:1746066741.150174:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+9:32458:x1830882982722688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066741.150186:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066741.150196:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfa430b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfa94 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.150210:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066741.150211:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066741.150214:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfa430b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4616192->5033983] (req 4616192->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa94 expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.150224:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8c00/0xf1867c21abfa430b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4616192->5033983] (req 4616192->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa94 expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.150231:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8c00, rc 0) 00000100:00100000:0.0:1746066741.150246:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:32458:x1830882982722688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066741.150251:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14645 00000100:00100000:0.0:1746066741.157256:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.162289:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.166032:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.173156:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.175338:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.175754:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.178322:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.181924:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.186974:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.187052:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.202963:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.206295:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.219112:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.219193:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.255015:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.258329:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.258913:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.261061:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.266240:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.268928:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982726144:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7418us (7860us total) trans 21474841604 rc 0/0 00000100:00100000:0.0:1746066741.268939:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 761 00002000:00100000:0.0:1746066741.268950:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2711551) req@ffff880095801500 x1830882982726144/t21474841604(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/448 e 0 to 0 dl 1746066752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.268959:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801500 with x1830882982726144 ext(2097152->2711551) 00010000:00010000:0.0:1746066741.268967:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa42fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4612095] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa86 expref: 22 pid: 12255 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.268980:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa42fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4612095] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa86 expref: 22 pid: 12255 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746066741.268991:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095801500 00000100:00100000:0.0:1746066741.273259:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984241536:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066741.273283:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066741.273334:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882982726272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6183us (7104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066741.273345:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6504 00000100:00100000:0.0:1746066741.273425:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982726656 00000100:00100000:0.0:1746066741.273428:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982726656 00010000:00010000:0.0:1746066741.273446:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa42fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4612095] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa86 expref: 22 pid: 12255 timeout: 809 lvb_type: 0 00000100:00100000:0.0:1746066741.273466:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6505 00000100:00100000:0.0:1746066741.273473:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882982726656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066741.273485:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066741.273505:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa42fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->4612095] (req 2097152->2711551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa86 expref: 22 pid: 12255 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.273516:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa42fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->4612095] (req 2097152->2711551) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa86 expref: 22 pid: 12255 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.273539:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa42fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->4612095] (req 2097152->2711551) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa86 expref: 22 pid: 12255 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.273558:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066741.273560:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066741.273568:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095750a00/0xf1867c21abfa435f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfacc expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.273577:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095750a00/0xf1867c21abfa435f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfacc expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.273608:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095750a00/0xf1867c21abfa435f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfacc expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066741.273619:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095801880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984241664:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066741.276657:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066741.281582:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.284695:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.285534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.303185:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.310834:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.322951:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.322976:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982728704 00000100:00100000:0.0:1746066741.322979:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982728704 00000100:00100000:0.0:1746066741.323015:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5804 00000100:00100000:0.0:1746066741.323021:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:32462:x1830882982728704:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066741.323202:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:32462:x1830882982728704:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 181us (255us total) trans 8589936339 rc 0/0 00000100:00100000:0.0:1746066741.323209:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5804 00000100:00100000:0.0:1746066741.329515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.355188:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.370066:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.380023:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.387821:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.477200:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.486060:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.486290:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.512291:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.512339:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.512387:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.527040:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.530767:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.536205:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.540388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.540574:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.549624:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.551092:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.557302:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.560145:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.560211:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.561594:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.561634:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.563640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.564994:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984243456:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066741.565010:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066741.565042:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882982732928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3231us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066741.565050:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6511 00000100:00100000:0.0:1746066741.577501:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982733312:12345-192.168.204.16@tcp:4:cat.0 Request processed in 13151us (13853us total) trans 17179874181 rc 0/0 00000100:00100000:0.0:1746066741.577512:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 765 00002000:00100000:0.0:1746066741.577521:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2191360->3145727) req@ffff8800a4ed6d80 x1830882982733312/t17179874181(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/448 e 0 to 0 dl 1746066752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.577530:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed6d80 with x1830882982733312 ext(2191360->3145727) 00010000:00010000:0.0:1746066741.577538:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa43d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb0b expref: 41 pid: 12233 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.577552:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa43d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb0b expref: 41 pid: 12233 timeout: 809 lvb_type: 0 00002000:00010000:0.0:1746066741.577558:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ed6d80 00000100:00100000:0.0:1746066741.580470:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.580505:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.580527:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.580547:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.580871:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6514 00000100:00100000:0.0:1746066741.580877:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982734208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066741.580896:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066741.580905:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa43d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb0b expref: 41 pid: 12233 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.580912:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa43d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb0b expref: 41 pid: 12233 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.580930:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa43d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb0b expref: 41 pid: 12233 timeout: 809 lvb_type: 0 00010000:00010000:0.0:1746066741.580944:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066741.580946:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066741.580952:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa4431 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb2e expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.580959:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa4431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb2e expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.580983:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa4431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb2e expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066741.580993:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984243968:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066741.581029:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066741.584070:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.588488:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882982733952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7642us (8017us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066741.588496:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3633 00002000:00100000:0.0:1746066741.588502:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095ce2d80 x1830882982733952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/440 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.588509:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2d80 with x1830882982733952 ext(2097152->3145727) 00002000:00010000:0.0:1746066741.588512:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce2d80 00000100:00100000:0.0:1746066741.591671:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982735104 00000100:00100000:0.0:1746066741.591682:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982735104 00000100:00100000:0.0:1746066741.591726:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14664 00000100:00100000:0.0:1746066741.591733:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+11:32475:x1830882982735104:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066741.591753:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066741.591779:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfb3c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.591808:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77600/0xf1867c21abfa42f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa7f expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.591816:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa4319 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa9b expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066741.591822:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066741.591823:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066741.591827:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1171455] (req 1048576->1171455) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066741.591857:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa4319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa9b expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066741.591868:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa4319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa9b expref: 12 pid: 9592 timeout: 809 lvb_type: 1 00000100:00100000:0.0:1746066741.591880:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984244224:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066741.593116:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.595078:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.595118:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.600501:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984244480:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066741.600526:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066741.600570:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982735488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5360us (5450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066741.600580:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6517 00000100:00100000:0.0:1746066741.601536:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.601827:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.604190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.604227:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.604245:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982736768 00000100:00100000:0.0:1746066741.604251:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982736768 00000100:00100000:0.0:1746066741.604282:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5806 00000100:00100000:0.0:1746066741.604288:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:32475:x1830882982736768:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066741.604460:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+17:32475:x1830882982736768:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 171us (232us total) trans 8589936344 rc 0/0 00000100:00100000:0.0:1746066741.604467:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5806 00000100:00100000:0.0:1746066741.619287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.622581:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.630051:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3640 00000100:00100000:0.0:1746066741.630059:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882982737792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066741.648191:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.648285:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.652102:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.655235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.664236:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.664268:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.664306:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.664531:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14671 00000100:00100000:0.0:1746066741.664538:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882982738688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066741.664545:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066741.664554:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa46200/0xf1867c21abfa4470 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfb66 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066741.664594:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984245248:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066741.665055:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066741.670999:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.671053:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.686228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.695280:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.699701:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.699798:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.737101:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.751713:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.788778:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882984245888:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.788812:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066741.788837:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3776:1830882984246400:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.788865:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066741.788877:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882984246912:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.788909:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066741.788924:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066741.788929:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3776:1830882984246016:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.788945:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066741.789094:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3776:1830882984246528:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.789114:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066741.789181:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882984245888:0@lo:400:kworker.0 00000100:00080000:0.0:1746066741.789199:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746066741.789202:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746066741.789204:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746066741.789206:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066741.789223:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1746066741.789227:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3776:x1830882984246400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.789250:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3776:x1830882984246400:12345-0@lo:400:kworker.0 Request processed in 23us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066741.789255:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1746066741.789266:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1746066741.789269:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3776:x1830882984246016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.789287:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3776:x1830882984246016:12345-0@lo:400:kworker.0 Request processed in 18us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066741.789293:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1746066741.789308:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3776:1830882984246016:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.789314:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3776:1830882984246528:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.789320:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3776:1830882984246400:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.789326:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882984246912:0@lo:400:kworker.0 00000100:00100000:0.0:1746066741.799079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.803369:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.804510:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066741.804524:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984247040:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1746066741.804933:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b905f80, transno 21474841545 00000004:00080000:1.0:1746066741.804943:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b907b80, transno 21474841546 00000004:00080000:1.0:1746066741.804946:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b906300, transno 21474841547 00000004:00080000:1.0:1746066741.804948:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b904e00, transno 21474841548 00000004:00080000:1.0:1746066741.804950:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b904380, transno 21474841549 00000004:00080000:1.0:1746066741.804952:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b907100, transno 21474841550 00000004:00080000:1.0:1746066741.804954:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b905180, transno 21474841551 00000004:00080000:1.0:1746066741.804956:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b906680, transno 21474841552 00000004:00080000:1.0:1746066741.804958:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ff100, transno 21474841553 00000004:00080000:1.0:1746066741.804960:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f0e00, transno 21474841554 00000004:00080000:1.0:1746066741.804962:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e211880, transno 21474841555 00000004:00080000:1.0:1746066741.804964:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e210380, transno 21474841556 00000004:00080000:1.0:1746066741.804966:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d8ca680, transno 21474841557 00000004:00080000:1.0:1746066741.804968:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e212d80, transno 21474841558 00000004:00080000:1.0:1746066741.804970:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d8cbb80, transno 21474841559 00000004:00080000:1.0:1746066741.804971:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d8cb480, transno 21474841560 00000004:00080000:1.0:1746066741.804973:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e212300, transno 21474841561 00000004:00080000:1.0:1746066741.804975:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012faf2680, transno 21474841562 00000004:00080000:1.0:1746066741.804978:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d08700, transno 21474841571 00000004:00080000:1.0:1746066741.804981:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0ad80, transno 21474841572 00000004:00080000:1.0:1746066741.804983:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0b480, transno 21474841573 00000004:00080000:1.0:1746066741.804985:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0a680, transno 21474841574 00000004:00080000:1.0:1746066741.804987:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d09180, transno 21474841575 00000004:00080000:1.0:1746066741.804989:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d09880, transno 21474841576 00000004:00080000:1.0:1746066741.804991:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d09f80, transno 21474841577 00000004:00080000:1.0:1746066741.804993:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d08e00, transno 21474841578 00000004:00080000:1.0:1746066741.804995:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d62300, transno 21474841579 00000004:00080000:1.0:1746066741.804997:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d6300, transno 21474841584 00000004:00080000:1.0:1746066741.805000:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a6680, transno 21474841585 00000004:00080000:1.0:1746066741.805002:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d7480, transno 21474841586 00000004:00080000:1.0:1746066741.805004:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d5500, transno 21474841587 00000004:00080000:1.0:1746066741.805006:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d4e00, transno 21474841588 00000004:00080000:1.0:1746066741.805008:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d4380, transno 21474841589 00000004:00080000:1.0:1746066741.805010:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d6680, transno 21474841590 00000004:00080000:1.0:1746066741.805012:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d7c000, transno 21474841591 00000004:00080000:1.0:1746066741.805014:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a03d7100, transno 21474841592 00000004:00080000:1.0:1746066741.805017:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b0a80, transno 21474841593 00000004:00080000:1.0:1746066741.805020:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88a80, transno 21474841594 00000004:00080000:1.0:1746066741.805022:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b3100, transno 21474841595 00000004:00080000:1.0:1746066741.805024:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a8a300, transno 21474841596 00000004:00080000:1.0:1746066741.805026:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b1f80, transno 21474841597 00000004:00080000:1.0:1746066741.805028:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88000, transno 21474841598 00000004:00080000:1.0:1746066741.805030:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b3480, transno 21474841599 00000004:00080000:1.0:1746066741.805032:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a88e00, transno 21474841600 00000004:00080000:1.0:1746066741.805034:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb77480, transno 21474841601 00000100:00100000:1.0:1746066741.805044:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984247040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066741.818431:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.818489:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.819426:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982741248 00000100:00100000:1.0:1746066741.819438:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982741248 00002000:00100000:1.0:1746066741.819491:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1961983) req@ffff8800b40b5180 x1830882982741248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.819502:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b5180 with x1830882982741248 ext(1048576->1961983) 00002000:00010000:1.0:1746066741.819507:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b40b5180 00000100:00100000:1.0:1746066741.819541:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982741504 00000100:00100000:1.0:1746066741.819544:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982741504 00002000:00100000:1.0:1746066741.819559:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1171456->2097151) req@ffff8800b40b6a00 x1830882982741504/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.819565:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b6a00 with x1830882982741504 ext(1171456->2097151) 00002000:00010000:1.0:1746066741.819568:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800b40b6a00 00000100:00100000:1.0:1746066741.819578:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3643 00000100:00100000:1.0:1746066741.819587:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982741248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066741.829409:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982741248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9809us (10976us total) trans 0 rc 913408/913408 00000100:00100000:1.0:1746066741.829421:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3643 00002000:00100000:1.0:1746066741.829435:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1961983) req@ffff8800b40b5180 x1830882982741248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/440 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.829444:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b5180 with x1830882982741248 ext(1048576->1961983) 00002000:00010000:1.0:1746066741.829450:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b40b5180 00000100:00100000:0.0:1746066741.835080:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.843451:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.843507:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.843515:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982741888 00000100:00100000:1.0:1746066741.843525:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982741888 00000100:00100000:1.0:1746066741.843570:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14674 00000100:00100000:1.0:1746066741.843577:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:32481:x1830882982741888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066741.843598:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066741.843616:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfb97 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.843647:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfa4438 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb35 expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.843654:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066741.843656:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066741.843659:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 41 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.843688:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfa4438 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb35 expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.843700:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfa4438 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb35 expref: 25 pid: 12255 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066741.843712:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984247296:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066741.843793:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066741.847545:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.849672:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.849745:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.854109:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.854154:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.854813:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14677 00000100:00100000:0.0:1746066741.854822:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882982742784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066741.854830:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066741.854840:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa4526 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfbb3 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066741.854904:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984247808:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066741.854980:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066741.856813:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984247808:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066741.856842:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa4526 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbb3 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066741.857068:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa4526 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbb3 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066741.857080:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945a00, rc 0) 00000100:00100000:1.0:1746066741.857098:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882982742784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2279us (2944us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066741.857104:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14677 00000100:00100000:0.0:1746066741.858314:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.858354:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982742912 00000100:00100000:1.0:1746066741.858361:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982742912 00000100:00100000:1.0:1746066741.858402:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14678 00000100:00100000:1.0:1746066741.858409:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982742912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066741.858423:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066741.858436:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfa452d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfbba expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066741.858477:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984247936:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066741.859203:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066741.860329:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.862325:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.862850:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.866042:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6521 00000100:00100000:1.0:1746066741.866052:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982743296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066741.866059:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066741.866070:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa4431 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb2e expref: 32 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.866080:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa4431 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb2e expref: 32 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.866092:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa4431 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb2e expref: 32 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.866105:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066741.866107:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066741.866111:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa4518 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3981312->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfba5 expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.866118:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa4518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3981312->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfba5 expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.866135:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa4518 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3981312->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfba5 expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066741.866148:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984248192:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066741.866171:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066741.866426:0:12233:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880135d62300 x1830882984247936) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfa4438 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb35 expref: 31 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.866440:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009357aa00/0xf1867c21abfa4438 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1961984->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb35 expref: 31 pid: 12255 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066741.866448:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984247936:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066741.866469:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfa452d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbba expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066741.866478:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6200/0xf1867c21abfa452d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbba expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066741.866485:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f6200, rc 0) 00000100:00100000:1.0:1746066741.866523:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982742912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8113us (8209us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066741.866530:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14678 00000100:00100000:0.0:1746066741.867602:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.867673:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982743424 00000100:00100000:1.0:1746066741.867680:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982743424 00000100:00100000:1.0:1746066741.867717:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14679 00000100:00100000:1.0:1746066741.867723:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:32491:x1830882982743424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066741.867740:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066741.867762:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfbc1 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.867783:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 41 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.867790:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066741.867791:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066741.867794:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.867814:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 41 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.867825:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 41 pid: 11630 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066741.867835:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984248320:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066741.868509:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066741.870361:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.871241:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984248192:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066741.871339:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066741.872340:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982743296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6289us (9488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066741.872347:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6521 00000100:00100000:0.0:1746066741.872600:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.874392:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.874441:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3646 00000100:00100000:0.0:1746066741.874450:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882982743936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066741.874607:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984248320:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066741.874627:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.874638:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7000, rc 0) 00000100:00100000:1.0:1746066741.874654:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:32491:x1830882982743424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6931us (7055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066741.874659:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14679 00000100:00100000:0.0:1746066741.874794:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982743936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 345us (2194us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066741.874801:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3646 00002000:00100000:0.0:1746066741.874806:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3981312->3985407) req@ffff880096ecb100 x1830882982743936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/4536 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.874814:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecb100 with x1830882982743936 ext(3981312->3985407) 00002000:00010000:0.0:1746066741.874817:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ecb100 00000100:00100000:0.0:1746066741.878957:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.879048:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.879510:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982744448 00000100:00100000:1.0:1746066741.879515:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982744448 00000100:00100000:1.0:1746066741.879539:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14682 00000100:00100000:1.0:1746066741.879543:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:32481:x1830882982744448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066741.879550:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066741.879559:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4549 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfbd6 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.879584:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 11 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.879591:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066741.879592:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066741.879595:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4549 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1806335] (req 1048576->1806335) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbd6 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.879613:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 11 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.879622:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 11 pid: 12255 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066741.879630:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984248704:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066741.880293:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066741.880627:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.882033:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984248704:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066741.882058:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4549 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1806335] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbd6 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.882073:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7200, rc 0) 00000100:00100000:1.0:1746066741.882117:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+23:32481:x1830882982744448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2572us (3068us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066741.882125:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14682 00000100:00100000:0.0:1746066741.885537:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982744704 00000100:00100000:0.0:1746066741.885545:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982744704 00002000:00100000:0.0:1746066741.885582:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1171455) req@ffff880097a8a300 x1830882982744704/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.885592:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a300 with x1830882982744704 ext(1048576->1171455) 00010000:00010000:0.0:1746066741.885601:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 12 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066741.885611:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 12 pid: 12255 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746066741.885617:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a8a300 00000100:00100000:0.0:1746066741.885635:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 771 00000100:00100000:0.0:1746066741.885642:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882982744704:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066741.888657:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.889999:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982744576:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9085us (9371us total) trans 17179874183 rc 0/0 00000100:00100000:0.0:1746066741.890009:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 770 00002000:00100000:0.0:1746066741.890018:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1990656->2097151) req@ffff880096ec9180 x1830882982744576/t17179874183(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/448 e 0 to 0 dl 1746066752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.890026:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9180 with x1830882982744576 ext(1990656->2097151) 00010000:00010000:0.0:1746066741.890034:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 43 pid: 11630 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066741.890043:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 43 pid: 11630 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746066741.890048:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096ec9180 00000100:00100000:1.0:1746066741.895214:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982744704:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9558us (9748us total) trans 21474841607 rc 0/0 00000100:00100000:1.0:1746066741.895227:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 771 00002000:00100000:1.0:1746066741.895240:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1171455) req@ffff880097a8a300 x1830882982744704/t21474841607(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/448 e 0 to 0 dl 1746066752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.895249:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a300 with x1830882982744704 ext(1048576->1171455) 00010000:00010000:1.0:1746066741.895259:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 16 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.895273:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa443f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1171455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb3c expref: 16 pid: 12255 timeout: 810 lvb_type: 0 00002000:00010000:1.0:1746066741.895279:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a8a300 00000100:00100000:0.0:1746066741.896623:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.896658:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.896808:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982744960 00000100:00100000:1.0:1746066741.896814:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982744960 00010000:00010000:1.0:1746066741.896843:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa4454 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb51 expref: 23 pid: 9592 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066741.896866:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6522 00000100:00100000:1.0:1746066741.896872:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882982744960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066741.896911:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066741.896928:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa4454 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb51 expref: 23 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.896938:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa4454 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb51 expref: 23 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.896961:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa4454 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb51 expref: 23 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.896981:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066741.897368:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982744960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 494us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066741.897374:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6522 00000100:00100000:0.0:1746066741.897402:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.897413:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982745344 00000100:00100000:1.0:1746066741.897416:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982745344 00010000:00010000:1.0:1746066741.897427:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 43 pid: 11630 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066741.897441:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6523 00000100:00100000:1.0:1746066741.897446:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982745344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066741.897455:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066741.897467:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 43 pid: 11630 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.897474:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 43 pid: 11630 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.897489:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310f6000/0xf1867c21abfa44ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfb97 expref: 43 pid: 11630 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.897499:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066741.897500:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066741.897507:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.897515:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066741.897546:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066741.897557:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984249088:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066741.897603:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066741.903548:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.903579:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.903984:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984249088:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066741.904001:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066741.904040:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982745344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6593us (6637us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066741.904047:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6523 00000100:00100000:0.0:1746066741.904839:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.904911:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982745984 00000100:00100000:1.0:1746066741.904914:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982745984 00002000:00100000:1.0:1746066741.904946:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096eca680 x1830882982745984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.904955:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096eca680 with x1830882982745984 ext(1048576->2097151) 00002000:00010000:1.0:1746066741.904959:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096eca680 00000100:00100000:1.0:1746066741.904980:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3647 00000100:00100000:1.0:1746066741.904986:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982745984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066741.915583:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.915620:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.916090:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982745984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11101us (11249us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066741.916102:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3647 00002000:00100000:1.0:1746066741.916116:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096eca680 x1830882982745984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/440 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.916125:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096eca680 with x1830882982745984 ext(1048576->2097151) 00002000:00010000:1.0:1746066741.916131:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096eca680 00000100:00100000:0.0:1746066741.916468:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982746240 00000100:00100000:0.0:1746066741.916477:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982746240 00002000:00100000:0.0:1746066741.916516:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (4751360->4755455) req@ffff880135d62300 x1830882982746240/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.916524:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62300 with x1830882982746240 ext(4751360->4755455) 00002000:00010000:0.0:1746066741.916527:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d62300 00000100:00100000:0.0:1746066741.916542:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982746496 00000100:00100000:0.0:1746066741.916545:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982746496 00002000:00100000:0.0:1746066741.916557:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1802240->1806335) req@ffff8800a4ed7b80 x1830882982746496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.916562:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7b80 with x1830882982746496 ext(1802240->1806335) 00002000:00010000:0.0:1746066741.916565:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed7b80 00000100:00100000:0.0:1746066741.916577:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3648 00000100:00100000:0.0:1746066741.916582:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982746240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066741.916690:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982746240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 108us (1119us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066741.916695:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3648 00002000:00100000:0.0:1746066741.916699:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (4751360->4755455) req@ffff880135d62300 x1830882982746240/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/4536 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.916704:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62300 with x1830882982746240 ext(4751360->4755455) 00002000:00010000:0.0:1746066741.916707:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d62300 00000100:00100000:0.0:1746066741.916718:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3649 00000100:00100000:0.0:1746066741.916722:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982746496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066741.916779:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982746496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 55us (1158us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066741.916784:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3649 00002000:00100000:0.0:1746066741.916789:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1802240->1806335) req@ffff8800a4ed7b80 x1830882982746496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/4536 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066741.916795:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7b80 with x1830882982746496 ext(1802240->1806335) 00002000:00010000:0.0:1746066741.918692:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed7b80 00000100:00100000:0.0:1746066741.927188:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.934724:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.936493:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982747008 00000100:00100000:1.0:1746066741.936508:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982747008 00002000:00100000:1.0:1746066741.936561:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1806336->2097151) req@ffff880096ecbb80 x1830882982747008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.936572:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecbb80 with x1830882982747008 ext(1806336->2097151) 00002000:00010000:1.0:1746066741.936578:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecbb80 00000100:00100000:1.0:1746066741.936614:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3650 00000100:00100000:1.0:1746066741.936622:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882982747008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066741.947201:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882982747008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10566us (12478us total) trans 0 rc 290816/290816 00000100:00100000:1.0:1746066741.947214:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3650 00002000:00100000:1.0:1746066741.947229:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1806336->2097151) req@ffff880096ecbb80 x1830882982747008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/440 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 290816/290816 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.947240:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecbb80 with x1830882982747008 ext(1806336->2097151) 00002000:00010000:1.0:1746066741.947246:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecbb80 00000100:00100000:0.0:1746066741.950239:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.950294:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.952195:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14685 00000100:00100000:1.0:1746066741.952204:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982747136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066741.952222:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066741.952232:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfa455e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfbe4 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066741.952257:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984249600:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066741.952558:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066741.953850:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984249600:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066741.953863:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfa455e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbe4 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066741.953870:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801310f7c00/0xf1867c21abfa455e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbe4 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066741.953902:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7c00, rc 0) 00000100:00100000:1.0:1746066741.953997:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982747136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1793us (3701us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066741.954003:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14685 00000100:00100000:0.0:1746066741.955933:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.959598:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.959667:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982747520 00000100:00100000:1.0:1746066741.959676:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982747520 00002000:00100000:1.0:1746066741.959722:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4755455) req@ffff880096ec8000 x1830882982747520/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.959732:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8000 with x1830882982747520 ext(4194304->4755455) 00010000:00010000:1.0:1746066741.959742:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfa4550 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbdd expref: 13 pid: 11630 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.959764:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfa4550 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbdd expref: 13 pid: 11630 timeout: 810 lvb_type: 0 00002000:00010000:1.0:1746066741.959771:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ec8000 00000100:00100000:1.0:1746066741.960027:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 772 00000100:00100000:1.0:1746066741.960035:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982747520:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066741.966642:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982747520:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6593us (7038us total) trans 21474841608 rc 0/0 00000100:00100000:1.0:1746066741.966657:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 772 00002000:00100000:1.0:1746066741.966671:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4755455) req@ffff880096ec8000 x1830882982747520/t21474841608(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/448 e 0 to 0 dl 1746066752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.966688:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8000 with x1830882982747520 ext(4194304->4755455) 00010000:00010000:1.0:1746066741.966700:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfa4550 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbdd expref: 15 pid: 11630 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.966717:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984ba000/0xf1867c21abfa4550 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4755455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbdd expref: 15 pid: 11630 timeout: 810 lvb_type: 0 00002000:00010000:1.0:1746066741.966724:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096ec8000 00000100:00100000:0.0:1746066741.971174:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.975929:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.975989:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982747904 00000100:00100000:1.0:1746066741.975996:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982747904 00002000:00100000:1.0:1746066741.976036:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098482a00 x1830882982747904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.976046:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098482a00 with x1830882982747904 ext(2097152->3145727) 00002000:00010000:1.0:1746066741.976051:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098482a00 00000100:00100000:1.0:1746066741.976173:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3651 00000100:00100000:1.0:1746066741.976181:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882982747904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066741.981671:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882982747904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5478us (5729us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066741.981683:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3651 00002000:00100000:1.0:1746066741.981848:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098482a00 x1830882982747904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:147/0 lens 488/440 e 0 to 0 dl 1746066752 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.981858:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098482a00 with x1830882982747904 ext(2097152->3145727) 00002000:00010000:1.0:1746066741.981865:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098482a00 00000100:00100000:0.0:1746066741.985307:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066741.987596:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066741.987671:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982748160 00000100:00100000:1.0:1746066741.987677:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982748160 00002000:00100000:1.0:1746066741.987716:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3981312->4194303) req@ffff880098483100 x1830882982748160/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/0 e 0 to 0 dl 1746066752 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.987726:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098483100 with x1830882982748160 ext(3981312->4194303) 00010000:00010000:1.0:1746066741.987733:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa4518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3981312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfba5 expref: 27 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.987744:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa4518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3981312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfba5 expref: 27 pid: 12255 timeout: 810 lvb_type: 0 00002000:00010000:1.0:1746066741.987762:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098483100 00000100:00100000:1.0:1746066741.987785:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 773 00000100:00100000:1.0:1746066741.987791:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982748160:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066741.990011:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982748160:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2208us (2405us total) trans 17179874184 rc 0/0 00000100:00100000:1.0:1746066741.990021:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 773 00002000:00100000:1.0:1746066741.990030:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3981312->4194303) req@ffff880098483100 x1830882982748160/t17179874184(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:147/0 lens 488/448 e 0 to 0 dl 1746066752 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066741.990039:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098483100 with x1830882982748160 ext(3981312->4194303) 00010000:00010000:1.0:1746066741.990046:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa4518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3981312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfba5 expref: 29 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066741.990057:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa4518 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3981312->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfba5 expref: 29 pid: 12255 timeout: 810 lvb_type: 0 00002000:00010000:1.0:1746066741.990064:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098483100 00000100:00100000:0.0:1746066741.991263:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.001664:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.002109:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.002218:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982748544 00000100:00100000:1.0:1746066742.002229:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982748544 00002000:00100000:1.0:1746066742.002279:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880098480700 x1830882982748544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.002290:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480700 with x1830882982748544 ext(2097152->4194303) 00002000:00010000:1.0:1746066742.002296:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098480700 00000100:00100000:1.0:1746066742.002500:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982748800 00000100:00100000:1.0:1746066742.002504:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982748800 00002000:00100000:1.0:1746066742.002520:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880098481880 x1830882982748800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.002528:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098481880 with x1830882982748800 ext(3145728->4194303) 00002000:00010000:1.0:1746066742.002531:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098481880 00000100:00100000:1.0:1746066742.002695:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3652 00000100:00100000:1.0:1746066742.002704:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882982748544:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066742.027131:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.027207:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982749056 00000100:00100000:0.0:1746066742.027216:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982749056 00000100:00100000:0.0:1746066742.027274:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16058 00000100:00100000:0.0:1746066742.027282:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:32497:x1830882982749056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066742.027307:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.027327:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfa4573 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc00 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.027404:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027417:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027428:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027439:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027445:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027450:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027553:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa4588 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027562:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa4588 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027568:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa4588 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066742.027576:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066742.027650:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027656:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027661:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027667:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027672:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a2000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066742.027675:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027681:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027694:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066742.027697:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066742.027702:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027707:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa457a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027731:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027736:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027741:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027745:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a3e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066742.027758:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027762:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027768:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0f300) 00010000:00010000:0.0:1746066742.027770:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066742.027772:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027776:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3e00/0xf1867c21abfa4581 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066742.027817:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3c00/0xf1867c21abfa4573 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc00 expref: 25 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.027829:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa4588 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc00 expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.027834:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066742.027836:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066742.027838:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a3800, rc 0) 00000100:00100000:0.0:1746066742.027912:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:32497:x1830882982749056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 629us (789us total) trans 8589936354 rc 0/0 00000100:00100000:0.0:1746066742.027919:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16058 00000100:00100000:1.0:1746066742.034342:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882982748544:12345-192.168.204.16@tcp:3:cat.0 Request processed in 31625us (32676us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066742.034355:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3652 00002000:00100000:1.0:1746066742.034368:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880098480700 x1830882982748544/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.034378:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480700 with x1830882982748544 ext(2097152->4194303) 00002000:00010000:1.0:1746066742.034385:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098480700 00000100:00100000:0.0:1746066742.037313:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.039199:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.039226:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.039251:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.039281:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982749696 00000100:00100000:0.0:1746066742.039284:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982749696 00000100:00100000:0.0:1746066742.039305:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14689 00000100:00100000:0.0:1746066742.039310:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882982749440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066742.039318:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.039327:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71a00/0xf1867c21abfa459d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc0e expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.039366:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984250240:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066742.039425:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.039443:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14690 00000100:00100000:0.0:1746066742.039448:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982749696:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066742.039455:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.039462:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70200/0xf1867c21abfa45a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc1c expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.039472:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.039474:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.039478:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70200/0xf1867c21abfa45a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc1c expref: 30 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.039489:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70200/0xf1867c21abfa45a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc1c expref: 30 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.039496:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70200, rc 0) 00000100:00100000:0.0:1746066742.039511:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982749696:12345-192.168.204.16@tcp:101:cat.0 Request processed in 63us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.039516:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14690 00000100:00100000:0.0:1746066742.039838:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.048987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.054996:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.055076:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982750208 00000100:00100000:1.0:1746066742.055086:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982750208 00002000:00100000:1.0:1746066742.055129:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098480380 x1830882982750208/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.055140:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480380 with x1830882982750208 ext(1048576->2097151) 00002000:00010000:1.0:1746066742.055146:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098480380 00000100:00100000:1.0:1746066742.055176:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3655 00000100:00100000:1.0:1746066742.055183:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982750208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066742.068023:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982750208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12827us (13024us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066742.068036:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3655 00002000:00100000:1.0:1746066742.068048:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098480380 x1830882982750208/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.068059:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480380 with x1830882982750208 ext(1048576->2097151) 00002000:00010000:1.0:1746066742.068066:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098480380 00000100:00100000:0.0:1746066742.073233:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.075166:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.075251:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982750592 00000100:00100000:1.0:1746066742.075262:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982750592 00000100:00100000:1.0:1746066742.076001:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5812 00000100:00100000:1.0:1746066742.076008:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:32491:x1830882982750592:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066742.076175:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:32491:x1830882982750592:12345-192.168.204.16@tcp:35:cat.0 Request processed in 167us (1017us total) trans 8589936355 rc 0/0 00000100:00100000:1.0:1746066742.076181:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5812 00000100:00100000:0.0:1746066742.079340:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.079778:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982750720 00000100:00100000:1.0:1746066742.079790:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982750720 00002000:00100000:1.0:1746066742.079835:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1806335) req@ffff880098482680 x1830882982750720/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.079845:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098482680 with x1830882982750720 ext(1048576->1806335) 00010000:00010000:1.0:1746066742.079854:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbd6 expref: 23 pid: 12233 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.079868:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbd6 expref: 23 pid: 12233 timeout: 810 lvb_type: 0 00002000:00010000:1.0:1746066742.079875:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098482680 00000100:00100000:1.0:1746066742.080158:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 774 00000100:00100000:1.0:1746066742.080166:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882982750720:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066742.092346:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982750720:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12171us (13007us total) trans 21474841609 rc 0/0 00000100:00100000:1.0:1746066742.092357:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 774 00002000:00100000:1.0:1746066742.092375:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1806335) req@ffff880098482680 x1830882982750720/t21474841609(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/448 e 0 to 0 dl 1746066753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.092389:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098482680 with x1830882982750720 ext(1048576->1806335) 00010000:00010000:1.0:1746066742.092398:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbd6 expref: 25 pid: 12233 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.092413:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4549 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbd6 expref: 25 pid: 12233 timeout: 810 lvb_type: 0 00002000:00010000:1.0:1746066742.092435:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098482680 00000100:00100000:0.0:1746066742.108196:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.113741:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.113828:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982751104 00000100:00100000:1.0:1746066742.113837:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982751104 00002000:00100000:1.0:1746066742.113895:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009666ce00 x1830882982751104/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.113911:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ce00 with x1830882982751104 ext(1048576->2097151) 00002000:00010000:1.0:1746066742.113916:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666ce00 00000100:00100000:1.0:1746066742.113943:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3656 00000100:00100000:1.0:1746066742.113949:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982751104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066742.153074:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.160742:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.160805:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.160844:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982751872 00000100:00100000:0.0:1746066742.160853:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982751872 00000100:00100000:0.0:1746066742.160921:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16059 00000100:00100000:0.0:1746066742.160931:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:32500:x1830882982751872:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066742.160960:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.160980:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa45b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc2a expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.161064:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161080:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161091:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161104:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161110:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161115:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161215:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70400/0xf1867c21abfa45ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161224:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70400/0xf1867c21abfa45ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161232:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70400/0xf1867c21abfa45ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:0.0:1746066742.161241:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066742.161311:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161316:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161321:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161326:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161331:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097019200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066742.161334:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161340:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161349:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066742.161351:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066742.161354:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161358:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097019200/0xf1867c21abfa45c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161373:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161377:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161385:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161388:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d70600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066742.161390:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161393:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161397:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0fa00) 00010000:00010000:0.0:1746066742.161399:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066742.161400:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161404:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa45c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.161438:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa45b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc2a expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.161447:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70400/0xf1867c21abfa45ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc2a expref: 40 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.161452:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066742.161453:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066742.161455:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70400, rc 0) 00000100:00100000:0.0:1746066742.161497:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:32500:x1830882982751872:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 568us (691us total) trans 8589936356 rc 0/0 00000100:00100000:0.0:1746066742.161502:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16059 00000100:00100000:1.0:1746066742.180692:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982752512 00000100:00100000:1.0:1746066742.180696:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982752512 00000100:00100000:1.0:1746066742.180736:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16060 00000100:00100000:1.0:1746066742.180741:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:32502:x1830882982752512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066742.180762:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.180775:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2cc00/0xf1867c21abfa45dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc31 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.180829:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180840:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180849:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180860:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180866:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180872:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180980:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa45f1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180988:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa45f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.180994:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa45f1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066742.181002:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066742.181039:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181046:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181051:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181056:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181061:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2c000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066742.181064:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181069:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181075:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066742.181077:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066742.181080:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181088:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2c000/0xf1867c21abfa45e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181243:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181250:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181254:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181258:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2da00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066742.181261:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181265:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181272:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096476600) 00010000:00010000:1.0:1746066742.181274:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066742.181276:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181280:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa45ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.181309:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2cc00/0xf1867c21abfa45dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc31 expref: 26 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.181319:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa45f1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc31 expref: 25 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.181329:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.181331:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066742.181334:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2ca00, rc 0) 00000100:00100000:1.0:1746066742.181368:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:32502:x1830882982752512:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 627us (1371us total) trans 8589936358 rc 0/0 00000100:00100000:1.0:1746066742.181374:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16060 00000100:00100000:1.0:1746066742.187383:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.210475:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.210528:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.219187:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.221833:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.221858:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982753536 00000100:00100000:1.0:1746066742.221861:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982753536 00002000:00100000:1.0:1746066742.221901:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1953792->1957887) req@ffff8800a4ed4000 x1830882982753536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.221910:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed4000 with x1830882982753536 ext(1953792->1957887) 00002000:00010000:1.0:1746066742.221915:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed4000 00000100:00100000:1.0:1746066742.221926:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3660 00000100:00100000:1.0:1746066742.221935:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982753536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066742.223233:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982753536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1299us (1398us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066742.223240:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3660 00002000:00100000:1.0:1746066742.223246:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1953792->1957887) req@ffff8800a4ed4000 x1830882982753536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/4536 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.223253:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed4000 with x1830882982753536 ext(1953792->1957887) 00002000:00010000:1.0:1746066742.223258:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed4000 00000100:00100000:1.0:1746066742.227826:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.228984:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.230084:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.230824:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.232255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.232339:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982754176 00000100:00100000:0.0:1746066742.232344:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982754176 00000100:00100000:0.0:1746066742.232366:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14696 00000100:00100000:0.0:1746066742.232371:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882982754176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066742.232380:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.232388:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa4614 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc4d expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.232413:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984251648:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066742.232445:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.237133:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984251264:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066742.237142:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984251520:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066742.237164:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->2285567] (req 2097152->2285567) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 17 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.237179:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d600, rc 0) 00000100:00100000:0.0:1746066742.237197:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+17:32502:x1830882982754048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6246us (6374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.237204:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14695 00000100:00100000:1.0:1746066742.237341:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.237377:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.237405:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982754304 00000100:00100000:1.0:1746066742.237411:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982754304 00010000:00010000:1.0:1746066742.237435:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa45ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc15 expref: 17 pid: 12255 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.237453:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6533 00000100:00100000:1.0:1746066742.237458:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982754304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.237469:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.237487:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa45ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc15 expref: 17 pid: 12255 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.237496:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa45ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc15 expref: 17 pid: 12255 timeout: 810 lvb_type: 1 00002000:00010000:0.0:1746066742.237568:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066741 -> 1746066743 00002000:00010000:0.0:1746066742.237572:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066741 -> 1746066743 00002000:00010000:0.0:1746066742.237574:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066741 -> 1746066743 00000100:00100000:0.0:1746066742.237589:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984251648:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066742.237612:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa4614 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc4d expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.237623:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa4614 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc4d expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.237635:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70000, rc 0) 00000100:00100000:0.0:1746066742.237654:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882982754176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5284us (5399us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066742.237660:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14696 00010000:00010000:1.0:1746066742.237997:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa45ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc15 expref: 17 pid: 12255 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.238017:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.238019:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.238025:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.238041:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.238074:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.238085:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984251776:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066742.239380:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.241650:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.242368:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984251776:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066742.242389:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.243195:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982754304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5735us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.243205:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6533 00000100:00100000:0.0:1746066742.243644:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.243664:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982754816 00000100:00100000:0.0:1746066742.243667:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982754816 00000100:00100000:0.0:1746066742.243690:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14697 00000100:00100000:0.0:1746066742.243695:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982754816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066742.243704:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.243720:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfa461b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc54 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.243773:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984251904:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066742.243825:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.245571:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.247363:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984251904:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066742.247396:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfa461b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc54 expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.247410:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70e00/0xf1867c21abfa461b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc54 expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.247421:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70e00, rc 0) 00000100:00100000:1.0:1746066742.247466:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982754816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3770us (3822us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066742.247475:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14697 00000100:00100000:0.0:1746066742.251878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.251979:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.252144:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982755328 00000100:00100000:1.0:1746066742.252155:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982755328 00002000:00100000:1.0:1746066742.252202:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff88009666c380 x1830882982755328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.252212:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c380 with x1830882982755328 ext(5029888->5033983) 00002000:00010000:1.0:1746066742.252217:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666c380 00000100:00100000:1.0:1746066742.252608:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3663 00000100:00100000:1.0:1746066742.252615:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982755328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066742.252770:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982755328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 154us (902us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066742.252776:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3663 00002000:00100000:1.0:1746066742.252782:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff88009666c380 x1830882982755328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/4536 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.252789:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c380 with x1830882982755328 ext(5029888->5033983) 00002000:00010000:1.0:1746066742.252792:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666c380 00000100:00100000:0.0:1746066742.259791:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.275069:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.275619:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982755968 00000100:00100000:1.0:1746066742.275628:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982755968 00000100:00100000:1.0:1746066742.275824:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16061 00000100:00100000:1.0:1746066742.275834:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:32507:x1830882982755968:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066742.275859:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.275878:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfa4622 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc5b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.275968:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.275984:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.275996:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.276009:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.276014:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.276019:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.276087:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.276096:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa24 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.276103:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.276131:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa24 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.276142:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa24 expref: 39 pid: 10125 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.276154:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984252032:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.276251:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.278148:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984252032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066742.278148:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.278322:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066742.279512:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.279635:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982756352 00000100:00100000:1.0:1746066742.279639:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982756352 00010000:00010000:1.0:1746066742.279662:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa24 expref: 41 pid: 10125 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.279693:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6535 00000100:00100000:1.0:1746066742.279699:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982756352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.279711:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.279717:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa24 expref: 41 pid: 10125 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.279727:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa24 expref: 41 pid: 10125 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.279759:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa428d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa24 expref: 41 pid: 10125 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.279783:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.279788:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279796:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279803:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279826:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066742.279837:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279844:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066742.279880:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066742.279907:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066742.279923:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279932:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279942:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279947:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279952:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279958:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279963:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0153800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066742.279966:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279973:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279984:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066742.279987:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066742.279990:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.279994:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa4629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280004:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280008:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280012:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280016:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0152600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066742.280018:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280021:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280027:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096476300) 00010000:00010000:1.0:1746066742.280029:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066742.280031:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280034:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa4630 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.280060:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfa4622 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc5b expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.280072:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc5b expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.280078:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.280080:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066742.280082:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152400, rc 0) 00000100:00100000:1.0:1746066742.280112:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32507:x1830882982755968:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4280us (5053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.280118:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16061 00000100:00100000:1.0:1746066742.280147:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882982756352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 448us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.280153:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6535 00000100:00100000:0.0:1746066742.282925:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.282995:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982756480 00000100:00100000:1.0:1746066742.283002:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982756480 00000100:00100000:1.0:1746066742.283045:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14698 00000100:00100000:1.0:1746066742.283051:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982756480:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066742.283069:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.283084:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa463e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc62 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.283134:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984252160:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066742.283230:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.284200:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982756608 00000100:00100000:0.0:1746066742.284204:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982756608 00000100:00100000:0.0:1746066742.284236:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14699 00000100:00100000:0.0:1746066742.284242:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982756608:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066742.284251:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.284260:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc69 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.284279:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.284281:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.284290:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.284305:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.284315:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70600, rc 0) 00000100:00100000:0.0:1746066742.284351:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982756608:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 109us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.284357:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14699 00000100:00100000:0.0:1746066742.284856:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.285302:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984252160:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066742.285323:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa463e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc62 expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.285337:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153a00/0xf1867c21abfa463e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc62 expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.285347:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0153a00, rc 0) 00000100:00100000:1.0:1746066742.285365:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982756480:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2314us (2447us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066742.285371:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14698 00000100:00100000:0.0:1746066742.286355:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.287378:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.287681:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982756992 00000100:00100000:1.0:1746066742.287685:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982756992 00000100:00100000:1.0:1746066742.287708:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14702 00000100:00100000:1.0:1746066742.287713:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982756992:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066742.287720:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.287729:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa465a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc7e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.287740:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.287742:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.287761:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa465a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc7e expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.287775:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa465a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc7e expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.287785:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57000, rc 0) 00000100:00100000:1.0:1746066742.287805:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982756992:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 92us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.287812:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14702 00000100:00100000:0.0:1746066742.292230:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.292495:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982757248 00000100:00100000:1.0:1746066742.292504:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982757248 00000100:00100000:1.0:1746066742.292557:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16062 00000100:00100000:1.0:1746066742.292564:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32507:x1830882982757248:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066742.292583:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.292599:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa4661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfc85 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.292704:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfa4668 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.292719:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc5b expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.292725:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf56c00/0xf1867c21abfa4668 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066742.292768:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc5b expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.292780:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa4637 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc5b expref: 9 pid: 7245 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.292791:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984252544:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.292866:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.296635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.300648:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.302543:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.304326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.304360:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.304385:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.304409:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.304434:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982758016 00000100:00100000:0.0:1746066742.304441:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982758016 00000100:00100000:0.0:1746066742.304479:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982757888 00000100:00100000:0.0:1746066742.304482:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982757888 00000100:00100000:0.0:1746066742.304496:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982758272 00000100:00100000:0.0:1746066742.304498:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982758272 00000100:00100000:0.0:1746066742.304507:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982758144 00000100:00100000:0.0:1746066742.304509:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982758144 00000100:00100000:0.0:1746066742.304521:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14703 00000100:00100000:0.0:1746066742.304527:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982758016:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066742.304563:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa4692 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.304579:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa4606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc3f expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.304586:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066742.304588:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066742.304591:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa4692 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.304617:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa4606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1613823) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc3f expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.304629:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa4606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1613823) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc3f expref: 42 pid: 9592 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746066742.304642:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984252800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066742.304707:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.304763:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14706 00000100:00100000:1.0:1746066742.304769:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982758144:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066742.304871:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.304964:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.304971:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.304978:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa4596 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc07 expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066742.305103:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.305129:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.305130:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.305133:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.305210:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa4596 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc07 expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.305217:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa4596 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc07 expref: 28 pid: 11630 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.305225:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984253312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.305639:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.305648:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 14 pid: 9592 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.305656:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984253568:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066742.305658:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.305678:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.305685:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4534 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbc1 expref: 42 pid: 12233 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.305692:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984253696:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.305709:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.305721:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982758528 00000100:00100000:1.0:1746066742.305724:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982758528 00000100:00100000:1.0:1746066742.305741:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14708 00000100:00100000:1.0:1746066742.305756:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982758528:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066742.305770:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.305779:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895400/0xf1867c21abfa456c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbf9 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.305785:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa465a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc7e expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.305792:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70200/0xf1867c21abfa45a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc1c expref: 28 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.305797:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.305798:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.305800:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.305811:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70200/0xf1867c21abfa45a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc1c expref: 28 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.305817:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70200/0xf1867c21abfa45a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc1c expref: 28 pid: 13363 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.305824:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984253824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.305864:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa465a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc7e expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.305872:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa465a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc7e expref: 15 pid: 12233 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.305879:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984253952:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.306517:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895400/0xf1867c21abfa456c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbf9 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.306531:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895400/0xf1867c21abfa456c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfbf9 expref: 42 pid: 11630 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.306540:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984254080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.307202:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.309702:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984253312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.309710:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984253568:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.310445:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984253696:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.310461:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.310789:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984253824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.310797:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984253952:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.310804:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984254080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.310817:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.316439:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.316477:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.316503:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.316978:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.317462:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982758784 00000100:00100000:0.0:1746066742.317464:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.317475:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982758784 00000100:00100000:0.0:1746066742.317483:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.317492:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982759424 00000100:00100000:1.0:1746066742.317495:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982759424 00000100:00100000:0.0:1746066742.317502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.317536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.318019:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 16 pid: 9592 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.318039:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6540 00000100:00100000:1.0:1746066742.318045:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982759424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.318053:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.318061:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 16 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.318069:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 16 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.318080:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa4645 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc69 expref: 16 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.318099:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.318825:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982759424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 779us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.318831:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6540 00010000:00010000:1.0:1746066742.318857:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130801e00/0xf1867c21abfa427f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa1d expref: 23 pid: 12255 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746066742.318857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.318901:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982759296 00000100:00100000:1.0:1746066742.318904:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982759296 00010000:00010000:1.0:1746066742.318914:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa4596 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc07 expref: 29 pid: 11630 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.318927:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6542 00000100:00100000:1.0:1746066742.318932:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882982758784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.318938:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.318945:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130801e00/0xf1867c21abfa427f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa1d expref: 23 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.318954:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130801e00/0xf1867c21abfa427f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa1d expref: 23 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.318966:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130801e00/0xf1867c21abfa427f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa1d expref: 23 pid: 12255 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.318975:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.318991:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882982758784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 59us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.318997:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6542 00000100:00100000:1.0:1746066742.319007:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6544 00000100:00100000:1.0:1746066742.319012:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982759040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.319018:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.319025:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa41ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9d7 expref: 13 pid: 9590 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.319033:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa41ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9d7 expref: 13 pid: 9590 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.319043:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa41ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cf9d7 expref: 13 pid: 9590 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.319056:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.319057:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.319060:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfa4699 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319066:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d400/0xf1867c21abfa4699 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319080:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.319095:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982759040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.319100:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6544 00010000:00010000:1.0:1746066742.319118:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319125:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319140:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319147:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319154:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319166:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097393400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066742.319170:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319178:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319187:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.319192:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097393400/0xf1867c21abfa46a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.319231:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982758144:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 14462us (14821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.319239:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14706 00000100:00100000:0.0:1746066742.319648:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982759680 00000100:00100000:0.0:1746066742.319652:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982759680 00002000:00100000:0.0:1746066742.319669:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2285567) req@ffff880097a8b800 x1830882982759680/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.319677:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882982759680 ext(2097152->2285567) 00010000:00010000:0.0:1746066742.319682:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 17 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.319690:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 17 pid: 9592 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746066742.319695:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a8b800 00000100:00100000:0.0:1746066742.319714:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 777 00000100:00100000:0.0:1746066742.319720:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882982759680:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:0.0:1746066742.320180:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320188:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320206:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320212:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320217:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320223:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097017e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066742.320225:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320232:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320241:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.320251:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa46b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.320295:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982758528:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 14539us (14635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.320303:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14708 00000100:00100000:0.0:1746066742.327132:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982759680:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7399us (7555us total) trans 21474841611 rc 0/0 00000100:00100000:0.0:1746066742.327144:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 777 00002000:00100000:0.0:1746066742.327157:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2285567) req@ffff880097a8b800 x1830882982759680/t21474841611(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/448 e 0 to 0 dl 1746066753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.327167:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882982759680 ext(2097152->2285567) 00010000:00010000:0.0:1746066742.327177:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 21 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.327188:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 21 pid: 9592 timeout: 810 lvb_type: 0 00002000:00010000:0.0:1746066742.327195:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a8b800 00000100:00100000:0.0:1746066742.330270:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.330477:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982760192 00000100:00100000:1.0:1746066742.330485:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982760192 00010000:00010000:1.0:1746066742.330509:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 19 pid: 9592 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.330539:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6546 00000100:00100000:1.0:1746066742.330547:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982760192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.330559:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.330577:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 19 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.330587:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 19 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.330609:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d600/0xf1867c21abfa460d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2285567) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc46 expref: 19 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.330623:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.330625:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.330630:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa46ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.330638:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa46ae lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.330668:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.330685:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882982760192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.330690:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6546 00000100:00100000:1.0:1746066742.337644:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982760320 00000100:00100000:1.0:1746066742.337655:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982760320 00010000:00010000:1.0:1746066742.337695:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895200/0xf1867c21abfa45ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc38 expref: 18 pid: 9592 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.337738:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6547 00000100:00100000:1.0:1746066742.337755:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982760320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.337770:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.337791:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d895200/0xf1867c21abfa45ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc38 expref: 18 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.337804:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d895200/0xf1867c21abfa45ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc38 expref: 18 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.337828:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895200/0xf1867c21abfa45ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc38 expref: 18 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.337842:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.337844:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.337849:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfa46a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.337858:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894800/0xf1867c21abfa46a0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.337914:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.337959:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982760320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 215us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.337966:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6547 00000100:00100000:0.0:1746066742.340627:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.341313:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982760448 00000100:00100000:1.0:1746066742.341322:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982760448 00010000:00010000:1.0:1746066742.341365:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa4606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc3f expref: 43 pid: 9592 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.341402:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6548 00000100:00100000:1.0:1746066742.341410:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882982760448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.341425:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.341443:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa4606 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc3f expref: 43 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.341454:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa4606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1613823) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc3f expref: 43 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.341478:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa4606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->1613823) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc3f expref: 43 pid: 9592 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.341492:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.341494:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.341498:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa4692 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.341506:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa4692 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.341539:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.341580:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982760448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 171us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.341587:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6548 00000100:00100000:0.0:1746066742.343815:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.346453:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.348610:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.349301:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982760960 00000100:00100000:1.0:1746066742.349308:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982760960 00010000:00010000:1.0:1746066742.349333:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa42c5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa4e expref: 40 pid: 17253 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.349476:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6550 00000100:00100000:1.0:1746066742.349484:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882982760960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.349494:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.349499:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa42c5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa4e expref: 40 pid: 17253 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.349508:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa42c5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa4e expref: 40 pid: 17253 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.349524:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa42c5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa4e expref: 40 pid: 17253 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.349539:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.349543:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152e00/0xf1867c21abfa46bc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.349550:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.350211:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982760960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 567us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.350218:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6550 00000100:00100000:0.0:1746066742.352970:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.353013:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.353051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.353121:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982761344 00000100:00100000:1.0:1746066742.353125:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982761344 00010000:00010000:1.0:1746066742.353142:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa4343 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfab7 expref: 26 pid: 7243 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.353160:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6551 00000100:00100000:1.0:1746066742.353166:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982761088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.353179:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.353185:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa42b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa40 expref: 26 pid: 10125 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.353196:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa42b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa40 expref: 26 pid: 10125 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.353706:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa42b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfa40 expref: 26 pid: 10125 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.354141:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.354146:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.354180:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982761088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1013us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.354187:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6551 00000100:00100000:1.0:1746066742.383829:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984254976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.383871:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.383912:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984255488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.383927:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.383940:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.383952:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.383962:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1746066742.383968:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984255104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.383979:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.383988:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984255616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.383999:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.384008:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.384019:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.384039:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984254976 00000100:00100000:1.0:1746066742.384044:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984254976 00000100:00100000:1.0:1746066742.384066:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984255488 00000100:00100000:1.0:1746066742.384067:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984255488 00000100:00100000:1.0:1746066742.384077:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984256000 00000100:00100000:1.0:1746066742.384078:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984256000 00000100:00100000:1.0:1746066742.384084:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984255104 00000100:00100000:1.0:1746066742.384086:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984255104 00000100:00100000:1.0:1746066742.384091:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984255616 00000100:00100000:1.0:1746066742.384093:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984255616 00000100:00100000:1.0:1746066742.384098:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984256128 00000100:00100000:1.0:1746066742.384100:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984256128 00000100:00100000:1.0:1746066742.384107:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14715 00000100:00100000:1.0:1746066742.384113:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3776:x1830882984254976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.384223:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882984254976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (352us total) trans 21474841614 rc 0/0 00000100:00100000:1.0:1746066742.384228:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14715 00000100:00100000:1.0:1746066742.384239:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14716 00000100:00100000:1.0:1746066742.384243:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882984255488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.384300:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984255488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (371us total) trans 17179874190 rc 0/0 00000100:00100000:1.0:1746066742.384305:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14716 00000100:00100000:1.0:1746066742.384313:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14717 00000100:00100000:1.0:1746066742.384317:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882984256000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.384361:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984256000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (408us total) trans 17179874191 rc 0/0 00000100:00100000:1.0:1746066742.384366:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14717 00000100:00100000:1.0:1746066742.384374:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14718 00000100:00100000:1.0:1746066742.384378:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3776:x1830882984255104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.384421:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882984255104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (440us total) trans 21474841615 rc 0/0 00000100:00100000:1.0:1746066742.384425:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14718 00000100:00100000:1.0:1746066742.384434:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14719 00000100:00100000:1.0:1746066742.384437:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882984255616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.384479:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984255616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (478us total) trans 17179874192 rc 0/0 00000100:00100000:1.0:1746066742.384483:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14719 00000100:00100000:1.0:1746066742.384490:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14720 00000100:00100000:1.0:1746066742.384494:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3776:x1830882984256128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.384536:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984256128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (515us total) trans 17179874193 rc 0/0 00000100:00100000:1.0:1746066742.384541:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14720 00000004:00080000:1.0:1746066742.384564:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098924e00/2, rc 0, transno 21474841615 00000100:00100000:1.0:1746066742.384567:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984255104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066742.384574:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d7100/2, rc 0, transno 17179874192 00000100:00100000:1.0:1746066742.384576:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984255616:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066742.384582:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012faf2680/2, rc 0, transno 17179874193 00000100:00100000:1.0:1746066742.384584:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066742.384589:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098924380/2, rc 0, transno 21474841614 00000100:00100000:1.0:1746066742.384592:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984254976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066742.384597:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d5500/2, rc 0, transno 17179874190 00000100:00100000:1.0:1746066742.384600:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984255488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066742.384605:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d5880/2, rc 0, transno 17179874191 00000100:00100000:1.0:1746066742.384608:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.384651:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.384668:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.384683:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984256512 00000100:00100000:1.0:1746066742.384686:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984256512 00000100:00100000:1.0:1746066742.384699:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14721 00000100:00100000:1.0:1746066742.384703:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882984256512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.384785:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882984256512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (116us total) trans 21474841616 rc 0/0 00000100:00100000:1.0:1746066742.384790:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14721 00000004:00080000:1.0:1746066742.384807:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098927b80/2, rc 0, transno 21474841616 00000100:00100000:1.0:1746066742.384810:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.384820:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984256384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.384836:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.384850:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984256384 00000100:00100000:1.0:1746066742.384853:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984256384 00000100:00100000:1.0:1746066742.384863:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14722 00000100:00100000:1.0:1746066742.384867:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984256384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066742.384927:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:1.0:1746066742.384930:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.384932:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066742.384934:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.384936:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:1.0:1746066742.384956:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882984256384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (119us total) trans 21474841617 rc 0/0 00000100:00100000:1.0:1746066742.384961:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14722 00000004:00080000:1.0:1746066742.384979:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098926d80/2, rc 0, transno 21474841617 00000100:00100000:1.0:1746066742.384983:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984256384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.385003:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746066742.385008:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.385023:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.385037:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984256640 00000100:00100000:1.0:1746066742.385039:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984256640 00000100:00100000:1.0:1746066742.385050:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14723 00000100:00100000:1.0:1746066742.385053:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3776:x1830882984256640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066742.385090:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066742.385093:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066742.385095:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066742.385096:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066742.385098:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:1.0:1746066742.385116:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3776:x1830882984256640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (92us total) trans 21474841618 rc 0/0 00000100:00100000:1.0:1746066742.385120:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14723 00000004:00080000:1.0:1746066742.385135:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a89c00/2, rc 0, transno 21474841618 00000100:00100000:1.0:1746066742.385137:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984256640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.385163:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984256896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.385180:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.385189:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746066742.385193:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984256768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.385205:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.385217:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984256896 00000100:00100000:1.0:1746066742.385220:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984256896 00000100:00100000:1.0:1746066742.385228:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984256768 00000100:00100000:1.0:1746066742.385229:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984256768 00000100:00100000:1.0:1746066742.385235:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14724 00000100:00100000:1.0:1746066742.385239:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984256896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.385292:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984256896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (112us total) trans 21474841619 rc 0/0 00000100:00100000:1.0:1746066742.385296:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14724 00000100:00100000:1.0:1746066742.385303:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14725 00000100:00100000:1.0:1746066742.385306:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984256768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066742.385335:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:1.0:1746066742.385337:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.385339:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066742.385340:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.385342:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:1.0:1746066742.385356:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984256768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (150us total) trans 21474841620 rc 0/0 00000100:00100000:1.0:1746066742.385360:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14725 00000004:00080000:1.0:1746066742.385375:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5c700/2, rc 0, transno 21474841620 00000100:00100000:1.0:1746066742.385377:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984256768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066742.385382:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5ce00/2, rc 0, transno 21474841619 00000100:00100000:1.0:1746066742.385384:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984256896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.385870:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.394219:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.399119:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.400835:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.417054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.417386:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.422955:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.424587:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.425854:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16070 00000100:00100000:1.0:1746066742.425862:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:32518:x1830882982763136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.425873:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.425879:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa4741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfcb6 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.425935:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066742.425943:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066742.425952:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066742.425960:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066742.426046:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70600/0xf1867c21abfa4741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcb6 expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.426063:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcb6 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.426070:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.426073:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746066742.426075:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.426080:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.426084:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00000100:00100000:1.0:1746066742.426105:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:32518:x1830882982763136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 245us (1520us total) trans 8589936369 rc 0/0 00000100:00100000:1.0:1746066742.426114:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16070 00000100:00100000:0.0:1746066742.431684:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982763904 00000100:00100000:0.0:1746066742.431695:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982763904 00000100:00100000:0.0:1746066742.431772:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14731 00000100:00100000:0.0:1746066742.431780:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982763904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066742.431802:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.431823:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfa4756 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfce0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066742.431846:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd36, atime: 0x6812dd36, ctime: 0x6812dd36, blocks: 0x1000 00010000:00010000:0.0:1746066742.431867:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.431869:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.431878:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfa4756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce0 expref: 30 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.431912:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfa4756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce0 expref: 30 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.431924:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a200, rc 0) 00000100:00100000:0.0:1746066742.431983:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982763904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 203us (3363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.431990:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14731 00000100:00100000:0.0:1746066742.440448:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982764544 00000100:00100000:0.0:1746066742.440460:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982764544 00010000:00010000:0.0:1746066742.440508:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899000/0xf1867c21abfa4702 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfca8 expref: 30 pid: 7245 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746066742.440541:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6554 00000100:00100000:0.0:1746066742.440549:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982764544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066742.440564:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066742.440569:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899000/0xf1867c21abfa4702 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfca8 expref: 30 pid: 7245 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.440581:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899000/0xf1867c21abfa4702 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfca8 expref: 30 pid: 7245 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.440604:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066742.440608:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.440616:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.440621:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066742.441158:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982764544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 606us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.441167:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6554 00000100:00100000:1.0:1746066742.442663:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982764416 00000100:00100000:1.0:1746066742.442668:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982764416 00000100:00100000:0.0:1746066742.443330:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.443513:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982764800 00000100:00100000:1.0:1746066742.443517:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982764800 00000100:00100000:1.0:1746066742.443535:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14737 00000100:00100000:1.0:1746066742.443540:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982764800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.443547:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066742.443551:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.443554:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa4780 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd03 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.443563:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.443564:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.443569:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa4780 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd03 expref: 26 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066742.443569:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982764672 00000100:00100000:0.0:1746066742.443574:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982764672 00010000:00010000:1.0:1746066742.443577:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa4780 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd03 expref: 26 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.443582:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894000, rc 0) 00010000:00010000:0.0:1746066742.443597:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa46f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfca1 expref: 11 pid: 7244 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.443600:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882982764800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.443605:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14737 00000100:00100000:0.0:1746066742.443616:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6555 00000100:00100000:0.0:1746066742.443621:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982764672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066742.443632:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066742.443637:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa46f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfca1 expref: 11 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.443646:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa46f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfca1 expref: 11 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.443662:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa46f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfca1 expref: 11 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.443680:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066742.443685:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.443692:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.443697:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.443713:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066742.443734:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982764672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.443752:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6555 00000100:00100000:0.0:1746066742.443803:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.443852:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982765056 00000100:00100000:1.0:1746066742.443855:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982765056 00000100:00100000:1.0:1746066742.443897:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16071 00000100:00100000:1.0:1746066742.443902:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:32519:x1830882982765056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.443911:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.443920:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa478e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd11 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.443951:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa478e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd11 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.443960:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa478e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd11 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.443973:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.443976:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066742.443979:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895c00, rc 0) 00000100:00100000:1.0:1746066742.443999:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:32519:x1830882982765056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.444003:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16071 00000100:00100000:0.0:1746066742.465093:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.465450:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.465791:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3664 00000100:00100000:1.0:1746066742.465804:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882982765312:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066742.467143:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.470796:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.479839:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.479872:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.479925:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.479937:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.479984:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982766464 00000100:00100000:0.0:1746066742.479990:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982766464 00002000:00100000:0.0:1746066742.480023:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800966e3100 x1830882982766464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.480032:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3100 with x1830882982766464 ext(0->1048575) 00002000:00010000:0.0:1746066742.480036:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3100 00000100:00100000:0.0:1746066742.480049:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982766592 00000100:00100000:0.0:1746066742.480051:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982766592 00002000:00100000:0.0:1746066742.480060:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800966e0700 x1830882982766592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.480066:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0700 with x1830882982766592 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.480069:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e0700 00000100:00100000:0.0:1746066742.480076:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982766976 00000100:00100000:0.0:1746066742.480078:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982766976 00002000:00100000:0.0:1746066742.480086:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800966e2300 x1830882982766976/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.480097:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882982766976 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.480100:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:0.0:1746066742.480107:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982766848 00000100:00100000:0.0:1746066742.480109:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982766848 00002000:00100000:0.0:1746066742.480116:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800966e3480 x1830882982766848/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.480122:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882982766848 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.480124:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e3480 00000100:00100000:0.0:1746066742.480136:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3668 00000100:00100000:0.0:1746066742.480142:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982766464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066742.480753:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882982765568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14921us (15290us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066742.480759:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3665 00002000:00100000:0.0:1746066742.480765:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf1c00 x1830882982765568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.480771:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1c00 with x1830882982765568 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.480774:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1c00 00000100:00100000:0.0:1746066742.480789:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3669 00000100:00100000:0.0:1746066742.480794:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982766592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066742.508673:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982766464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 28530us (28839us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066742.508679:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3668 00002000:00100000:0.0:1746066742.508685:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800966e3100 x1830882982766464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.508691:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3100 with x1830882982766464 ext(0->1048575) 00002000:00010000:0.0:1746066742.508694:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3100 00000100:00100000:0.0:1746066742.527772:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982767488 00000100:00100000:0.0:1746066742.527779:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982767488 00000100:00100000:1.0:1746066742.527794:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982767616 00000100:00100000:1.0:1746066742.527802:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982767616 00010000:00010000:0.0:1746066742.527805:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcb6 expref: 29 pid: 7243 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.527826:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfa46c3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc9a expref: 10 pid: 7244 timeout: 810 lvb_type: 0 00000100:00100000:0.0:1746066742.527826:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6556 00000100:00100000:0.0:1746066742.527832:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882982767488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066742.527845:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066742.527850:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6557 00010000:00010000:0.0:1746066742.527851:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcb6 expref: 29 pid: 7243 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.527857:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982767616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066742.527861:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcb6 expref: 29 pid: 7243 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.527868:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.527873:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfa46c3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc9a expref: 10 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.527899:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70c00/0xf1867c21abfa4748 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcb6 expref: 29 pid: 7243 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.527907:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfa46c3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc9a expref: 10 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.527926:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bac00/0xf1867c21abfa46c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfc9a expref: 10 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:0.0:1746066742.527927:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066742.527931:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0200/0xf1867c21abfa479c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.527941:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0200/0xf1867c21abfa479c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066742.527947:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0200/0xf1867c21abfa479c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.528024:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.528028:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.528049:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982767616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 193us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.528056:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6557 00010000:00010000:0.0:1746066742.528466:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066742.528500:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982767488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 667us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.528506:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6556 00000100:00100000:1.0:1746066742.530677:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982767744 00000100:00100000:1.0:1746066742.530685:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982767744 00000100:00100000:1.0:1746066742.530722:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16073 00000100:00100000:1.0:1746066742.530730:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:32518:x1830882982767744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.530762:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.530779:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b39800/0xf1867c21abfa47a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd1f expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.530827:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0200/0xf1867c21abfa479c lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.530836:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b39800/0xf1867c21abfa47a3 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd1f expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.530852:0:10125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0200/0xf1867c21abfa479c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.530866:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b39800/0xf1867c21abfa47a3 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd1f expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.530877:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.530880:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066742.530901:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4b39800/0xf1867c21abfa47a3 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd1f expref: 29 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.530908:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b39800, rc 0) 00000100:00100000:1.0:1746066742.531082:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:32518:x1830882982767744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 351us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.531188:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16073 00000100:00100000:1.0:1746066742.535104:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984257536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535177:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535234:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535259:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535284:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746066742.535291:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984257664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535315:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535337:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535351:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535371:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984257920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535387:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535398:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984258432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535414:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535426:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746066742.535430:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984257792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535448:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535459:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984258304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.535470:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.535487:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984258048 00000100:00100000:1.0:1746066742.535490:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984258048 00000100:00100000:0.0:1746066742.535633:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.535657:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.536925:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984259072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.536946:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.536956:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066742.536960:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.536972:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.536978:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984259200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.536989:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.537020:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984258432 00000100:00100000:0.0:1746066742.537023:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984258432 00000100:00100000:0.0:1746066742.537036:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984257792 00000100:00100000:0.0:1746066742.537039:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984257792 00000100:00100000:0.0:1746066742.537045:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984258304 00000100:00100000:0.0:1746066742.537046:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984258304 00000100:00100000:0.0:1746066742.537052:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984258560 00000100:00100000:0.0:1746066742.537054:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984258560 00000100:00100000:0.0:1746066742.537061:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984259072 00000100:00100000:0.0:1746066742.537062:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984259072 00000100:00100000:0.0:1746066742.537068:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984258688 00000100:00100000:0.0:1746066742.537070:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984258688 00000100:00100000:0.0:1746066742.537075:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984259200 00000100:00100000:0.0:1746066742.537077:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984259200 00000100:00100000:0.0:1746066742.537085:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14739 00000100:00100000:0.0:1746066742.537091:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984258048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066742.537142:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066742.537145:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066742.537147:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066742.537148:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066742.537150:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:0.0:1746066742.537168:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984258048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1909us total) trans 21474841622 rc 0/0 00000100:00100000:0.0:1746066742.537173:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14739 00000100:00100000:0.0:1746066742.537185:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14741 00000100:00100000:0.0:1746066742.537189:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984258176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.537239:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984258176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (1886us total) trans 21474841624 rc 0/0 00000100:00100000:0.0:1746066742.537244:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14741 00000100:00100000:0.0:1746066742.537253:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14743 00000100:00100000:0.0:1746066742.537257:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984258432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066742.537298:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:0.0:1746066742.537300:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066742.537302:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066742.537304:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066742.537305:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:0.0:1746066742.537322:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984258432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1907us total) trans 21474841626 rc 0/0 00000100:00100000:0.0:1746066742.537327:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14743 00000100:00100000:0.0:1746066742.537337:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14745 00000100:00100000:0.0:1746066742.537341:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984258304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066742.537374:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066742.537376:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066742.537378:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066742.537380:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066742.537382:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:0.0:1746066742.537397:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984258304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1927us total) trans 21474841628 rc 0/0 00000100:00100000:0.0:1746066742.537402:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14745 00000100:00100000:0.0:1746066742.537410:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14747 00000100:00100000:0.0:1746066742.537414:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882984259072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066742.537451:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066742.537453:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066742.537455:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066742.537457:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066742.537459:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066742.537475:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882984259072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (528us total) trans 17179874195 rc 0/0 00000100:00100000:0.0:1746066742.537480:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14747 00000100:00100000:0.0:1746066742.537489:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14749 00000100:00100000:0.0:1746066742.537493:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882984259200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.539002:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882984259200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1505us (2008us total) trans 17179874196 rc 0/0 00000100:00100000:0.0:1746066742.539009:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14749 00000100:00100000:1.0:1746066742.539067:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984258816 00000100:00100000:1.0:1746066742.539073:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984258816 00000100:00100000:1.0:1746066742.539111:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14751 00000100:00100000:1.0:1746066742.539118:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3774:x1830882984258816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066742.539190:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066742.539193:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066742 -> 1746066742 00002000:00010000:1.0:1746066742.539195:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066742 -> 1746066742 00002000:00010000:1.0:1746066742.539197:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066742 -> 1746066742 00002000:00010000:1.0:1746066742.539198:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746066742.539230:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882984258816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (1630us total) trans 17179874199 rc 0/0 00000100:00100000:1.0:1746066742.539237:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14751 00000004:00080000:0.0:1746066742.540022:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5fb80/2, rc 0, transno 21474841627 00000100:00100000:0.0:1746066742.540046:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984257792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.540061:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5c000/2, rc 0, transno 21474841628 00000100:00100000:0.0:1746066742.540065:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984258304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.540074:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5ca80/2, rc 0, transno 21474841625 00000100:00100000:0.0:1746066742.540078:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984257920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.540087:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5e300/2, rc 0, transno 21474841626 00000100:00100000:0.0:1746066742.540090:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984258432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.540117:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e2d80/2, rc 0, transno 17179874197 00000100:00100000:0.0:1746066742.540121:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066742.540130:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e1180/2, rc 0, transno 17179874196 00000100:00100000:0.0:1746066742.540133:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984259200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066742.540141:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e1500/2, rc 0, transno 17179874194 00000100:00100000:0.0:1746066742.540144:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066742.540153:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e2680/2, rc 0, transno 17179874195 00000100:00100000:0.0:1746066742.540155:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984259072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066742.540166:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5d880/2, rc 0, transno 21474841623 00000100:00100000:0.0:1746066742.540169:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984257664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.540178:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5d500/2, rc 0, transno 21474841624 00000100:00100000:0.0:1746066742.540181:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.540190:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5f480/2, rc 0, transno 21474841621 00000100:00100000:0.0:1746066742.540193:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984257536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.540202:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5c380/2, rc 0, transno 21474841622 00000100:00100000:0.0:1746066742.540206:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984258048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.540604:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066742.540616:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984259712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.540653:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066742.541210:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677d880/2, rc 0, transno 21474841629 00000100:00100000:1.0:1746066742.541215:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984259712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.542223:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.542468:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982767872 00000100:00100000:1.0:1746066742.542474:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982767872 00000100:00100000:1.0:1746066742.542838:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16074 00000100:00100000:1.0:1746066742.542846:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:32519:x1830882982767872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.542864:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.542904:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa47aa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd26 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.542960:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa47aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd26 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.542973:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0400/0xf1867c21abfa47aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd26 expref: 12 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.542991:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.542993:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066742.542997:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0400, rc 0) 00000100:00100000:1.0:1746066742.543044:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:32519:x1830882982767872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 199us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.543049:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16074 00000100:00100000:0.0:1746066742.543415:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.555079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.555107:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.555138:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.555213:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.555253:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982768384 00000100:00100000:0.0:1746066742.555262:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982768384 00002000:00100000:0.0:1746066742.555311:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf1f80 x1830882982768384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.555322:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1f80 with x1830882982768384 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.555327:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1f80 00000100:00100000:0.0:1746066742.555357:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982768640 00000100:00100000:0.0:1746066742.555360:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982768640 00002000:00100000:0.0:1746066742.555371:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c490380 x1830882982768640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.555378:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882982768640 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.555381:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c490380 00000100:00100000:0.0:1746066742.555390:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982768896 00000100:00100000:0.0:1746066742.555392:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982768896 00002000:00100000:0.0:1746066742.555403:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c492a00 x1830882982768896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.555413:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492a00 with x1830882982768896 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.555416:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c492a00 00000100:00100000:0.0:1746066742.555427:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3672 00000100:00100000:0.0:1746066742.555435:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882982768384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066742.573003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.573020:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.573037:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982769152 00000100:00100000:0.0:1746066742.573044:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982769152 00002000:00100000:0.0:1746066742.573075:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012c491880 x1830882982769152/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.573082:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491880 with x1830882982769152 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.573085:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491880 00000100:00100000:0.0:1746066742.573095:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982769408 00000100:00100000:0.0:1746066742.573097:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982769408 00002000:00100000:0.0:1746066742.573105:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c491500 x1830882982769408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.573111:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491500 with x1830882982769408 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.573114:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491500 00000100:00100000:0.0:1746066742.573123:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3675 00000100:00100000:0.0:1746066742.573129:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982769152:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066742.580054:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.581176:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.581199:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.581220:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982769920 00000100:00100000:1.0:1746066742.581228:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982769920 00010000:00010000:1.0:1746066742.581265:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa4710 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcbd expref: 22 pid: 9592 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.581290:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982769792 00000100:00100000:1.0:1746066742.581292:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982769792 00010000:00010000:1.0:1746066742.581300:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa4764 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce7 expref: 27 pid: 1893 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.581319:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6558 00000100:00100000:1.0:1746066742.581327:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882982769920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.581342:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.581363:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa4710 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcbd expref: 22 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.581373:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa4710 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcbd expref: 22 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.581398:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.581439:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882982769920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.581445:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6558 00000100:00100000:1.0:1746066742.581462:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6559 00000100:00100000:1.0:1746066742.581466:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982769792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.581474:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.581480:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa4764 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce7 expref: 27 pid: 1893 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.581489:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa4764 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce7 expref: 27 pid: 1893 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.581500:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.581502:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.581509:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.581518:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.581546:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.581558:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984260096:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066742.581604:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.581819:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882982768384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26384us (26710us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066742.581827:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3672 00002000:00100000:1.0:1746066742.581834:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf1f80 x1830882982768384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.581844:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1f80 with x1830882982768384 ext(1048576->2097151) 00002000:00010000:1.0:1746066742.581848:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1f80 00000100:00100000:1.0:1746066742.581860:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982769664 00000100:00100000:1.0:1746066742.581862:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982769664 00002000:00100000:1.0:1746066742.581879:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009677c000 x1830882982769664/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.581903:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c000 with x1830882982769664 ext(1048576->2097151) 00002000:00010000:1.0:1746066742.581906:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c000 00000100:00100000:1.0:1746066742.581917:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3677 00000100:00100000:1.0:1746066742.581922:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982769664:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066742.593693:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984260096:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066742.593714:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.593764:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882982769792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12296us (12562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.593775:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6559 00000100:00100000:0.0:1746066742.597954:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.603784:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982769664:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 21850us (23729us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066742.603801:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3677 00002000:00100000:0.0:1746066742.603813:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009677c000 x1830882982769664/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.603822:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c000 with x1830882982769664 ext(1048576->2097151) 00002000:00010000:0.0:1746066742.603828:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c000 00000100:00100000:0.0:1746066742.610206:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.610297:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.610604:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14757 00000100:00100000:1.0:1746066742.610611:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:32516:x1830882982770432:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066742.610621:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.610639:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd3b expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.610664:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa4717 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcc4 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.610672:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa475d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcee expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.610677:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.610679:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.610682:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1052671] (req 1048576->1052671) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.610699:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa475d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcee expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.610709:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa475d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcee expref: 44 pid: 9592 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.610718:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984260352:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.610802:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa4717 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcc4 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.610809:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa4717 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcc4 expref: 31 pid: 9591 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.610817:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984260480:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.610833:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.616330:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984260352:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.616344:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984260480:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.616375:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1052671] (req 1048576->1052671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.616393:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6800, rc 0) 00000100:00100000:1.0:1746066742.616439:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:32516:x1830882982770432:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5827us (6139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.616448:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14757 00000100:00100000:0.0:1746066742.620189:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.620297:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982770560 00000100:00100000:1.0:1746066742.620306:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982770560 00010000:00010000:1.0:1746066742.620343:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa475d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcee expref: 45 pid: 9592 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.620377:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6560 00000100:00100000:1.0:1746066742.620384:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882982770560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.620398:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.620417:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa475d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcee expref: 45 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.620428:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa475d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcee expref: 45 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.620450:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa475d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcee expref: 45 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.621848:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.621874:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982770560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1489us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.621892:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6560 00000100:00100000:1.0:1746066742.625089:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.626696:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.626718:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.628261:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3681 00000100:00100000:0.0:1746066742.628271:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982771456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066742.636366:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.636405:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.639207:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3683 00000100:00100000:1.0:1746066742.639222:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982771968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066742.653240:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982771456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24970us (26519us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066742.653247:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3681 00002000:00100000:1.0:1746066742.653253:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012c493800 x1830882982771456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.653262:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493800 with x1830882982771456 ext(2097152->4194303) 00002000:00010000:1.0:1746066742.653268:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c493800 00000100:00100000:1.0:1746066742.670634:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982771968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 31404us (34216us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066742.670647:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3683 00002000:00100000:1.0:1746066742.670660:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012c492d80 x1830882982771968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.670670:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492d80 with x1830882982771968 ext(2097152->4194303) 00002000:00010000:1.0:1746066742.670677:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c492d80 00000100:00100000:0.0:1746066742.674705:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.674822:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982772224 00000100:00100000:1.0:1746066742.674832:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982772224 00002000:00100000:1.0:1746066742.674912:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490000 x1830882982772224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.674923:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490000 with x1830882982772224 ext(4194304->5033983) 00002000:00010000:1.0:1746066742.674929:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490000 00000100:00100000:1.0:1746066742.674961:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3684 00000100:00100000:1.0:1746066742.674968:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982772224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066742.683321:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.685802:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.685923:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982772480 00000100:00100000:1.0:1746066742.685928:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982772480 00000100:00100000:1.0:1746066742.685960:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14759 00000100:00100000:1.0:1746066742.685966:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882982772480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.685976:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.685987:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa47cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd49 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.686016:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984260864:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066742.686064:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.686637:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982772224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11667us (11940us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066742.686645:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3684 00002000:00100000:1.0:1746066742.686653:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490000 x1830882982772224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.686662:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490000 with x1830882982772224 ext(4194304->5033983) 00002000:00010000:1.0:1746066742.686666:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490000 00002000:00010000:1.0:1746066742.690631:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066741 -> 1746066743 00000100:00100000:1.0:1746066742.690644:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984260864:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066742.690666:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa47cd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd49 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.690680:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa47cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd49 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.691610:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5771c00, rc 0) 00000100:00100000:1.0:1746066742.691674:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882982772480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5706us (5873us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066742.691683:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14759 00000100:00100000:0.0:1746066742.698924:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.699022:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.699036:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982772736 00000100:00100000:1.0:1746066742.699047:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982772736 00002000:00100000:1.0:1746066742.699096:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490700 x1830882982772736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.699106:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882982772736 ext(4194304->5033983) 00002000:00010000:1.0:1746066742.699111:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:1.0:1746066742.699151:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3685 00000100:00100000:1.0:1746066742.699159:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882982772736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066742.704830:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882982772736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5658us (5940us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066742.704842:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3685 00002000:00100000:1.0:1746066742.704854:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490700 x1830882982772736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/440 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.704865:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882982772736 ext(4194304->5033983) 00002000:00010000:1.0:1746066742.704870:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:0.0:1746066742.711222:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.711244:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.711672:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.711835:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14761 00000100:00100000:1.0:1746066742.711844:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982773248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.711852:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.711862:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa47db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd57 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.711907:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984261248:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066742.712286:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.716363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.716988:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984261248:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066742.717006:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa47db lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd57 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.717016:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa47db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd57 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.717114:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5771c00, rc 0) 00000100:00100000:1.0:1746066742.717138:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982773248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5296us (5892us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066742.717143:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14761 00000100:00100000:0.0:1746066742.719469:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.719518:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982773632 00000100:00100000:1.0:1746066742.719524:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982773632 00000100:00100000:1.0:1746066742.719569:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14763 00000100:00100000:1.0:1746066742.719575:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:32518:x1830882982773632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.719592:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.719607:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa47e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd65 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.719624:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.719626:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.719634:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa47e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd65 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.719648:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa47e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd65 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.719657:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5771200, rc 0) 00000100:00100000:1.0:1746066742.719700:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:32518:x1830882982773632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 123us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.719706:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14763 00000100:00100000:0.0:1746066742.720847:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.720903:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982773760 00000100:00100000:1.0:1746066742.720908:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982773760 00010000:00010000:1.0:1746066742.720925:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfa472c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcd9 expref: 20 pid: 9592 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.720952:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6563 00000100:00100000:1.0:1746066742.720957:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982773760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.720965:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.720981:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfa472c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcd9 expref: 20 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.720991:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfa472c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcd9 expref: 20 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.721007:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899600/0xf1867c21abfa472c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcd9 expref: 20 pid: 9592 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.721019:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.721020:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.721025:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 24 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.721032:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 24 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.721057:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 24 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.721068:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984261504:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066742.721149:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.723082:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.723118:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.723142:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.723168:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982773888 00000100:00100000:1.0:1746066742.723177:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982773888 00000100:00100000:1.0:1746066742.723211:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982774016 00000100:00100000:1.0:1746066742.723213:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982774016 00000100:00100000:1.0:1746066742.723225:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982774144 00000100:00100000:1.0:1746066742.723227:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982774144 00000100:00100000:1.0:1746066742.723258:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14764 00000100:00100000:1.0:1746066742.723265:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882982773888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066742.723284:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.723300:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa47f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd6c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.723349:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984261632:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066742.723414:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.723446:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984261504:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066742.723459:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.723938:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882982773760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2978us (3093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.723948:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6563 00000100:00100000:0.0:1746066742.725423:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.725746:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982774400 00000100:00100000:1.0:1746066742.725752:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982774400 00002000:00100000:1.0:1746066742.725784:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2867200->2871295) req@ffff88009d8c9180 x1830882982774400/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.725794:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9180 with x1830882982774400 ext(2867200->2871295) 00002000:00010000:1.0:1746066742.725798:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9180 00000100:00100000:1.0:1746066742.725827:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3686 00000100:00100000:1.0:1746066742.725834:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982774400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066742.725976:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982774400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 141us (554us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066742.725982:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3686 00002000:00100000:1.0:1746066742.725987:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2867200->2871295) req@ffff88009d8c9180 x1830882982774400/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/4536 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.725994:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9180 with x1830882982774400 ext(2867200->2871295) 00002000:00010000:1.0:1746066742.725997:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9180 00000100:00100000:0.0:1746066742.729062:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.730585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.736875:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.737101:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.737236:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982774912 00000100:00100000:1.0:1746066742.737240:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982774912 00010000:00010000:1.0:1746066742.737259:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfa4756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce0 expref: 30 pid: 9591 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.737289:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6564 00000100:00100000:1.0:1746066742.737295:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982774912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.737304:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.737320:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfa4756 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce0 expref: 30 pid: 9591 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.737329:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfa4756 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce0 expref: 30 pid: 9591 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.737355:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a200/0xf1867c21abfa4756 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfce0 expref: 30 pid: 9591 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.737376:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.737399:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982774912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.737404:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6564 00000100:00100000:0.0:1746066742.739668:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.739836:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982775296 00000100:00100000:1.0:1746066742.739843:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982775296 00010000:00010000:1.0:1746066742.739867:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa4772 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd0a expref: 45 pid: 9590 timeout: 810 lvb_type: 1 00000100:00100000:1.0:1746066742.739925:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6565 00000100:00100000:1.0:1746066742.739932:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882982775296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.739942:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.739957:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa4772 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd0a expref: 45 pid: 9590 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.739968:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa4772 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd0a expref: 45 pid: 9590 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.739987:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa4772 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd0a expref: 45 pid: 9590 timeout: 810 lvb_type: 1 00010000:00010000:1.0:1746066742.740005:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.740044:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.740055:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 44 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.740068:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 44 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.740101:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 44 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.740112:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984262144:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066742.740194:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.747840:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984262144:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066742.747864:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.747936:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982775296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8003us (8273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.747947:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6565 00000100:00100000:0.0:1746066742.748992:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.749191:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982775552 00000100:00100000:1.0:1746066742.749199:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982775552 00002000:00100000:1.0:1746066742.749236:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2805760->2809855) req@ffff88009d8c9500 x1830882982775552/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.749246:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9500 with x1830882982775552 ext(2805760->2809855) 00002000:00010000:1.0:1746066742.749251:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c9500 00000100:00100000:1.0:1746066742.749280:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3688 00000100:00100000:1.0:1746066742.749287:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982775552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066742.750417:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982775552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1125us (1423us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066742.750428:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3688 00002000:00100000:1.0:1746066742.750435:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2805760->2809855) req@ffff88009d8c9500 x1830882982775552/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/4536 e 0 to 0 dl 1746066753 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.750442:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9500 with x1830882982775552 ext(2805760->2809855) 00002000:00010000:1.0:1746066742.750447:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c9500 00000100:00100000:0.0:1746066742.753572:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.766671:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.768698:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.770263:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.770343:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982776320 00000100:00100000:1.0:1746066742.770349:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982776320 00010000:00010000:1.0:1746066742.770376:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcaf expref: 12 pid: 7244 timeout: 810 lvb_type: 0 00000100:00100000:1.0:1746066742.770411:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6566 00000100:00100000:1.0:1746066742.770417:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982776320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.770430:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.770435:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcaf expref: 12 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.770447:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcaf expref: 12 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.770468:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895200/0xf1867c21abfa473a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcaf expref: 12 pid: 7244 timeout: 810 lvb_type: 0 00010000:00010000:1.0:1746066742.770487:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066742.770491:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfa4821 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.770500:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfa4821 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.770506:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7dbac00/0xf1867c21abfa4821 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066742.770535:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.770565:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982776320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.770571:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6566 00000100:00100000:0.0:1746066742.773285:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.773326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.773352:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.773491:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14770 00000100:00100000:1.0:1746066742.773499:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882982776704:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066742.773506:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.773515:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa482f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfd9d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.773528:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.773530:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746066742.773535:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.773537:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa482f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd9d expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.773556:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa482f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd9d expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.773564:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f600, rc 0) 00000100:00100000:1.0:1746066742.773597:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882982776704:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 101us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.773601:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14770 00000100:00100000:1.0:1746066742.773611:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982776832 00000100:00100000:1.0:1746066742.773613:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982776832 00000100:00100000:1.0:1746066742.773625:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14771 00000100:00100000:1.0:1746066742.773635:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882982776832:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066742.773642:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.773651:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa483d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfda4 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.773663:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.773664:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.773668:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa483d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfda4 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.773676:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa483d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfda4 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.773682:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00000100:00100000:1.0:1746066742.773699:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882982776832:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.773704:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14771 00000100:00100000:0.0:1746066742.773725:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.773788:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.773997:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14773 00000100:00100000:0.0:1746066742.774004:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882982777088:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066742.774010:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066742.774017:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b46fc00/0xf1867c21abfa484b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfdb2 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.774041:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984262656:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066742.774082:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38540 going to sleep for 11 seconds 00002000:00010000:0.0:1746066742.775638:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066742 -> 1746066743 00002000:00010000:0.0:1746066742.775642:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066742 -> 1746066743 00002000:00010000:0.0:1746066742.775644:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066742 -> 1746066743 00000100:00100000:0.0:1746066742.775655:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984262656:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066742.775670:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b46fc00/0xf1867c21abfa484b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfdb2 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.775679:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b46fc00/0xf1867c21abfa484b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfdb2 expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.775701:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46fc00, rc 0) 00000100:00100000:0.0:1746066742.775720:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882982777088:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1717us (1932us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066742.775726:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14773 00000100:00100000:0.0:1746066742.777752:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.780607:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.783789:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.787630:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.791118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.791166:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.792431:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.792811:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.793198:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14775 00000100:00100000:1.0:1746066742.793207:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982777984:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066742.793214:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.793225:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfa487c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfdce expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.793250:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984263168:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066742.793282:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.795766:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984263168:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066742.795791:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfa487c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfdce expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.795809:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80fa00/0xf1867c21abfa487c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfdce expref: 15 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.795820:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fa00, rc 0) 00000100:00100000:0.0:1746066742.795850:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982777984:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2645us (4683us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066742.795857:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14775 00000100:00100000:0.0:1746066742.799163:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.801875:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.802428:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.802455:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.802469:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.802493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.802513:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.802567:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982779008 00000100:00100000:0.0:1746066742.802570:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982779008 00000100:00100000:0.0:1746066742.802589:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982779264 00000100:00100000:0.0:1746066742.802591:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982779264 00000100:00100000:0.0:1746066742.802611:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982778624 00000100:00100000:0.0:1746066742.802613:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982778624 00000100:00100000:0.0:1746066742.802625:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982778880 00000100:00100000:0.0:1746066742.802627:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982778880 00000100:00100000:0.0:1746066742.802637:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982779136 00000100:00100000:0.0:1746066742.802639:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982779136 00000100:00100000:0.0:1746066742.802651:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14779 00000100:00100000:0.0:1746066742.802656:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982779008:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066742.802677:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.802688:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa4725 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcd2 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.802700:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa483d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfda4 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.802707:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa4779 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcfc expref: 24 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.802713:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.802714:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066742.802716:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.802747:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa4779 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcfc expref: 24 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.802755:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa4779 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcfc expref: 24 pid: 9590 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746066742.802765:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984263552:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.802976:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14781 00000100:00100000:1.0:1746066742.802982:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982778624:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066742.802997:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.803006:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.803011:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066742.803013:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066742.803015:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.803027:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.803034:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 18 pid: 3528 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066742.803041:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984263808:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066742.803358:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa483d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfda4 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.803367:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa483d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfda4 expref: 12 pid: 9591 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746066742.803375:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984264064:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066742.803404:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa4725 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcd2 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066742.803412:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa4725 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcd2 expref: 18 pid: 9591 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746066742.803420:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984264192:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066742.803435:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066742.803452:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14783 00000100:00100000:0.0:1746066742.803457:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982779136:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066742.803474:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.803484:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 24 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.803491:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa47e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd65 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.803509:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066742.803510:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066742.803512:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.803526:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa47e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd65 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.803539:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa47e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd65 expref: 24 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066742.803546:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984264320:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066742.803569:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 24 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.803577:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 24 pid: 13363 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066742.803584:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984264448:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066742.803596:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.803820:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066742.810251:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.810543:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982779392 00000100:00100000:0.0:1746066742.810552:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982779392 00002000:00100000:0.0:1746066742.810597:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1052671) req@ffff88009677f480 x1830882982779392/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 4584/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.810607:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677f480 with x1830882982779392 ext(1048576->1052671) 00010000:00010000:0.0:1746066742.810615:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 29 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066742.810628:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 29 pid: 20361 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746066742.810635:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677f480 00000100:00100000:1.0:1746066742.811142:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984263552:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.811630:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982779520 00000100:00100000:1.0:1746066742.811634:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982779520 00010000:00010000:1.0:1746066742.811657:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa4779 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcfc expref: 25 pid: 9590 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066742.811683:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6569 00000100:00100000:1.0:1746066742.811690:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882982779520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.811703:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.811721:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa4779 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcfc expref: 25 pid: 9590 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066742.811731:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa4779 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcfc expref: 26 pid: 9590 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066742.811767:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa4779 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfcfc expref: 26 pid: 9590 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066742.811785:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.811821:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882982779520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 131us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.811915:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982779648 00000100:00100000:0.0:1746066742.811919:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982779648 00010000:00010000:0.0:1746066742.811937:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa47e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd65 expref: 24 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066742.811949:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984264320:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066742.811956:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984264448:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066742.811968:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066742.811996:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2809855) req@ffff880098925880 x1830882982779648/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.812004:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925880 with x1830882982779648 ext(2097152->2809855) 00010000:00010000:0.0:1746066742.812009:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 44 pid: 3528 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066742.812017:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 44 pid: 3528 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746066742.812022:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098925880 00000100:00100000:0.0:1746066742.812034:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 778 00000100:00100000:0.0:1746066742.812039:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982779392:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066742.812767:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6569 00000100:00100000:1.0:1746066742.812816:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984263808:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.812828:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.812845:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984264064:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066742.812853:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984264192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066742.812866:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.812880:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982780032 00000100:00100000:1.0:1746066742.812894:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982780032 00002000:00100000:1.0:1746066742.812955:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2867200->3145727) req@ffff880098924700 x1830882982780032/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.812963:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924700 with x1830882982780032 ext(2867200->3145727) 00010000:00010000:1.0:1746066742.812969:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 23 pid: 13363 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.812979:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 23 pid: 13363 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746066742.812985:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098924700 00000100:00100000:1.0:1746066742.812997:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 780 00000100:00100000:1.0:1746066742.813002:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882982780032:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066742.814294:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882982779392:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2249us (4048us total) trans 17179874202 rc 0/0 00000100:00100000:0.0:1746066742.814311:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 778 00002000:00100000:0.0:1746066742.814318:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1052671) req@ffff88009677f480 x1830882982779392/t17179874202(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 4584/448 e 0 to 0 dl 1746066753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.814326:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677f480 with x1830882982779392 ext(1048576->1052671) 00010000:00010000:0.0:1746066742.814332:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 31 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066742.814341:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 31 pid: 20361 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746066742.814348:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677f480 00010000:00010000:1.0:1746066742.815389:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815496:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815513:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815525:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815532:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815538:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b46fc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066742.815541:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815548:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815557:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.815563:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b46fc00/0xf1867c21abfa48ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.815616:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982779008:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12959us (13188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.815623:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14779 00000100:00100000:0.0:1746066742.816112:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982780288 00000100:00100000:0.0:1746066742.816116:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982780288 00002000:00100000:0.0:1746066742.816141:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (655360->1048575) req@ffff880098927100 x1830882982780288/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:148/0 lens 488/0 e 0 to 0 dl 1746066753 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066742.816149:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927100 with x1830882982780288 ext(655360->1048575) 00010000:00010000:0.0:1746066742.816155:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 18 pid: 3528 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066742.816163:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0000/0xf1867c21abfa47b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 655360->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd2d expref: 18 pid: 3528 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746066742.816169:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098927100 00000100:00100000:0.0:1746066742.816180:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 781 00000100:00100000:0.0:1746066742.816185:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982780288:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066742.822770:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982780672 00000100:00100000:1.0:1746066742.822783:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982780672 00010000:00010000:1.0:1746066742.822820:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa471e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfccb expref: 31 pid: 9592 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066742.822868:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6575 00000100:00100000:1.0:1746066742.822876:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982780672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.822913:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.822931:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa471e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfccb expref: 31 pid: 9592 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066742.822942:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa471e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfccb expref: 31 pid: 9592 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066742.822966:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa471e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfccb expref: 31 pid: 9592 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066742.822980:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.822982:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.822987:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa48c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.822994:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153000/0xf1867c21abfa48c2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.823027:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.823074:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982780672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 199us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.823080:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6575 00000100:00100000:0.0:1746066742.832925:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.833311:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982780800 00000100:00100000:1.0:1746066742.833321:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982780800 00010000:00010000:1.0:1746066742.833350:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 30 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066742.833382:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6576 00000100:00100000:1.0:1746066742.833389:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982780800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.833501:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.833520:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 30 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.833531:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 30 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.833554:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa47bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd3b expref: 30 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.833568:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.833570:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.833575:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6c00/0xf1867c21abfa48a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.833584:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a6c00/0xf1867c21abfa48a6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.833617:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.833640:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982780800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 251us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.833646:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6576 00000100:00100000:1.0:1746066742.837026:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982780032:12345-192.168.204.16@tcp:4:cat.0 Request processed in 24013us (24172us total) trans 21474841630 rc 0/0 00000100:00100000:1.0:1746066742.837037:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 780 00002000:00100000:1.0:1746066742.837049:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2867200->3145727) req@ffff880098924700 x1830882982780032/t21474841630(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:148/0 lens 488/448 e 0 to 0 dl 1746066753 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066742.837058:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924700 with x1830882982780032 ext(2867200->3145727) 00010000:00010000:1.0:1746066742.837068:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 25 pid: 13363 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.837081:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 25 pid: 13363 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746066742.837087:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098924700 00000100:00100000:0.0:1746066742.841683:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.841767:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982780928 00000100:00100000:1.0:1746066742.841778:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982780928 00000100:00100000:0.0:1746066742.841792:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.841816:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 45 pid: 3528 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066742.841851:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982781056 00000100:00100000:1.0:1746066742.841853:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982781056 00010000:00010000:1.0:1746066742.841866:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa47d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2867200->3145727] (req 2867200->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd5e expref: 25 pid: 13363 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066742.841880:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6577 00000100:00100000:1.0:1746066742.841906:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882982780928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066742.841920:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066742.841939:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 45 pid: 3528 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.841949:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 45 pid: 3528 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.841970:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0600/0xf1867c21abfa4805 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2809855) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfd81 expref: 45 pid: 3528 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066742.841987:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.841989:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.841993:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfa48b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.842002:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800979a6000/0xf1867c21abfa48b4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.842021:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066742.842066:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882982780928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 161us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.842072:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6577 00010000:00010000:0.0:1746066742.842257:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842266:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842285:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842294:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842301:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842306:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093507400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066742.842310:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842316:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842347:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.842352:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa48c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.842797:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982779136:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 39338us (40282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.842805:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14783 00000100:00100000:0.0:1746066742.844454:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066742.845320:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845330:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845345:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845356:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845362:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845368:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80e800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066742.845371:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845377:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845387:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.845393:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa48bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.846141:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982778624:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 43102us (43614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.846152:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14781 00000100:00100000:0.0:1746066742.852378:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.857728:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.857767:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.857819:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.864592:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984265600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.864595:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984265216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.864646:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864672:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.864686:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864703:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066742.864710:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.864724:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864746:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.864754:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864762:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984265472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.864777:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.864787:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984265728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.864791:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984265984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.864803:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864822:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984266496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.864826:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984265600 00000100:00100000:0.0:1746066742.864833:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066742.864834:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984265600 00000100:00100000:0.0:1746066742.864844:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984267008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.864856:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864867:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746066742.864871:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984265344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.864906:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864918:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984265856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.864931:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864942:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984266368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.864953:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864959:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984266880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.864969:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.864988:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984267008 00000100:00100000:0.0:1746066742.864993:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984267008 00000100:00100000:0.0:1746066742.865015:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984266880 00000100:00100000:0.0:1746066742.865018:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984266880 00000100:00100000:0.0:1746066742.865630:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14791 00000100:00100000:0.0:1746066742.865638:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882984267008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066742.865750:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066742.865753:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066742.865754:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066742.865756:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066742.865758:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:0.0:1746066742.865787:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984267008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (929us total) trans 21474841634 rc 0/0 00000100:00100000:0.0:1746066742.865794:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14791 00000100:00100000:0.0:1746066742.865807:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14794 00000100:00100000:0.0:1746066742.865812:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984266880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.866172:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984266880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 358us (1200us total) trans 21474841636 rc 0/0 00000100:00100000:0.0:1746066742.866177:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14794 00000100:00100000:0.0:1746066742.866197:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066742.866228:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967aaa00/2, rc 0, transno 17179874204 00000100:00100000:0.0:1746066742.866233:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.866242:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984267136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.866261:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066742.866278:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677d180/2, rc 0, transno 21474841632 00000100:00100000:0.0:1746066742.866281:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.866286:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066742.866290:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.866303:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066742.866324:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984267264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066742.866335:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066742.866858:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677c380/2, rc 0, transno 21474841639 00000100:00100000:0.0:1746066742.866864:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.866871:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098924a80/2, rc 0, transno 21474841640 00000100:00100000:0.0:1746066742.866874:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984267264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.866880:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d0d880/2, rc 0, transno 21474841638 00000100:00100000:0.0:1746066742.866902:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984267136:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066742.866910:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677fb80/2, rc 0, transno 21474841637 00000100:00100000:0.0:1746066742.866912:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984266240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066742.867072:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14799 00000100:00100000:1.0:1746066742.867078:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3776:x1830882984265600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066742.867136:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066742.867139:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.867141:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:1.0:1746066742.867143:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.867145:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:1.0:1746066742.867170:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3776:x1830882984265600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (2525us total) trans 17179874210 rc 0/0 00000100:00100000:1.0:1746066742.867175:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14799 00000004:00080000:0.0:1746066742.867187:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967aad80/2, rc 0, transno 17179874210 00000100:00100000:0.0:1746066742.867191:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984265600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.867194:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066742.867223:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967a8a80/2, rc 0, transno 17179874205 00000100:00100000:1.0:1746066742.867227:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984265216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066742.867237:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984265728 00000100:00100000:1.0:1746066742.867240:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984265728 00000100:00100000:1.0:1746066742.867252:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14800 00000100:00100000:1.0:1746066742.867255:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3777:x1830882984265728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066742.867291:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:1.0:1746066742.867293:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.867295:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066742.867297:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066742.867298:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:1.0:1746066742.867318:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3777:x1830882984265728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (124us total) trans 17179874211 rc 0/0 00000100:00100000:1.0:1746066742.867326:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14800 00000004:00080000:0.0:1746066742.867337:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800967a8380/2, rc 0, transno 17179874211 00000100:00100000:0.0:1746066742.867341:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984265728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066742.870426:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.884842:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.891034:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.891094:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.891853:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.891933:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.892022:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.892034:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982782720 00000100:00100000:1.0:1746066742.892037:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982782720 00000100:00100000:1.0:1746066742.892053:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14804 00000100:00100000:1.0:1746066742.892058:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982782464:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066742.892064:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.892071:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfa4901 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe06 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066742.892082:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd36, atime: 0x6812dd36, ctime: 0x6812dd36, blocks: 0x800 00010000:00010000:1.0:1746066742.892089:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.892090:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.892094:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfa4901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe06 expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.892102:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfa4901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe06 expref: 13 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.892109:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80ee00, rc 0) 00000100:00100000:1.0:1746066742.892574:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982782464:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 514us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.892579:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14804 00000100:00100000:0.0:1746066742.892747:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.893959:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982782848 00000100:00100000:1.0:1746066742.893966:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982782848 00000100:00100000:1.0:1746066742.894007:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14806 00000100:00100000:1.0:1746066742.894014:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982782848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066742.894027:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066742.894041:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa490f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe1b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066742.894071:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd37, atime: 0x6812dd36, ctime: 0x6812dd37, blocks: 0x1000 00010000:00010000:1.0:1746066742.894085:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.894087:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.894095:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa490f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe1b expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.894107:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa490f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe1b expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066742.894116:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f600, rc 0) 00000100:00100000:1.0:1746066742.894157:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982782848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 143us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.894162:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14806 00000100:00100000:0.0:1746066742.899441:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.899727:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.900071:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.900304:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.900366:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982783104 00000100:00100000:0.0:1746066742.900370:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982783104 00000100:00100000:0.0:1746066742.900396:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982783360 00000100:00100000:0.0:1746066742.900399:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982783360 00000100:00100000:0.0:1746066742.900413:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14808 00000100:00100000:0.0:1746066742.900418:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982783104:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066742.900468:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982783104:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 49us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.900473:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14808 00000100:00100000:0.0:1746066742.900583:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14809 00000100:00100000:0.0:1746066742.900588:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982783360:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066742.900616:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982783360:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.900620:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14809 00000100:00100000:1.0:1746066742.900767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.900793:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.900938:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14812 00000100:00100000:0.0:1746066742.900944:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982783232:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066742.900970:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982783232:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.901028:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14812 00000100:00100000:0.0:1746066742.905571:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.905606:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.905635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.905659:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.905671:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.905695:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982783872 00000100:00100000:0.0:1746066742.905705:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982783872 00000100:00100000:0.0:1746066742.905753:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982784128 00000100:00100000:0.0:1746066742.905756:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982784128 00000100:00100000:0.0:1746066742.905768:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982784384 00000100:00100000:0.0:1746066742.905770:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982784384 00000100:00100000:0.0:1746066742.905782:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982783744 00000100:00100000:0.0:1746066742.905785:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982783744 00000100:00100000:0.0:1746066742.905799:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14813 00000100:00100000:0.0:1746066742.905806:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982783872:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066742.905943:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14815 00000100:00100000:1.0:1746066742.905951:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982784384:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066742.906130:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982783872:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 323us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066742.906135:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14813 00000100:00100000:0.0:1746066742.906177:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.906325:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982784384:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 374us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066742.906330:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14815 00000100:00100000:0.0:1746066742.909752:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.920406:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.926261:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.927920:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.928030:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982785152 00000100:00100000:1.0:1746066742.928035:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982785152 00000100:00100000:1.0:1746066742.928210:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3690 00000100:00100000:1.0:1746066742.928216:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882982785152:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066742.928233:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.928241:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.928242:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.928244:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.928252:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.937456:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.937495:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.937516:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.937539:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066742.937620:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982785664 00000100:00100000:1.0:1746066742.937624:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982785664 00000100:00100000:1.0:1746066742.937927:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3692 00000100:00100000:1.0:1746066742.937934:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982786048:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066742.937960:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.937969:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.937971:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066742.937974:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.937982:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962125:0:13353:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962146:0:13353:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962154:0:13353:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962161:0:13353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80e200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066742.962165:0:13353:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962172:0:13353:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962191:0:13353:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962197:0:13353:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa491d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.962299:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882982785152:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 34077us (34381us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066742.962312:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3690 00010000:00010000:1.0:1746066742.962475:0:20357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c184600/0xf1867c21abfa4924 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962482:0:20357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c184600/0xf1867c21abfa4924 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962489:0:20357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c184600/0xf1867c21abfa4924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962494:0:20357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c184600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066742.962496:0:20357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c184600/0xf1867c21abfa4924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962502:0:20357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c184600/0xf1867c21abfa4924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962511:0:20357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c184600/0xf1867c21abfa4924 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.962517:0:20357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c184600/0xf1867c21abfa4924 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.962550:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982785792:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 24834us (25104us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066742.962556:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3691 00010000:00010000:0.0:1746066742.967839:0:20360:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa4932 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.967858:0:20360:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa4932 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.967866:0:20360:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa4932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.967873:0:20360:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066742.967877:0:20360:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa4932 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.968080:0:20360:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa4932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.968100:0:20360:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa4932 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066742.968107:0:20360:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa4932 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066742.969200:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982785536:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 31239us (31697us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066742.969211:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3693 00010000:00010000:1.0:1746066742.976120:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.976140:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.976148:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.976156:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80ea00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066742.976160:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.976169:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.976188:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066742.976195:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa492b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066742.976652:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982786048:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 38713us (39105us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066742.976662:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3692 00000100:00100000:0.0:1746066742.993076:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066742.995819:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.002196:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.004972:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.008755:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.012753:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.013204:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14823 00000100:00100000:1.0:1746066743.013214:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:32524:x1830882982787072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.013255:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.013273:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfa4955 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe30 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.013304:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfa4901 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe06 expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.013312:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.013313:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.013317:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfa4955 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe30 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.013345:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfa4901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe06 expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.013356:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80ee00/0xf1867c21abfa4901 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe06 expref: 11 pid: 9592 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.013367:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984267904:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.013446:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.014581:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984267904:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.014600:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfa4955 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe30 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.014606:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066743.014610:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3e00, rc 0) 00000100:00100000:1.0:1746066743.014633:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32524:x1830882982787072:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1423us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.014638:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14823 00000100:00100000:0.0:1746066743.017402:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.017855:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982787328 00000100:00100000:1.0:1746066743.017862:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982787328 00000100:00100000:1.0:1746066743.017940:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14824 00000100:00100000:1.0:1746066743.017948:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32524:x1830882982787328:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.017963:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.017979:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa495c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe37 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.018011:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130801400/0xf1867c21abfa48fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe0d expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.018019:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.018021:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.018024:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa495c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe37 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.018048:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130801400/0xf1867c21abfa48fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe0d expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.018060:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130801400/0xf1867c21abfa48fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe0d expref: 14 pid: 9590 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.018083:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984268160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.018149:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.019219:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984268160:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.019234:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa495c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe37 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.019251:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2800, rc 0) 00000100:00100000:1.0:1746066743.019272:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:32524:x1830882982787328:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1326us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.019278:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14824 00000100:00100000:0.0:1746066743.019938:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.022395:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.022447:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982787584 00000100:00100000:1.0:1746066743.022453:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982787584 00000100:00100000:1.0:1746066743.022523:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14825 00000100:00100000:1.0:1746066743.022529:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32524:x1830882982787584:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.022544:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.022560:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f3800/0xf1867c21abfa4963 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe3e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.022583:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130800c00/0xf1867c21abfa4908 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe14 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.022590:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.022592:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.022595:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3800/0xf1867c21abfa4963 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe3e expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.022616:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130800c00/0xf1867c21abfa4908 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe14 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.022627:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130800c00/0xf1867c21abfa4908 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe14 expref: 14 pid: 9590 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.022642:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984268416:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.022698:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.027341:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984268416:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.027376:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3800/0xf1867c21abfa4963 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe3e expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.027394:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3800, rc 0) 00000100:00100000:1.0:1746066743.027450:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:32524:x1830882982787584:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4919us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.027458:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14825 00000100:00100000:0.0:1746066743.027779:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.030862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.030963:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982787840 00000100:00100000:1.0:1746066743.030971:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982787840 00000100:00100000:1.0:1746066743.031092:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14826 00000100:00100000:1.0:1746066743.031100:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:32524:x1830882982787840:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.031117:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.031134:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfa496a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe45 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.031163:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa490f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe1b expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.031170:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.031172:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.031176:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfa496a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe45 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.031204:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa490f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe1b expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.031217:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f600/0xf1867c21abfa490f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe1b expref: 11 pid: 9592 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.031227:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984268672:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.031629:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.035203:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984268672:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.035230:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2c00/0xf1867c21abfa496a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe45 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.035244:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2c00, rc 0) 00000100:00100000:1.0:1746066743.036257:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32524:x1830882982787840:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5155us (5401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.036264:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14826 00000100:00100000:0.0:1746066743.036850:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984268928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066743.039316:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.039352:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.039387:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.039525:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14828 00000100:00100000:1.0:1746066743.039534:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982788480:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066743.039638:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066743.039641:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.039643:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.039645:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066743 -> 1746066744 00002000:00010000:1.0:1746066743.039647:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066743.039679:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982788480:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 146us (326us total) trans 21474841642 rc 0/0 00000100:00100000:1.0:1746066743.039685:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14828 00000100:00100000:1.0:1746066743.039980:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982788352 00000100:00100000:1.0:1746066743.039984:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982788352 00000100:00100000:1.0:1746066743.039990:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982788608 00000100:00100000:1.0:1746066743.039992:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982788608 00000100:00100000:1.0:1746066743.040010:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14831 00000100:00100000:1.0:1746066743.040015:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982788608:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066743.040061:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:1.0:1746066743.040064:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.040065:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.040068:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066743 -> 1746066744 00002000:00010000:1.0:1746066743.040069:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:1.0:1746066743.040089:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982788608:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 73us (122us total) trans 21474841644 rc 0/0 00000100:00100000:1.0:1746066743.040095:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14831 00000100:00100000:1.0:1746066743.040193:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14832 00000100:00100000:1.0:1746066743.040198:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982788352:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066743.040390:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066743.040392:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066742 -> 1746066743 00002000:00010000:1.0:1746066743.040394:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066742 -> 1746066743 00002000:00010000:1.0:1746066743.040396:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066742 -> 1746066744 00002000:00010000:1.0:1746066743.040398:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066743.040419:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982788352:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 220us (484us total) trans 17179874215 rc 0/0 00000100:00100000:1.0:1746066743.040428:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14832 00000100:00100000:0.0:1746066743.043085:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.044765:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.047713:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984269312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.047778:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984269568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.048081:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.048285:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.048307:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984269824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.048322:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.048500:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984270080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.048517:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.048527:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984270592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.048540:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.048550:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984271104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.048562:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.048585:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984269824 00000100:00100000:1.0:1746066743.048588:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984269824 00000100:00100000:1.0:1746066743.048604:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984269440 00000100:00100000:1.0:1746066743.048605:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984269440 00000100:00100000:1.0:1746066743.048614:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984270080 00000100:00100000:1.0:1746066743.048616:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984270080 00000100:00100000:1.0:1746066743.048624:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984270592 00000100:00100000:1.0:1746066743.048626:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984270592 00000100:00100000:1.0:1746066743.048631:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984271104 00000100:00100000:1.0:1746066743.048632:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984271104 00000100:00100000:1.0:1746066743.048641:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14833 00000100:00100000:1.0:1746066743.048647:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3776:x1830882984269312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.048841:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984270336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.048860:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.048868:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984270848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.048880:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.048917:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984270336 00000100:00100000:0.0:1746066743.048919:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984270336 00000100:00100000:0.0:1746066743.048929:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984270848 00000100:00100000:0.0:1746066743.048931:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984270848 00000100:00100000:0.0:1746066743.048938:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14835 00000100:00100000:0.0:1746066743.048942:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3777:x1830882984269440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066743.049004:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066743.049007:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.049008:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.049010:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:0.0:1746066743.049012:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066743.049026:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984269440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (540us total) trans 17179874216 rc 0/0 00000100:00100000:0.0:1746066743.049033:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14835 00000100:00100000:0.0:1746066743.049039:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14837 00000100:00100000:0.0:1746066743.049043:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882984270592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066743.049307:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066743.049309:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066743.049311:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066743.049312:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066743.049314:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:0.0:1746066743.049329:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3774:x1830882984270592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 286us (788us total) trans 21474841647 rc 0/0 00002000:00010000:1.0:1746066743.049381:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066743.049383:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.049385:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.049387:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.049388:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:1.0:1746066743.049405:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882984269312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 758us (1119us total) trans 21474841648 rc 0/0 00000100:00100000:0.0:1746066743.050173:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14837 00000004:00080000:0.0:1746066743.050216:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb75180/2, rc 0, transno 21474841648 00000100:00100000:0.0:1746066743.050227:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984269312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.050236:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb75c00/2, rc 0, transno 21474841645 00000100:00100000:0.0:1746066743.050239:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984269824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.050245:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb75f80/2, rc 0, transno 21474841650 00000100:00100000:0.0:1746066743.050248:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984270336:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.050253:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e422300/2, rc 0, transno 21474841651 00000100:00100000:0.0:1746066743.050256:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984270848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.050299:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984269952 00000100:00100000:0.0:1746066743.050302:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984269952 00000100:00100000:0.0:1746066743.050318:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14843 00000100:00100000:0.0:1746066743.050322:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984269952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066743.050337:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984270464 00000100:00100000:0.0:1746066743.050339:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984270464 00000100:00100000:0.0:1746066743.050349:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14844 00000100:00100000:0.0:1746066743.050353:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984270464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066743.050395:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066743.050396:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.050398:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066743.050400:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.050402:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066743.050418:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882984270464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (99us total) trans 17179874219 rc 0/0 00000100:00100000:0.0:1746066743.050422:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14844 00000100:00100000:0.0:1746066743.050430:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984270976 00000100:00100000:0.0:1746066743.050432:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984270976 00000100:00100000:0.0:1746066743.050438:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14845 00000100:00100000:0.0:1746066743.050442:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882984270976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066743.050482:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3777:x1830882984270976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (129us total) trans 17179874220 rc 0/0 00000100:00100000:0.0:1746066743.050488:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14845 00002000:00010000:0.0:1746066743.050527:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066743.050529:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.050531:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.050532:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:0.0:1746066743.050534:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066743.050549:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3777:x1830882984269952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (267us total) trans 17179874221 rc 0/0 00000100:00100000:0.0:1746066743.050554:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14843 00000100:00100000:1.0:1746066743.050681:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14833 00000004:00080000:1.0:1746066743.050713:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb77800/2, rc 0, transno 21474841649 00000100:00100000:1.0:1746066743.050716:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984269568:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066743.050723:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb77480/2, rc 0, transno 21474841646 00000100:00100000:1.0:1746066743.050725:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984270080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066743.050745:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e421180/2, rc 0, transno 21474841647 00000100:00100000:1.0:1746066743.050748:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984270592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066743.050755:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d0df80/2, rc 0, transno 17179874217 00000100:00100000:1.0:1746066743.050758:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984271104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.050764:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066743.050768:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984271232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.050786:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.050812:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984271232 00000100:00100000:1.0:1746066743.050814:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984271232 00000100:00100000:1.0:1746066743.050832:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14846 00000100:00100000:1.0:1746066743.050836:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3774:x1830882984271232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.050907:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882984271232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (119us total) trans 21474841652 rc 0/0 00000100:00100000:1.0:1746066743.050913:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14846 00000004:00080000:1.0:1746066743.050928:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d89180/2, rc 0, transno 21474841652 00000100:00100000:1.0:1746066743.050931:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984271232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.050944:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984269696 00000100:00100000:1.0:1746066743.050946:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984269696 00000100:00100000:1.0:1746066743.050957:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14847 00000100:00100000:1.0:1746066743.050960:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3775:x1830882984269696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066743.050998:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:1.0:1746066743.051001:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.051002:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.051004:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.051006:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:1.0:1746066743.051024:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3775:x1830882984269696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (90us total) trans 21474841653 rc 0/0 00000100:00100000:1.0:1746066743.051029:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14847 00000100:00100000:1.0:1746066743.051037:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14848 00000100:00100000:1.0:1746066743.051041:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882984270208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066743.051076:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066743.051079:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.051080:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:1.0:1746066743.051082:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.051084:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:1.0:1746066743.051096:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984270208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (129us total) trans 17179874222 rc 0/0 00000100:00100000:1.0:1746066743.051101:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14848 00000100:00100000:0.0:1746066743.054031:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.056991:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.073638:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066743.073902:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066743.075205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066743.075818:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066743.077033:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.079960:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00080000:0.0:1746066743.080137:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066743.081792:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.081838:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.081872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.081930:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982790656 00000100:00100000:1.0:1746066743.081938:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982790656 00000100:00100000:0.0:1746066743.082164:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14850 00000100:00100000:0.0:1746066743.082170:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:32538:x1830882982790400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066743.082178:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.082191:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db77c00/0xf1867c21abfa49da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe68 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.082218:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0200/0xf1867c21abfa4947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe22 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.082226:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066743.082228:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066743.082231:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77c00/0xf1867c21abfa49da lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe68 expref: 25 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.082275:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa0200/0xf1867c21abfa4947 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe22 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.082286:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0200/0xf1867c21abfa4947 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe22 expref: 15 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.082294:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16088 00000100:00100000:0.0:1746066743.082298:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d88a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984271360:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.082301:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:32533:x1830882982791040:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066743.082313:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.082323:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa49f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe7d expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.082371:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066743.082681:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa49fd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066743.082690:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa49fd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066743.082696:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa49fd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066743.088454:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.088634:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.089031:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6591 00000100:00100000:1.0:1746066743.089043:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982791424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.089056:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.089064:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfa49b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe5a expref: 11 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.089074:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfa49b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe5a expref: 11 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.089092:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88011dd1c200/0xf1867c21abfa49b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe5a expref: 11 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.089112:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.089116:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa49fd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066743.089123:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa49fd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066743.089128:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2da00/0xf1867c21abfa49fd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066743.089134:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226da00/0xf1867c21abfa49ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.089139:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226da00/0xf1867c21abfa49ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.089154:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066743.089544:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.089561:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982791424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 521us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.089568:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6591 00000100:00100000:1.0:1746066743.089584:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982791296 00000100:00100000:1.0:1746066743.089589:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982791296 00010000:00010000:1.0:1746066743.089604:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800978d1000/0xf1867c21abfa4978 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe4c expref: 9 pid: 7244 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.089628:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6592 00000100:00100000:1.0:1746066743.089633:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982791296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.089639:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.089643:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800978d1000/0xf1867c21abfa4978 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe4c expref: 9 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.089651:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800978d1000/0xf1867c21abfa4978 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe4c expref: 9 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.089662:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800978d1000/0xf1867c21abfa4978 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe4c expref: 9 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.089671:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.089802:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226da00/0xf1867c21abfa49ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.089811:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226da00/0xf1867c21abfa49ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.089815:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226da00/0xf1867c21abfa49ef lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.090807:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.090835:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882982791296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1201us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.090841:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6592 00000100:00100000:0.0:1746066743.096211:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984272768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.096313:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984272256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066743.096514:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.096530:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066743.096552:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.096573:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.096587:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.096597:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746066743.096601:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984272896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066743.096620:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.096631:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.096654:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.096666:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.096684:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.096701:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984272768 00000100:00100000:0.0:1746066743.096705:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984272768 00000100:00100000:1.0:1746066743.097315:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.097341:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984273024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.097361:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.097371:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984273536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.097383:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.097405:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984274048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.097425:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.097434:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746066743.097438:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984272384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.097449:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.097459:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984273152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.097470:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.097475:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984273664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.097491:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.097496:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984274176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.097510:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066743.097529:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d89500/2, rc 0, transno 17179874229 00000100:00100000:1.0:1746066743.097532:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984272256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.097545:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984273152 00000100:00100000:1.0:1746066743.097548:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984273152 00000100:00100000:1.0:1746066743.097563:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984273664 00000100:00100000:1.0:1746066743.097565:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984273664 00000100:00100000:1.0:1746066743.097573:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14861 00000100:00100000:1.0:1746066743.097577:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882984273024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066743.097956:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14867 00000100:00100000:0.0:1746066743.097962:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3774:x1830882984274176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066743.098013:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:0.0:1746066743.098016:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.098018:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066743.098020:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.098021:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:0.0:1746066743.098042:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984274176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (530us total) trans 21474841661 rc 0/0 00000100:00100000:0.0:1746066743.098047:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14867 00000004:00080000:0.0:1746066743.098074:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7ff100/2, rc 0, transno 17179874228 00000100:00100000:0.0:1746066743.098077:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984272896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066743.098084:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbc700/2, rc 0, transno 21474841655 00000100:00100000:0.0:1746066743.098091:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.098098:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbe300/2, rc 0, transno 21474841656 00000100:00100000:0.0:1746066743.098101:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.098109:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbd500/2, rc 0, transno 21474841654 00000100:00100000:0.0:1746066743.098111:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.098114:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882984273024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 535us (750us total) trans 17179874230 rc 0/0 00000004:00080000:0.0:1746066743.098117:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d8aa00/2, rc 0, transno 17179874226 00000100:00100000:0.0:1746066743.098119:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984272768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.098120:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14861 00000004:00080000:0.0:1746066743.098125:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7fdf80/2, rc 0, transno 17179874227 00000100:00100000:0.0:1746066743.098127:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984273280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.098166:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984274304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.098186:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.098204:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984274304 00000100:00100000:0.0:1746066743.098207:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984274304 00000100:00100000:0.0:1746066743.098220:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14868 00000100:00100000:0.0:1746066743.098224:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3776:x1830882984274304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.098281:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3776:x1830882984274304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (94us total) trans 21474841662 rc 0/0 00000100:00100000:0.0:1746066743.098286:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14868 00000004:00080000:1.0:1746066743.098376:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7fce00/2, rc 0, transno 21474841662 00000100:00100000:1.0:1746066743.098379:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984274304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.100184:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.100235:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982791808 00000100:00100000:1.0:1746066743.100241:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982791808 00000100:00100000:1.0:1746066743.100280:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5826 00000100:00100000:1.0:1746066743.100286:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:32538:x1830882982791808:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:1.0:1746066743.100347:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:32538:x1830882982791808:12345-192.168.204.16@tcp:49:cat.0 Request processed in 61us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.100353:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5826 00000100:00100000:0.0:1746066743.103123:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.105650:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982792192 00000100:00100000:0.0:1746066743.105655:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982792192 00002000:00100000:0.0:1746066743.105685:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800966e1500 x1830882982792192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.105695:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1500 with x1830882982792192 ext(0->1048575) 00002000:00010000:0.0:1746066743.105700:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e1500 00000100:00100000:0.0:1746066743.105735:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3695 00000100:00100000:0.0:1746066743.105741:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882982792192:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066743.112712:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.112802:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982792576 00000100:00100000:1.0:1746066743.112808:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982792576 00002000:00100000:1.0:1746066743.112838:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009c7fdc00 x1830882982792576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.112845:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fdc00 with x1830882982792576 ext(0->1048575) 00002000:00010000:1.0:1746066743.112848:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fdc00 00000100:00100000:1.0:1746066743.112872:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3696 00000100:00100000:1.0:1746066743.112878:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982792576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066743.117926:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982792576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5037us (5211us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066743.117937:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3696 00002000:00100000:1.0:1746066743.117947:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009c7fdc00 x1830882982792576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/440 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.117956:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fdc00 with x1830882982792576 ext(0->1048575) 00002000:00010000:1.0:1746066743.117961:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fdc00 00000100:00100000:0.0:1746066743.121531:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.122664:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.122698:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982792832 00000100:00100000:1.0:1746066743.122702:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982792832 00000100:00100000:1.0:1746066743.122808:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14870 00000100:00100000:1.0:1746066743.122818:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:32538:x1830882982792832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.122826:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.122844:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfe92 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.122858:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa494e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe29 expref: 12 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.122869:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.122870:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.122873:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.122915:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa494e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe29 expref: 12 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.122923:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa494e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe29 expref: 12 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.122931:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984274688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.122981:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.123252:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.125697:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984274688:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.125713:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.125721:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e200, rc 0) 00000100:00100000:0.0:1746066743.126192:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.126222:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.126241:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.126257:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982793216 00000100:00100000:0.0:1746066743.126260:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982793216 00000100:00100000:1.0:1746066743.126279:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:32538:x1830882982792832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3460us (3614us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066743.126280:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77c00/0xf1867c21abfa49da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe68 expref: 26 pid: 1893 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.126284:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14870 00000100:00100000:1.0:1746066743.126553:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982793088 00000100:00100000:1.0:1746066743.126557:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982793088 00010000:00010000:1.0:1746066743.126569:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1400/0xf1867c21abfa49e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe76 expref: 20 pid: 9592 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.126601:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6594 00000100:00100000:1.0:1746066743.126606:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982793344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.126613:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.126624:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa494e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe29 expref: 13 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.126631:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa494e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe29 expref: 13 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.126642:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa494e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe29 expref: 13 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.126654:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.126656:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.126661:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.126667:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.126674:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.126675:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.126677:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa4a27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea0 expref: 5 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.126682:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa4a27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea0 expref: 5 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.126701:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa4a27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea0 expref: 5 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.126710:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984274816:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.126775:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.126783:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984274944:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.126800:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.128772:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.128843:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984274816:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.128852:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984274944:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.128862:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.128912:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982793344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2305us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.128918:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6594 00000100:00100000:0.0:1746066743.128945:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982793600 00000100:00100000:0.0:1746066743.128950:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982793600 00002000:00100000:0.0:1746066743.128976:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (372736->376831) req@ffff88012ce05f80 x1830882982793600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.128985:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce05f80 with x1830882982793600 ext(372736->376831) 00002000:00010000:0.0:1746066743.128989:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce05f80 00000100:00100000:0.0:1746066743.129015:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3697 00000100:00100000:0.0:1746066743.129021:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882982793600:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066743.129101:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882982793600:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 80us (331us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066743.129106:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3697 00002000:00100000:0.0:1746066743.129110:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (372736->376831) req@ffff88012ce05f80 x1830882982793600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.129116:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce05f80 with x1830882982793600 ext(372736->376831) 00002000:00010000:0.0:1746066743.129119:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce05f80 00000100:00100000:0.0:1746066743.132288:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.133568:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.135425:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.137925:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.140326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.149216:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.150905:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982794880 00000100:00100000:1.0:1746066743.150913:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982794880 00010000:00010000:1.0:1746066743.150939:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfa4955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe30 expref: 12 pid: 9591 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.150998:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6596 00000100:00100000:1.0:1746066743.151005:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982794880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.151018:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.151032:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfa4955 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe30 expref: 12 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.151041:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfa4955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe30 expref: 12 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.151059:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3e00/0xf1867c21abfa4955 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe30 expref: 12 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.151073:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.151075:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.151081:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa4a2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->1859583) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea7 expref: 6 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.151088:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa4a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->1859583) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea7 expref: 6 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.151110:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa4a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->1859583) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea7 expref: 6 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.151120:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984275328:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.151573:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.153916:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984275328:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.153931:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.153968:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982794880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2960us (4750us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.153977:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6596 00000100:00100000:0.0:1746066743.154472:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.158026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.159470:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.176646:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.177415:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.182189:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.182269:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982796032 00000100:00100000:1.0:1746066743.182276:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982796032 00010000:00010000:1.0:1746066743.182306:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa495c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe37 expref: 15 pid: 9591 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.182344:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6597 00000100:00100000:1.0:1746066743.182351:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982796032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.182362:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.182379:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa495c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe37 expref: 15 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.182388:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa495c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe37 expref: 15 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.182406:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa495c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe37 expref: 15 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.182432:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.182434:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.182439:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa4a3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeb5 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.182446:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa4a3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeb5 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.182477:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa4a3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeb5 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.182487:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984275712:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.182549:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.185129:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984275712:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.185146:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.185196:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982796032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2845us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.185205:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6597 00000100:00100000:0.0:1746066743.186725:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.186969:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982796160 00000100:00100000:1.0:1746066743.186976:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982796160 00010000:00010000:1.0:1746066743.187001:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa4a2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1310720->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea7 expref: 9 pid: 9590 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.187498:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6598 00000100:00100000:1.0:1746066743.187506:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982796160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.187518:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066743.187530:0:11928:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066743 -> 1746066744 00002000:00010000:1.0:1746066743.187533:0:11928:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066743 -> 1746066744 00010000:00010000:1.0:1746066743.187538:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa4a2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->1859583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea7 expref: 9 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.187548:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa4a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->1859583) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea7 expref: 9 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.187566:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa4a2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1310720->1859583) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea7 expref: 9 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.187592:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.187594:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.187600:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a400/0xf1867c21abfa4a35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeae expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.187608:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a400/0xf1867c21abfa4a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeae expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.187636:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a400/0xf1867c21abfa4a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeae expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.187645:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984275840:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.188171:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.192441:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984275840:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.192458:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.192495:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882982796160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4989us (5773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.192505:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6598 00000100:00100000:0.0:1746066743.195924:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982796672 00000100:00100000:0.0:1746066743.195935:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982796672 00002000:00100000:0.0:1746066743.195982:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880130d8bb80 x1830882982796672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.195992:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8bb80 with x1830882982796672 ext(1048576->2097151) 00002000:00010000:0.0:1746066743.195998:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8bb80 00000100:00100000:0.0:1746066743.196160:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3704 00000100:00100000:0.0:1746066743.196170:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982796672:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066743.201848:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.201919:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.201946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.201969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.201995:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982796800 00000100:00100000:0.0:1746066743.202003:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982796800 00000100:00100000:0.0:1746066743.202048:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982797056 00000100:00100000:0.0:1746066743.202051:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982797056 00000100:00100000:0.0:1746066743.202420:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982796928 00000100:00100000:0.0:1746066743.202423:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982796928 00000100:00100000:1.0:1746066743.202428:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14875 00000100:00100000:1.0:1746066743.202445:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14877 00000100:00100000:1.0:1746066743.202451:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982796928:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066743.202453:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14878 00000100:00100000:0.0:1746066743.202459:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982797184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.202465:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.202466:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.202481:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0cc00/0xf1867c21abfa4a43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfec3 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.202481:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b32000/0xf1867c21abfa4a4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfed1 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.202501:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.202503:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.202512:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0cc00/0xf1867c21abfa4a43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfec3 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.202527:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0cc00/0xf1867c21abfa4a43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfec3 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066743.202529:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984276096:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.202537:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0cc00, rc 0) 00000100:00100000:1.0:1746066743.202587:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982796928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 136us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.202593:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14877 00000100:00100000:0.0:1746066743.202608:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.202615:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982796800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.202621:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.202628:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa4a58 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfebc expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.202652:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984276224:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.202674:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00002000:00010000:1.0:1746066743.204625:0:9591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066743 -> 1746066744 00002000:00010000:1.0:1746066743.204628:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066743 -> 1746066744 00000100:00100000:1.0:1746066743.204644:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984276224:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.204665:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa4a58 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfebc expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.204679:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c000/0xf1867c21abfa4a58 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfebc expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.204689:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c000, rc 0) 00000100:00100000:1.0:1746066743.204738:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982796800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2290us (2888us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.204745:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14875 00000100:00100000:0.0:1746066743.206029:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.206605:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.208634:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.208807:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982797568 00000100:00100000:1.0:1746066743.208812:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982797568 00010000:00010000:1.0:1746066743.208838:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3800/0xf1867c21abfa4963 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe3e expref: 14 pid: 9591 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.208872:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6599 00000100:00100000:1.0:1746066743.208878:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982797568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.208909:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.208928:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f3800/0xf1867c21abfa4963 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe3e expref: 14 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.208937:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f3800/0xf1867c21abfa4963 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe3e expref: 14 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.208956:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3800/0xf1867c21abfa4963 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe3e expref: 14 pid: 9591 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.208966:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.208968:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.208973:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.208981:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.209003:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.209013:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984276480:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066743.209510:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.209691:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.213368:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984276480:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066743.213385:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066743.213426:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982797568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4547us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.213435:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6599 00000100:00100000:0.0:1746066743.215318:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.221246:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.221463:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.221931:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14882 00000100:00100000:1.0:1746066743.221940:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882982798208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.221948:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.221958:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfee6 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.221974:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.221977:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.221984:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.221998:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.222007:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d200, rc 0) 00000100:00100000:1.0:1746066743.222029:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982798208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 92us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.222036:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14882 00000100:00100000:0.0:1746066743.234754:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.234817:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.242018:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.247750:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.251481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.253970:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.254105:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982799488 00000100:00100000:0.0:1746066743.254112:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982799488 00002000:00100000:0.0:1746066743.254147:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800958ac700 x1830882982799488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.254155:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac700 with x1830882982799488 ext(3145728->4194303) 00002000:00010000:0.0:1746066743.254161:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ac700 00000100:00100000:0.0:1746066743.254178:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3709 00000100:00100000:0.0:1746066743.254184:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982799488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066743.262304:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.262598:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.262628:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982799872 00000100:00100000:1.0:1746066743.262638:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982799872 00002000:00100000:1.0:1746066743.262690:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800958afb80 x1830882982799872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.262702:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882982799872 ext(2097152->4194303) 00002000:00010000:1.0:1746066743.262709:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958afb80 00000100:00100000:1.0:1746066743.262739:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982800000 00000100:00100000:1.0:1746066743.262741:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982800000 00002000:00100000:1.0:1746066743.262753:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800958adc00 x1830882982800000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.262760:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adc00 with x1830882982800000 ext(3145728->4194303) 00002000:00010000:1.0:1746066743.262763:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958adc00 00000100:00100000:1.0:1746066743.262788:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3710 00000100:00100000:1.0:1746066743.263245:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982799872:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066743.265303:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982799488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11109us (11331us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066743.265313:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3709 00002000:00100000:0.0:1746066743.265322:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800958ac700 x1830882982799488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/440 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.265331:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac700 with x1830882982799488 ext(3145728->4194303) 00002000:00010000:0.0:1746066743.265336:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ac700 00000100:00100000:0.0:1746066743.272325:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.289476:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982799872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26222us (27174us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066743.289490:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3710 00002000:00100000:1.0:1746066743.289502:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800958afb80 x1830882982799872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/440 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.289512:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882982799872 ext(2097152->4194303) 00002000:00010000:1.0:1746066743.289520:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958afb80 00000100:00100000:0.0:1746066743.299869:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.301263:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982800384 00000100:00100000:1.0:1746066743.301274:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982800384 00000100:00100000:1.0:1746066743.301376:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14885 00000100:00100000:1.0:1746066743.301385:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982800384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.301406:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.301423:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82400/0xf1867c21abfa4aac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff09 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.301483:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984276992:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.301582:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.301680:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.310872:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984276992:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.310953:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82400/0xf1867c21abfa4aac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff09 expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.310968:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82400/0xf1867c21abfa4aac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff09 expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.310992:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82400, rc 0) 00000100:00100000:1.0:1746066743.311061:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982800384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9676us (11203us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.311070:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14885 00000100:00100000:0.0:1746066743.316545:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.322044:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982801152 00000100:00100000:0.0:1746066743.322053:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982801152 00002000:00100000:0.0:1746066743.322092:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800966e1180 x1830882982801152/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.322101:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1180 with x1830882982801152 ext(4194304->5033983) 00002000:00010000:0.0:1746066743.322110:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e1180 00000100:00100000:0.0:1746066743.322129:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3713 00000100:00100000:0.0:1746066743.322137:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882982801152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066743.327344:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982801408 00000100:00100000:1.0:1746066743.327355:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982801408 00000100:00100000:1.0:1746066743.327431:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5830 00000100:00100000:1.0:1746066743.327442:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:32544:x1830882982801408:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066743.327722:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:32544:x1830882982801408:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 279us (612us total) trans 8589936390 rc 0/0 00000100:00100000:1.0:1746066743.327741:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5830 00000100:00100000:0.0:1746066743.331683:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.331738:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.332622:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982801792 00000100:00100000:1.0:1746066743.332628:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982801792 00000100:00100000:1.0:1746066743.332665:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14886 00000100:00100000:1.0:1746066743.332673:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982801792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.332686:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.332706:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfa4ad6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff17 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.332776:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984277120:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.332861:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.338311:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984277120:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.338349:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfa4ad6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff17 expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.338363:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326de00/0xf1867c21abfa4ad6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff17 expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.338377:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326de00, rc 0) 00000100:00100000:1.0:1746066743.339685:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982801792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7006us (7951us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.339696:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14886 00000100:00100000:0.0:1746066743.343776:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.343977:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982801920 00000100:00100000:1.0:1746066743.343988:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982801920 00000100:00100000:1.0:1746066743.344067:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14887 00000100:00100000:1.0:1746066743.344078:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882982801920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.344101:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.344122:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfa4add lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff1e expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.344184:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984277248:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.345207:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.348216:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984277248:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.348260:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfa4add lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff1e expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.348275:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326d400/0xf1867c21abfa4add lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff1e expref: 22 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.348302:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d400, rc 0) 00000100:00100000:1.0:1746066743.348374:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882982801920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4297us (4606us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.348382:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14887 00000100:00100000:0.0:1746066743.354389:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.377036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.377157:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982802304 00000100:00100000:1.0:1746066743.377167:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982802304 00000100:00100000:1.0:1746066743.377231:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14888 00000100:00100000:1.0:1746066743.377239:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:32542:x1830882982802304:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066743.377258:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.377276:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff25 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.377306:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2a00/0xf1867c21abfa4a7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfef4 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.377313:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfa4a82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfefb expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.377319:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.377321:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.377324:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2330624->2990079] (req 2330624->2990079) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.377355:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfa4a82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfefb expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.377366:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f3800/0xf1867c21abfa4a82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfefb expref: 28 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.377377:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277376:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.377939:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800960f2a00/0xf1867c21abfa4a7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfef4 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.377948:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2a00/0xf1867c21abfa4a7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfef4 expref: 9 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.377956:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.377982:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.382254:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277376:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.382266:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277504:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.382296:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2330624->2990079] (req 2330624->2990079) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.382311:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d600, rc 0) 00000100:00100000:1.0:1746066743.383559:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:32542:x1830882982802304:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6309us (6523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.383570:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14888 00000100:00100000:0.0:1746066743.387787:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.388606:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.397571:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d88380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984277632:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066743.397593:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066743.397658:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982802560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8999us (9051us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.397669:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6602 00000100:00100000:0.0:1746066743.406818:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.417614:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.456193:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.456262:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982803456 00000100:00100000:1.0:1746066743.456272:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982803456 00000100:00100000:1.0:1746066743.456332:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14889 00000100:00100000:1.0:1746066743.456340:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+9:32544:x1830882982803456:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066743.456361:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.456378:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff2c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.456406:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.456415:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa4a27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea0 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.456422:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.456423:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.456427:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1593344->2097151] (req 1593344->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.456457:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa4a27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea0 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.456468:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa4a27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfea0 expref: 10 pid: 9592 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.456480:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277760:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.457052:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.457062:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 26 pid: 9590 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.457070:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277888:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.457122:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.459486:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277760:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.459500:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984277888:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.459529:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1593344->2097151] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.459546:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c600, rc 0) 00000100:00100000:1.0:1746066743.459586:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:32544:x1830882982803456:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3246us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.459596:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14889 00000100:00100000:0.0:1746066743.463299:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.463409:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.463845:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6604 00000100:00100000:1.0:1746066743.463852:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982803712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.463859:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.463869:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 27 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.463878:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 27 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.463916:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80e200/0xf1867c21abfa4a20 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe92 expref: 27 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.464411:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.466298:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982803712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2441us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.466308:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6604 00000100:00100000:0.0:1746066743.479734:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.480832:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.480906:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982804224 00000100:00100000:1.0:1746066743.480910:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982804224 00000100:00100000:1.0:1746066743.480944:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14890 00000100:00100000:1.0:1746066743.480949:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+9:32544:x1830882982804224:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066743.480958:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.480968:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff3a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.480991:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a400/0xf1867c21abfa4a35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeae expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.481000:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0cc00/0xf1867c21abfa4a43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfec3 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.481005:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.481007:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.481010:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff3a expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.481036:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0cc00/0xf1867c21abfa4a43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfec3 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.481046:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0cc00/0xf1867c21abfa4a43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfec3 expref: 10 pid: 13363 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.481057:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984278144:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.481128:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a400/0xf1867c21abfa4a35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeae expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.481135:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a400/0xf1867c21abfa4a35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeae expref: 25 pid: 9590 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.481141:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984278272:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.481154:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.483985:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.484084:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984278144:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.484096:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984278272:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.484123:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff3a expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.484139:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326da00, rc 0) 00000100:00100000:1.0:1746066743.484178:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:32544:x1830882982804224:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3228us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.484186:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14890 00000100:00100000:0.0:1746066743.485075:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.488507:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.488541:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982804864 00000100:00100000:1.0:1746066743.488548:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982804864 00000100:00100000:1.0:1746066743.488587:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16094 00000100:00100000:1.0:1746066743.488595:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:32552:x1830882982804864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.488617:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.488633:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff41 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.488708:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488736:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488747:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488757:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488768:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488773:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488878:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa4b2a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488905:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa4b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488911:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa4b2a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066743.488921:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066743.488990:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.488996:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489002:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489007:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489012:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d93c600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066743.489015:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489022:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489033:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066743.489036:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066743.489040:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489045:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c600/0xf1867c21abfa4b1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489061:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489066:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489071:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489075:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d93c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066743.489077:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489081:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489086:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009fc3d400) 00010000:00010000:1.0:1746066743.489088:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066743.489090:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489093:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4b23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.489120:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff41 expref: 15 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.489129:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa4b2a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff41 expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.489143:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.489145:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066743.489147:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93da00, rc 0) 00000100:00100000:1.0:1746066743.489167:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:32552:x1830882982804864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 574us (668us total) trans 8589936394 rc 0/0 00000100:00100000:1.0:1746066743.489173:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16094 00000100:00100000:0.0:1746066743.494777:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.495439:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.495453:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.495475:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.495486:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.495497:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.495514:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.496055:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14895 00000100:00100000:1.0:1746066743.496061:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982805632:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.496067:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.496073:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff5d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.496082:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.496083:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.496088:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff5d expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.496101:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff5d expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.496107:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93ce00, rc 0) 00000100:00100000:1.0:1746066743.496123:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982805632:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 63us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.496131:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14895 00000100:00100000:1.0:1746066743.496141:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14896 00000100:00100000:1.0:1746066743.496145:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982805888:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.496150:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.496155:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d93c800/0xf1867c21abfa4b5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff6b expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.496175:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984279040:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.496193:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.498301:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:0.0:1746066743.500044:0:9591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066743 -> 1746066744 00002000:00010000:0.0:1746066743.500046:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066743 -> 1746066744 00000100:00100000:0.0:1746066743.500054:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984279040:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066743.500069:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d93c800/0xf1867c21abfa4b5b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff6b expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.500077:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d93c800/0xf1867c21abfa4b5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff6b expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.500117:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93c800, rc 0) 00000100:00100000:0.0:1746066743.500197:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982805888:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4050us (4681us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066743.500202:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14896 00000100:00100000:0.0:1746066743.500920:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.504209:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.505436:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.507481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.507661:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.507734:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982807040 00000100:00100000:0.0:1746066743.507741:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982807040 00010000:00010000:0.0:1746066743.507764:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfa4b0e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff33 expref: 10 pid: 13370 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066743.507791:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982806912 00000100:00100000:0.0:1746066743.507794:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982806912 00010000:00010000:0.0:1746066743.507802:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa4b2a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff41 expref: 15 pid: 7243 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066743.507815:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6608 00000100:00100000:0.0:1746066743.507820:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982807040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066743.507830:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066743.507835:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfa4b0e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff33 expref: 10 pid: 13370 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.507842:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfa4b0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff33 expref: 10 pid: 13370 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.507861:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47600/0xf1867c21abfa4b0e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff33 expref: 10 pid: 13370 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.507874:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066743.508025:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3200/0xf1867c21abfa4b77 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066743.508033:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3200/0xf1867c21abfa4b77 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066743.508037:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066743.508309:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982807040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 487us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.508315:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6608 00000100:00100000:0.0:1746066743.511357:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.511428:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.516933:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.517815:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.521059:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.521082:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.521098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.521115:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982807680 00000100:00100000:0.0:1746066743.521120:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982807680 00000100:00100000:0.0:1746066743.521157:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982807936 00000100:00100000:0.0:1746066743.521159:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982807936 00000100:00100000:0.0:1746066743.521168:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982807808 00000100:00100000:0.0:1746066743.521169:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982807808 00000100:00100000:0.0:1746066743.521179:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14900 00000100:00100000:0.0:1746066743.521185:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982807680:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066743.521202:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.521216:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff95 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.521237:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.521238:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.521246:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.521260:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.521269:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6200, rc 0) 00000100:00100000:0.0:1746066743.521294:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982807680:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 109us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.521299:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14900 00000100:00100000:0.0:1746066743.521311:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14901 00000100:00100000:0.0:1746066743.521316:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982807936:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066743.521318:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14902 00010000:00010000:0.0:1746066743.521323:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066743.521324:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882982807808:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.521330:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.521331:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa4ba1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cffa3 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.521336:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d93cc00/0xf1867c21abfa4ba8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cff9c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.521365:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984280064:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066743.521365:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984280192:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.521527:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.521905:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.521948:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.526830:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984280064:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.526848:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d93cc00/0xf1867c21abfa4ba8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff9c expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.526857:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d93cc00/0xf1867c21abfa4ba8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff9c expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.526872:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93cc00, rc 0) 00000100:00100000:1.0:1746066743.526933:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882982807808:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5607us (5832us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.526942:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14902 00000100:00100000:0.0:1746066743.527077:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.528718:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.528766:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.529180:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3720 00000100:00100000:1.0:1746066743.529188:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982808704:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066743.539190:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982808704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10001us (10421us total) trans 0 rc 643072/643072 00000100:00100000:0.0:1746066743.539200:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3720 00002000:00100000:0.0:1746066743.539210:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1454080->2097151) req@ffff8800958aca80 x1830882982808704/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/440 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.539219:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aca80 with x1830882982808704 ext(1454080->2097151) 00002000:00010000:0.0:1746066743.539224:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958aca80 00000100:00100000:0.0:1746066743.542372:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.542407:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.542434:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.542459:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.542474:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982809344 00000100:00100000:0.0:1746066743.542474:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.542478:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982809344 00000100:00100000:0.0:1746066743.542497:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.542511:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982809472 00000100:00100000:1.0:1746066743.542513:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982809472 00000100:00100000:0.0:1746066743.542515:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982809600 00000100:00100000:0.0:1746066743.542518:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982809600 00000100:00100000:1.0:1746066743.542522:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982809728 00000100:00100000:1.0:1746066743.542523:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982809728 00000100:00100000:1.0:1746066743.542531:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982809856 00000100:00100000:1.0:1746066743.542532:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982809856 00000100:00100000:0.0:1746066743.542555:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14904 00000100:00100000:0.0:1746066743.542564:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882982809344:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066743.542611:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa4bcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.542628:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 8 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.542635:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066743.542637:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066743.542639:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa4bcb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.542668:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 8 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.542681:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 8 pid: 12255 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066743.542693:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984280448:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066743.542768:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.542789:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14906 00000100:00100000:0.0:1746066743.542795:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882982809728:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066743.542815:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa4bd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.542825:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.542837:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa4b46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff64 expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.542843:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.542849:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.542851:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.542853:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa4bd9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.542870:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.542876:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 27 pid: 9591 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746066743.542912:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984280704:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.543021:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14907 00000100:00100000:1.0:1746066743.543027:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882982809216:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066743.543044:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.543055:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d800/0xf1867c21abfa4b7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff87 expref: 21 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.543061:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.543070:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.543071:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.543073:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.543088:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.543091:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa4b46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff64 expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.543096:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 18 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:0.0:1746066743.543099:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa4b46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff64 expref: 18 pid: 9592 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.543104:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984280832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066743.543108:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984280960:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.543133:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d800/0xf1867c21abfa4b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff87 expref: 21 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.543136:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.543140:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d800/0xf1867c21abfa4b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff87 expref: 21 pid: 1893 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.543143:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 21 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.543147:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984281088:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066743.543151:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984281216:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.543162:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009542e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.543167:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.549981:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.551187:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984280704:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.551198:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984280960:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.551215:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984280832:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.551222:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984281088:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.551236:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.551378:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.551843:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.551875:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984281216:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.551906:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa4bd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.561757:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.561822:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.561838:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.561855:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982810240 00000100:00100000:1.0:1746066743.561863:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982810240 00010000:00010000:1.0:1746066743.561907:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 19 pid: 9591 timeout: 811 lvb_type: 1 00000100:00100000:0.0:1746066743.562219:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.563477:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.563548:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982810624 00000100:00100000:1.0:1746066743.563554:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982810624 00010000:00010000:1.0:1746066743.563579:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 28 pid: 9591 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.563603:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982811008 00000100:00100000:1.0:1746066743.563606:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982811008 00010000:00010000:1.0:1746066743.563617:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 22 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.563625:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982811136 00000100:00100000:1.0:1746066743.563627:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982811136 00010000:00010000:1.0:1746066743.563636:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff5d expref: 20 pid: 9591 timeout: 811 lvb_type: 1 00000100:00100000:1.0:1746066743.563647:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6612 00000100:00100000:1.0:1746066743.563654:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882982810240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.563668:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.563689:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 20 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.563699:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 20 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.563728:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6200/0xf1867c21abfa4b9a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff95 expref: 20 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.563748:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.563783:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982810240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.563789:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6612 00000100:00100000:1.0:1746066743.563831:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6613 00000100:00100000:1.0:1746066743.563836:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882982810624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.563843:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.563852:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 28 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.563860:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 28 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.563875:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa4a74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfee6 expref: 28 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.563898:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.563912:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982810624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.563917:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6613 00000100:00100000:1.0:1746066743.563928:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6614 00000100:00100000:1.0:1746066743.563932:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982811008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.563938:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.563944:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 22 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.563951:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 22 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.563962:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa4a66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfedf expref: 22 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.563970:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.563981:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982811008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 50us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.563985:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6614 00000100:00100000:1.0:1746066743.563994:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6615 00000100:00100000:1.0:1746066743.563998:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982811136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.564003:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.564011:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b54 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff5d expref: 18 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.564018:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff5d expref: 18 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.564026:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa4b54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff5d expref: 18 pid: 9591 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.564036:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.564047:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982811136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.564052:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6615 00000100:00100000:0.0:1746066743.564617:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.564632:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6616 00000100:00100000:0.0:1746066743.564638:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982811392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066743.564645:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066743.564654:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d800/0xf1867c21abfa4b7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff87 expref: 21 pid: 1893 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.564661:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d800/0xf1867c21abfa4b7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff87 expref: 21 pid: 1893 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.564672:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88011dd1d800/0xf1867c21abfa4b7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff87 expref: 21 pid: 1893 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.564688:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.564690:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.564693:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.564700:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.564734:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066743.564753:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982811392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.565462:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.565498:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.565537:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.565548:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982810880 00000100:00100000:1.0:1746066743.565551:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982810880 00010000:00010000:1.0:1746066743.565563:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa4a5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfed8 expref: 27 pid: 20361 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.565577:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6618 00000100:00100000:1.0:1746066743.565582:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982810880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.565588:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.565596:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa4a5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfed8 expref: 27 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.565605:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa4a5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfed8 expref: 27 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.565617:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa4a5f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfed8 expref: 27 pid: 20361 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.565625:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.565641:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882982810880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.565646:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6618 00000100:00100000:1.0:1746066743.565677:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.565688:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982811264 00000100:00100000:1.0:1746066743.565691:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982811264 00010000:00010000:1.0:1746066743.565700:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa4a3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeb5 expref: 21 pid: 9590 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.565714:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6619 00000100:00100000:1.0:1746066743.565734:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982811264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.565742:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.565749:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa4a3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeb5 expref: 21 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.565757:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa4a3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeb5 expref: 21 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.565773:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa4a3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfeb5 expref: 21 pid: 9590 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.565782:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.565783:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.565786:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a22e00/0xf1867c21abfa4bee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.565793:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a22e00/0xf1867c21abfa4bee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.565808:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.565822:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982811264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.565827:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6619 00000100:00100000:0.0:1746066743.565941:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6616 00010000:00010000:0.0:1746066743.565977:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.565984:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.565995:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.566000:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.566006:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.566015:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d93de00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066743.566018:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.566023:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.566031:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.566036:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d93de00/0xf1867c21abfa4be0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.566066:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982809216:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 23039us (23704us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.566071:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14907 00000100:00100000:0.0:1746066743.571868:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.571915:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982811776 00000100:00100000:0.0:1746066743.571923:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982811776 00010000:00010000:0.0:1746066743.571956:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 14 pid: 12255 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066743.571981:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6620 00000100:00100000:0.0:1746066743.571988:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882982811776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066743.572001:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066743.572021:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 14 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.572032:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 14 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.572052:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa4aeb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1593344->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff2c expref: 14 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.572065:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.572067:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.572071:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa4bcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.572079:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6000/0xf1867c21abfa4bcb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.572108:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066743.572146:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882982811776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.572151:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6620 00000100:00100000:0.0:1746066743.574668:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.574696:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.574714:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.574740:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.574752:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.574765:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.574808:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.574907:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14912 00000100:00100000:1.0:1746066743.574915:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882982812032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.574924:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.574933:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cffcd expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.574934:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14913 00000100:00100000:0.0:1746066743.574940:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982812160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.574945:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.574947:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.574947:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.574951:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.574953:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa4c2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cffd4 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.574961:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.574968:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993800, rc 0) 00000100:00100000:0.0:1746066743.574984:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984281984:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.574992:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982812032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.574998:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14912 00000100:00100000:1.0:1746066743.575020:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14916 00000100:00100000:0.0:1746066743.575020:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.575025:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982812544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.575031:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.575038:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa4c42 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cffe9 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.575062:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984282112:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.575087:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.575101:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982812672 00000100:00100000:1.0:1746066743.575104:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982812672 00010000:00010000:1.0:1746066743.575118:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff3a expref: 13 pid: 12255 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.575135:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6621 00000100:00100000:1.0:1746066743.575139:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882982812672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.575147:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.575158:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff3a expref: 13 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.575171:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff3a expref: 13 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.575184:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.575186:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.575189:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356bc00/0xf1867c21abfa4bd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.575195:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356bc00/0xf1867c21abfa4bd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.575221:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.575249:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882982812672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.575255:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6621 00010000:00010000:0.0:1746066743.580074:0:11630:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880098fb5880 x1830882984281984) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff3a expref: 12 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.580106:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326da00/0xf1867c21abfa4af9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff3a expref: 12 pid: 12255 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066743.580116:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984281984:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066743.580140:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa4c2d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffd4 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.580154:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa4c2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffd4 expref: 31 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.580166:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d800, rc 0) 00000100:00100000:0.0:1746066743.580185:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982812160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5246us (5471us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066743.580192:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14913 00000100:00100000:1.0:1746066743.582421:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984282112:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.582450:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa4c42 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe9 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.582465:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa4c42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe9 expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.582485:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993000, rc 0) 00000100:00100000:1.0:1746066743.582523:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982812544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7497us (7756us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.582531:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14916 00000100:00100000:1.0:1746066743.582617:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882982810752:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 16989us (17117us total) trans 17179874235 rc 0/0 00000100:00100000:1.0:1746066743.582628:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 786 00002000:00100000:1.0:1746066743.582636:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2330624->2990079) req@ffff8800958aea00 x1830882982810752/t17179874235(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/448 e 0 to 0 dl 1746066754 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.582645:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aea00 with x1830882982810752 ext(2330624->2990079) 00010000:00010000:1.0:1746066743.582651:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2990079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.582663:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2990079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746066743.582669:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958aea00 00000100:00100000:0.0:1746066743.588971:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.589014:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982813056 00000100:00100000:1.0:1746066743.589025:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982813056 00010000:00010000:1.0:1746066743.589062:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2990079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.589089:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6622 00000100:00100000:1.0:1746066743.589096:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982813056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.589106:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.589122:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->2990079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.589132:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->2990079) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.589155:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa4ae4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->2990079) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff25 expref: 28 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.589168:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.589170:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.589173:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa4be7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.589181:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa4be7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.589217:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.589262:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982813056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 165us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.589268:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6622 00000100:00100000:1.0:1746066743.593458:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.595618:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982813824 00000100:00100000:0.0:1746066743.595627:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982813824 00002000:00100000:0.0:1746066743.595660:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800966e1f80 x1830882982813824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.595668:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1f80 with x1830882982813824 ext(1048576->2097151) 00002000:00010000:0.0:1746066743.595673:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1f80 00000100:00100000:0.0:1746066743.595690:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3723 00000100:00100000:0.0:1746066743.595697:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982813824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066743.600271:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982814080 00000100:00100000:1.0:1746066743.600281:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982814080 00010000:00010000:1.0:1746066743.600316:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226c000/0xf1867c21abfa4a0b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe8b expref: 14 pid: 7244 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.600352:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982814208 00000100:00100000:1.0:1746066743.600358:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982814208 00010000:00010000:1.0:1746066743.600369:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226da00/0xf1867c21abfa49ef lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe6f expref: 34 pid: 7243 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.600382:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982813952 00000100:00100000:1.0:1746066743.600384:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982813952 00010000:00010000:1.0:1746066743.600395:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfa4a12 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe84 expref: 35 pid: 7245 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.600409:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6623 00000100:00100000:1.0:1746066743.600415:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982814080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.600427:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.600431:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226c000/0xf1867c21abfa4a0b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe8b expref: 14 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.600441:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226c000/0xf1867c21abfa4a0b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe8b expref: 14 pid: 7244 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.600472:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.600477:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.600485:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.600524:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982814080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.600533:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6623 00000100:00100000:1.0:1746066743.600661:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6625 00000100:00100000:1.0:1746066743.600668:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982813952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.600675:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.600679:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfa4a12 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe84 expref: 35 pid: 7245 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.600686:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4000/0xf1867c21abfa4a12 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfe84 expref: 35 pid: 7245 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.600700:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.600704:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.600708:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.600734:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982813952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.600740:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6625 00000100:00100000:1.0:1746066743.600855:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.600871:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982814592 00000100:00100000:1.0:1746066743.600874:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982814592 00010000:00010000:1.0:1746066743.600911:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa4a9e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff02 expref: 33 pid: 7243 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.600925:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6626 00000100:00100000:1.0:1746066743.600930:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882982814592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.600936:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.600939:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa4a9e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff02 expref: 33 pid: 7243 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.600946:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa4a9e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff02 expref: 33 pid: 7243 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.600955:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.600958:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.600962:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.600975:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882982814592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 45us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.600980:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6626 00000100:00100000:1.0:1746066743.601022:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.601033:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982814464 00000100:00100000:1.0:1746066743.601035:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982814464 00010000:00010000:1.0:1746066743.601045:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfa4ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff10 expref: 13 pid: 7243 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.601057:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6627 00000100:00100000:1.0:1746066743.601061:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882982814464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.601066:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.601069:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfa4ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff10 expref: 13 pid: 7243 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.601077:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfa4ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff10 expref: 13 pid: 7243 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.601087:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfa4ac8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cff10 expref: 13 pid: 7243 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.601098:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.601101:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.601107:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.601113:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.601125:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.601137:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882982814464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.601142:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6627 00000100:00100000:0.0:1746066743.606308:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982814720 00000100:00100000:0.0:1746066743.606317:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982814720 00000100:00100000:0.0:1746066743.606393:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16100 00000100:00100000:0.0:1746066743.606401:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:32552:x1830882982814720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066743.606423:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.606442:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22c00/0xf1867c21abfa4c57 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfff7 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.606510:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066743.606518:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22c00/0xf1867c21abfa4c57 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfff7 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.606550:0:7243:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066743.606562:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22c00/0xf1867c21abfa4c57 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfff7 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.606579:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066743.606581:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066743.606584:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22c00/0xf1867c21abfa4c57 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfff7 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.606589:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22c00, rc 0) 00000100:00100000:0.0:1746066743.607458:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:32552:x1830882982814720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1055us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.607465:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16100 00000100:00100000:1.0:1746066743.607823:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.607865:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.607907:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.607923:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.607938:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746066743.607942:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984282880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.607955:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.607964:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.607975:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.607993:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984283264 00000100:00100000:1.0:1746066743.607998:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984283264 00000100:00100000:1.0:1746066743.608020:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984283776 00000100:00100000:1.0:1746066743.608022:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984283776 00000100:00100000:1.0:1746066743.608030:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984282880 00000100:00100000:1.0:1746066743.608032:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984282880 00000100:00100000:1.0:1746066743.608040:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984283392 00000100:00100000:1.0:1746066743.608041:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984283392 00000100:00100000:1.0:1746066743.608052:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14918 00000100:00100000:1.0:1746066743.608057:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984283264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066743.608176:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:1.0:1746066743.608180:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.608181:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066743.608183:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.608185:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:1.0:1746066743.608208:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882984283264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (342us total) trans 21474841664 rc 0/0 00000100:00100000:1.0:1746066743.608213:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14918 00000100:00100000:1.0:1746066743.608225:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14919 00000100:00100000:1.0:1746066743.608229:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984283776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066743.608270:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:1.0:1746066743.608272:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.608274:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066743.608276:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.608278:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:1.0:1746066743.608295:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882984283776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (371us total) trans 21474841665 rc 0/0 00000100:00100000:1.0:1746066743.608300:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14919 00000100:00100000:1.0:1746066743.608309:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14920 00000100:00100000:1.0:1746066743.608313:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984282880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066743.608349:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066743.608351:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.608353:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.608355:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.608356:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:1.0:1746066743.608371:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882984282880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (415us total) trans 21474841666 rc 0/0 00000100:00100000:1.0:1746066743.608376:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14920 00000100:00100000:1.0:1746066743.608385:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14921 00000100:00100000:1.0:1746066743.608390:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3776:x1830882984283392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066743.608424:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:1.0:1746066743.608426:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.608428:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066743.608430:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066743.608432:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:1.0:1746066743.608446:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882984283392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (470us total) trans 21474841667 rc 0/0 00000100:00100000:1.0:1746066743.608450:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14921 00000004:00080000:1.0:1746066743.608483:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ad500/2, rc 0, transno 21474841666 00000100:00100000:1.0:1746066743.608490:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984282880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066743.608496:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958af100/2, rc 0, transno 21474841667 00000100:00100000:1.0:1746066743.608499:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066743.608505:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ad180/2, rc 0, transno 21474841664 00000100:00100000:1.0:1746066743.608507:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283264:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066743.608513:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098926a00/2, rc 0, transno 21474841665 00000100:00100000:1.0:1746066743.608515:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.608537:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746066743.608541:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.608557:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.608571:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984283904 00000100:00100000:1.0:1746066743.608574:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984283904 00000100:00100000:1.0:1746066743.608588:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14922 00000100:00100000:1.0:1746066743.608592:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3776:x1830882984283904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.608642:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+55:3776:x1830882984283904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (84us total) trans 21474841668 rc 0/0 00000100:00100000:1.0:1746066743.608647:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14922 00000004:00080000:1.0:1746066743.608664:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbdc00/2, rc 0, transno 21474841668 00000100:00100000:1.0:1746066743.608667:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984283904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.614484:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982814848 00000100:00100000:1.0:1746066743.614489:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982814848 00000100:00100000:1.0:1746066743.614519:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5835 00000100:00100000:1.0:1746066743.614526:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:32552:x1830882982814848:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:1.0:1746066743.614611:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:32552:x1830882982814848:12345-192.168.204.16@tcp:49:cat.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.614616:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5835 00000100:00100000:0.0:1746066743.614902:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984284032:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066743.614922:0:13370:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746066743.614979:0:13370:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746066743.614990:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32550:x1830882982813568:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 21899us (22123us total) trans 8589936399 rc 0/0 00000100:00100000:0.0:1746066743.614996:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16099 00010000:00010000:1.0:1746066743.615260:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.615269:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.615276:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.615282:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c15e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066743.615286:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.615293:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.615308:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.615311:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066743.615315:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.615321:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15e00/0xf1867c21abfa4c49 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00000100:00100000:0.0:1746066743.617707:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.618040:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16101 00000100:00100000:1.0:1746066743.618051:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:32556:x1830882982814976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.618075:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.618096:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa4c5e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14cfffe expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.618325:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa4c5e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfffe expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.618338:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa4c5e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfffe expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.618354:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.618357:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066743.618360:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a600, rc 0) 00000100:00100000:1.0:1746066743.618410:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:32556:x1830882982814976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 360us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.618416:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16101 00000100:00100000:0.0:1746066743.620296:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.620749:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982815104 00000100:00100000:1.0:1746066743.620757:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982815104 00000100:00100000:1.0:1746066743.620805:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16102 00000100:00100000:1.0:1746066743.620813:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32550:x1830882982815104:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.620835:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.620852:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfa4c65 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0005 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.620933:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfa4c65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0005 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.620956:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfa4c65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0005 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.620972:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.620975:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066743.620978:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2800, rc 0) 00000100:00100000:1.0:1746066743.621031:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32550:x1830882982815104:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 218us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.621036:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16102 00000100:00100000:0.0:1746066743.622226:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.623496:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.631555:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.631624:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.631649:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.631667:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982815872 00000100:00100000:0.0:1746066743.631669:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982815872 00000100:00100000:0.0:1746066743.631693:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982816128 00000100:00100000:0.0:1746066743.631694:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982816128 00000100:00100000:0.0:1746066743.631712:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14935 00000100:00100000:0.0:1746066743.631716:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982815872:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066743.631743:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.631761:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0013 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.631779:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.631781:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.631789:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.631802:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.631811:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93c800, rc 0) 00000100:00100000:0.0:1746066743.632036:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982815872:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 131us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.632042:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14935 00000100:00100000:0.0:1746066743.632070:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.632207:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.632237:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.632429:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982816256 00000100:00100000:1.0:1746066743.632434:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982816256 00000100:00100000:1.0:1746066743.632453:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14938 00000100:00100000:1.0:1746066743.632458:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982816000:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.632465:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.632474:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d001a expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.632484:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.632485:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.632490:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.632499:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.632511:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7000, rc 0) 00000100:00100000:1.0:1746066743.632527:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982816000:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 69us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.632531:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14938 00000100:00100000:1.0:1746066743.633703:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.638752:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.640007:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.640043:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.640070:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.640083:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.640096:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.640108:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.640149:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.640208:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982817280 00000100:00100000:1.0:1746066743.640213:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982817280 00000100:00100000:1.0:1746066743.640245:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982817536 00000100:00100000:1.0:1746066743.640248:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982817536 00000100:00100000:1.0:1746066743.640262:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982817920 00000100:00100000:1.0:1746066743.640264:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982817920 00000100:00100000:1.0:1746066743.640275:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982817792 00000100:00100000:1.0:1746066743.640276:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982817792 00000100:00100000:1.0:1746066743.640285:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982817152 00000100:00100000:1.0:1746066743.640287:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982817152 00000100:00100000:1.0:1746066743.640294:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982817408 00000100:00100000:1.0:1746066743.640296:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982817408 00000100:00100000:1.0:1746066743.640304:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14941 00000100:00100000:1.0:1746066743.640310:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982817280:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066743.640373:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982817280:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 64us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.640379:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14941 00000100:00100000:1.0:1746066743.640390:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14943 00000100:00100000:1.0:1746066743.640394:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:32552:x1830882982817920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.640401:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.640413:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4cc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d004b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.640429:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.640431:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.640437:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d004b expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.640448:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801310f7200/0xf1867c21abfa4cc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d004b expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.640457:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801310f7200, rc 0) 00000100:00100000:1.0:1746066743.640467:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:32552:x1830882982817920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.640471:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14943 00000100:00100000:1.0:1746066743.641798:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982817664 00000100:00100000:1.0:1746066743.641802:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982817664 00000100:00100000:1.0:1746066743.641826:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14947 00000100:00100000:1.0:1746066743.641831:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882982817664:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066743.641906:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882982817664:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.641912:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14947 00000100:00100000:0.0:1746066743.642302:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.647569:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.647629:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.647843:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.648174:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.650754:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982819072 00000100:00100000:0.0:1746066743.650760:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982819072 00000100:00100000:0.0:1746066743.652809:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.654575:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.655590:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.655818:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14953 00000100:00100000:1.0:1746066743.655828:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982818944:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066743.655957:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982818944:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 129us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.655965:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14953 00000100:00100000:0.0:1746066743.656327:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.661156:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.665042:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.669804:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.669869:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.669923:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.669942:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.669955:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.669983:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.670065:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982819840 00000100:00100000:1.0:1746066743.670074:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982819840 00010000:00010000:1.0:1746066743.670112:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfa4c65 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0005 expref: 9 pid: 7243 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.670139:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982820224 00000100:00100000:1.0:1746066743.670142:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982820224 00010000:00010000:1.0:1746066743.670151:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22c00/0xf1867c21abfa4c57 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cfff7 expref: 9 pid: 7243 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.670163:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982820352 00000100:00100000:1.0:1746066743.670165:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982820352 00010000:00010000:1.0:1746066743.670172:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7de00/0xf1867c21abfa4c73 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d000c expref: 10 pid: 13370 timeout: 811 lvb_type: 0 00000100:00100000:0.0:1746066743.673617:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.673945:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6629 00000100:00100000:1.0:1746066743.673959:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882982819840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.673977:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.673988:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfa4c65 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0005 expref: 10 pid: 7243 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.674002:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098be2800/0xf1867c21abfa4c65 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0005 expref: 10 pid: 7243 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.674024:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.674029:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.674036:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066743.674042:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.674079:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882982819840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.674857:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6629 00000100:00100000:0.0:1746066743.679364:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.680167:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984285952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.680196:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.680226:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984286464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.680242:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.680244:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984285696 00000100:00100000:0.0:1746066743.680248:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984285696 00000100:00100000:1.0:1746066743.680267:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984285952 00000100:00100000:1.0:1746066743.680270:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984285952 00000100:00100000:0.0:1746066743.682263:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14961 00000100:00100000:0.0:1746066743.682270:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984286208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066743.682310:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066743.682312:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.682314:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066743.682316:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.682318:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066743.682343:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984286208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1581us total) trans 17179874249 rc 0/0 00000100:00100000:0.0:1746066743.682348:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14961 00000004:00080000:0.0:1746066743.682396:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbed80/2, rc 0, transno 17179874249 00000100:00100000:0.0:1746066743.682402:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984286208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066743.682799:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbd180/2, rc 0, transno 17179874251 00000100:00100000:1.0:1746066743.682803:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984285952:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066743.682811:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80e00/2, rc 0, transno 17179874246 00000100:00100000:1.0:1746066743.682813:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984286464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.682927:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984286976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.682951:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984286720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.683005:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.683005:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.683024:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984287232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.683060:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984287488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.683098:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984286720 00000100:00100000:1.0:1746066743.683101:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984286720 00000100:00100000:1.0:1746066743.683115:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984286976 00000100:00100000:1.0:1746066743.683117:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984286976 00000100:00100000:1.0:1746066743.683126:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14965 00000100:00100000:1.0:1746066743.683129:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882984286720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.683154:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882982820608:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11194us (13168us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066743.683161:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3728 00002000:00100000:0.0:1746066743.683170:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a5d7c000 x1830882982820608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/440 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.683178:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c000 with x1830882982820608 ext(1048576->2097151) 00002000:00010000:0.0:1746066743.683184:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c000 00002000:00010000:1.0:1746066743.683186:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066743.683189:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.683191:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:1.0:1746066743.683193:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.683194:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:0.0:1746066743.683201:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14966 00000100:00100000:0.0:1746066743.683205:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882984286976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.683214:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3774:x1830882984286720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (209us total) trans 21474841674 rc 0/0 00000100:00100000:1.0:1746066743.683219:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14965 00002000:00010000:0.0:1746066743.683244:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:0.0:1746066743.683246:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.683248:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.683250:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:0.0:1746066743.683251:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:0.0:1746066743.683273:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882984286976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (268us total) trans 21474841675 rc 0/0 00000100:00100000:0.0:1746066743.683277:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14966 00000100:00100000:0.0:1746066743.683285:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984287104 00000100:00100000:0.0:1746066743.683287:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984287104 00000100:00100000:0.0:1746066743.683298:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984287616 00000100:00100000:0.0:1746066743.683299:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984287616 00000100:00100000:0.0:1746066743.683306:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14967 00000100:00100000:0.0:1746066743.683309:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3777:x1830882984287104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066743.683344:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:0.0:1746066743.683346:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.683348:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066743.683350:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066743.683351:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:0.0:1746066743.683368:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+63:3777:x1830882984287104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (337us total) trans 21474841676 rc 0/0 00000100:00100000:0.0:1746066743.683373:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14967 00000100:00100000:0.0:1746066743.683389:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066743.683406:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80380/2, rc 0, transno 21474841674 00000100:00100000:0.0:1746066743.683411:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984286720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.683415:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746066743.683419:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984286848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.683433:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.683440:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984287360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.683451:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066743.683462:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984286848 00000100:00100000:0.0:1746066743.683465:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984286848 00000100:00100000:0.0:1746066743.683473:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984287360 00000100:00100000:0.0:1746066743.683475:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984287360 00000100:00100000:0.0:1746066743.683482:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14970 00000100:00100000:0.0:1746066743.683486:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3774:x1830882984286848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066743.683520:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066743.683522:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.683524:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066743 -> 1746066743 00002000:00010000:0.0:1746066743.683526:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:0.0:1746066743.683527:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066743.683542:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3774:x1830882984286848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (108us total) trans 21474841679 rc 0/0 00000100:00100000:0.0:1746066743.683547:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14970 00000004:00080000:0.0:1746066743.683562:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80000/2, rc 0, transno 21474841679 00000100:00100000:0.0:1746066743.683565:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984286848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.683570:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce04a80/2, rc 0, transno 21474841680 00000100:00100000:0.0:1746066743.683573:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984287360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.683578:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83480/2, rc 0, transno 21474841678 00000100:00100000:0.0:1746066743.683581:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984287232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066743.683951:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbdf80/2, rc 0, transno 17179874252 00000100:00100000:0.0:1746066743.683954:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984285696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066743.684119:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066743.684139:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83b80/2, rc 0, transno 21474841675 00000100:00100000:1.0:1746066743.684142:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984286976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.684194:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984288000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.684213:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066743.684372:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984288000 00000100:00100000:1.0:1746066743.684376:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984288000 00000004:00080000:1.0:1746066743.684388:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce07b80/2, rc 0, transno 21474841681 00000100:00100000:1.0:1746066743.684432:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984287488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.684452:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14973 00000100:00100000:1.0:1746066743.684456:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3774:x1830882984288000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066743.684511:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3774:x1830882984288000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (297us total) trans 21474841682 rc 0/0 00000100:00100000:1.0:1746066743.684516:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14973 00000004:00080000:0.0:1746066743.684565:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce06300/2, rc 0, transno 21474841682 00000100:00100000:0.0:1746066743.684568:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984288000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066743.686915:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.687936:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.687974:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982821120 00000100:00100000:1.0:1746066743.687979:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982821120 00000100:00100000:0.0:1746066743.687994:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.688012:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5837 00000100:00100000:1.0:1746066743.688018:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:32552:x1830882982821120:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:1.0:1746066743.688069:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:32552:x1830882982821120:12345-192.168.204.16@tcp:49:cat.0 Request processed in 51us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.688075:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5837 00000100:00100000:0.0:1746066743.692625:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.692676:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.694947:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.695021:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.695214:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982821632 00000100:00100000:1.0:1746066743.695218:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982821632 00000100:00100000:1.0:1746066743.695247:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 769 00000100:00100000:1.0:1746066743.695251:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882982821632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.695260:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.695275:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa4d14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d006e expref: 9 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.695291:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.695294:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.695338:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882982821632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 85us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.695343:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 769 00000100:00100000:0.0:1746066743.695767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.697998:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.698083:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.698596:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.699440:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.699507:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.707290:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.711243:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.711278:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.711299:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.711969:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982823296 00000100:00100000:1.0:1746066743.711979:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982823296 00000100:00100000:1.0:1746066743.712060:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982823808 00000100:00100000:1.0:1746066743.712063:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982823808 00002000:00100000:1.0:1746066743.712082:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (4112384->4116479) req@ffff880095ce0380 x1830882982823808/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.712089:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0380 with x1830882982823808 ext(4112384->4116479) 00002000:00010000:1.0:1746066743.712095:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce0380 00000100:00100000:0.0:1746066743.712145:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.712386:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3730 00000100:00100000:0.0:1746066743.712395:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982823296:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066743.712432:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.712444:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.712446:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.712451:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.712462:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.724246:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.724279:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.724362:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.725523:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.726183:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.726728:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982824832 00000100:00100000:1.0:1746066743.726734:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982824832 00000100:00100000:1.0:1746066743.729909:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982825600 00000100:00100000:1.0:1746066743.729924:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982825600 00000100:00100000:1.0:1746066743.729995:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982825344 00000100:00100000:1.0:1746066743.729998:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982825344 00000100:00100000:1.0:1746066743.730026:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3735 00000100:00100000:1.0:1746066743.730035:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982824576:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066743.730075:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.730095:0:20358:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa4d37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d008a expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.730103:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.730105:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.730108:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.730141:0:20358:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa4d37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d008a expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.730154:0:20358:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa4d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d008a expref: 12 pid: 12255 timeout: 811 lvb_type: 0 00000100:00100000:1.0:1746066743.730168:0:20358:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:20358:1830882984288896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.730257:0:20358:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.730279:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3736 00000100:00100000:1.0:1746066743.730286:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882982824832:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066743.730304:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.730311:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.730313:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.730318:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.730330:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.732189:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066743.732933:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.732942:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.732949:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.732955:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f6a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066743.732959:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.732966:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.732979:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.732983:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6a00/0xf1867c21abfa4d4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.733025:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2016:x1830882982823296:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20632us (21791us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066743.733032:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3730 00010000:00010000:0.0:1746066743.737238:0:9596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa4d53 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.737255:0:9596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa4d53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.737263:0:9596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa4d53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.737270:0:9596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066743.737274:0:9596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa4d53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.737280:0:9596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa4d53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.737299:0:9596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa4d53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.737305:0:9596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa4d53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.739119:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982824064:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 25654us (26960us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066743.739133:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3733 00000100:00100000:0.0:1746066743.749812:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.749963:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.749980:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982826112 00000100:00100000:0.0:1746066743.749984:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982826112 00002000:00100000:0.0:1746066743.750011:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1736704->2097151) req@ffff88009d9b3480 x1830882982826112/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.750020:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882982826112 ext(1736704->2097151) 00010000:00010000:0.0:1746066743.750028:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa4d37 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d008a expref: 13 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:0.0:1746066743.750038:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa4d37 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d008a expref: 13 pid: 12255 timeout: 811 lvb_type: 0 00002000:00010000:0.0:1746066743.750045:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b3480 00000100:00100000:0.0:1746066743.750061:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 787 00000100:00100000:0.0:1746066743.750066:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882982826112:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066743.750159:0:20358:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0001_UUID:20358:1830882984288896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.750171:0:20358:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.750319:0:13353:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.750327:0:13353:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.750334:0:13353:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.750340:0:13353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066743.750343:0:13353:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.750349:0:13353:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.750364:0:13353:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.750368:0:13353:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4d61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.750414:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882982824832:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20128us (26133us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066743.750422:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3736 00000100:00100000:1.0:1746066743.755687:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982826240 00000100:00100000:1.0:1746066743.755697:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982826240 00002000:00100000:1.0:1746066743.755758:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (4112384->4194303) req@ffff88009c7fe300 x1830882982826240/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.755769:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fe300 with x1830882982826240 ext(4112384->4194303) 00010000:00010000:1.0:1746066743.755778:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 28 pid: 9592 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.755792:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 28 pid: 9592 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746066743.755799:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fe300 00000100:00100000:1.0:1746066743.755830:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 788 00000100:00100000:1.0:1746066743.755838:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882982826240:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066743.758981:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6638 00000100:00100000:1.0:1746066743.758989:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882982826752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.758998:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.759008:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a22200/0xf1867c21abfa4c34 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffdb expref: 29 pid: 13363 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.759018:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a22200/0xf1867c21abfa4c34 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffdb expref: 29 pid: 13363 timeout: 811 lvb_type: 1 00010000:00010000:1.0:1746066743.759032:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.759034:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.759041:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfa4d84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d009f expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.759050:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfa4d84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d009f expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.759081:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589a600/0xf1867c21abfa4d84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d009f expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.759094:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984289536:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.759143:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.759211:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982826112:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9144us (9248us total) trans 17179874253 rc 0/0 00000100:00100000:1.0:1746066743.759219:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 787 00002000:00100000:1.0:1746066743.759227:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1736704->2097151) req@ffff88009d9b3480 x1830882982826112/t17179874253(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/448 e 0 to 0 dl 1746066754 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.759235:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882982826112 ext(1736704->2097151) 00010000:00010000:1.0:1746066743.759242:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa4d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d008a expref: 16 pid: 12255 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.759251:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa4d37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1736704->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d008a expref: 16 pid: 12255 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746066743.759261:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b3480 00000100:00100000:0.0:1746066743.763278:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.763323:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.763810:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984289536:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.763829:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.763908:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882982826752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4918us (5267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.763916:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6638 00000100:00100000:1.0:1746066743.763969:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982827136 00000100:00100000:1.0:1746066743.763972:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982827136 00002000:00100000:1.0:1746066743.763999:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1126400->1130495) req@ffff88009d9b1c00 x1830882982827136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.764009:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882982827136 ext(1126400->1130495) 00002000:00010000:1.0:1746066743.764013:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:1.0:1746066743.764039:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3741 00000100:00100000:1.0:1746066743.764044:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982827136:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746066743.764138:0:20358:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.764147:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.764153:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982827136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 108us (828us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066743.764159:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3741 00002000:00100000:1.0:1746066743.764164:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1126400->1130495) req@ffff88009d9b1c00 x1830882982827136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.764171:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882982827136 ext(1126400->1130495) 00002000:00010000:1.0:1746066743.764174:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:1.0:1746066743.766252:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882982826240:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10403us (10944us total) trans 17179874254 rc 0/0 00000100:00100000:1.0:1746066743.766268:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 788 00002000:00100000:1.0:1746066743.766280:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (4112384->4194303) req@ffff88009c7fe300 x1830882982826240/t17179874254(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/448 e 0 to 0 dl 1746066754 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.766290:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fe300 with x1830882982826240 ext(4112384->4194303) 00010000:00010000:1.0:1746066743.766300:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.766313:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746066743.766321:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fe300 00000100:00100000:0.0:1746066743.769106:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982827392 00000100:00100000:0.0:1746066743.769117:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982827392 00000100:00100000:0.0:1746066743.769174:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5838 00000100:00100000:0.0:1746066743.769182:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+8:32558:x1830882982827392:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066743.769418:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+9:32558:x1830882982827392:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 235us (662us total) trans 8589936403 rc 0/0 00000100:00100000:0.0:1746066743.769424:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5838 00000100:00100000:1.0:1746066743.772983:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982827904 00000100:00100000:1.0:1746066743.772993:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982827904 00002000:00100000:1.0:1746066743.773038:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4112383) req@ffff88009c7fd880 x1830882982827904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.773048:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fd880 with x1830882982827904 ext(2097152->4112383) 00010000:00010000:1.0:1746066743.773056:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.773070:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 811 lvb_type: 0 00002000:00010000:1.0:1746066743.773076:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fd880 00000100:00100000:1.0:1746066743.773108:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 789 00000100:00100000:1.0:1746066743.773115:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982827904:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746066743.779825:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.779843:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.779852:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.779859:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066743.779864:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.779871:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.779906:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.779918:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4d5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.781636:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982824576:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 51592us (57392us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066743.781649:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3735 00000100:00100000:0.0:1746066743.781841:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982827648 00000100:00100000:0.0:1746066743.781849:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982827648 00002000:00100000:0.0:1746066743.781903:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88011f766680 x1830882982827648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.781913:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766680 with x1830882982827648 ext(2097152->4194303) 00002000:00010000:0.0:1746066743.781919:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f766680 00000100:00100000:0.0:1746066743.781948:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3742 00000100:00100000:0.0:1746066743.781956:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982827648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066743.803575:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982827904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 30448us (30812us total) trans 0 rc 2015232/2015232 00000100:00100000:1.0:1746066743.803589:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 789 00002000:00100000:1.0:1746066743.803603:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4112383) req@ffff88009c7fd880 x1830882982827904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/440 e 0 to 0 dl 1746066754 ref 1 fl Complete:H/200/0 rc 2015232/2015232 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.803613:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fd880 with x1830882982827904 ext(2097152->4112383) 00010000:00010000:1.0:1746066743.803624:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 811 lvb_type: 0 00010000:00010000:1.0:1746066743.803639:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 812 lvb_type: 0 00002000:00010000:1.0:1746066743.803645:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fd880 00000100:00100000:0.0:1746066743.817949:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.817982:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982828032 00000100:00100000:1.0:1746066743.817993:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982828032 00010000:00010000:1.0:1746066743.818033:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066743.818083:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6640 00000100:00100000:1.0:1746066743.818092:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882982828032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.818107:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.818128:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066743.818141:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066743.818169:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa4d30 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0083 expref: 30 pid: 9592 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066743.818204:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.818206:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.818212:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa4d6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.818221:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa4d6f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.818229:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.818230:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.818233:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfa4d7d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.818239:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895c00/0xf1867c21abfa4d7d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.818244:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.818245:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.818250:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfa4d8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00a6 expref: 14 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.818257:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfa4d8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00a6 expref: 14 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.818309:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfa4d8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00a6 expref: 14 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.818324:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984289664:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.818434:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.821923:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984289664:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.821949:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.821987:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882982828032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3895us (4046us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.821998:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6640 00000100:00100000:0.0:1746066743.824281:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.824325:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.824978:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14981 00000100:00100000:0.0:1746066743.824986:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+28:32560:x1830882982828288:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066743.824994:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.825004:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d00b4 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.825021:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa4c3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe2 expref: 29 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.825030:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa4d3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0091 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.825036:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfa4c88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d002f expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.825040:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.825041:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.825045:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->4337663] (req 4194304->4337663) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 29 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.825075:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfa4c88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d002f expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.825085:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7dc00/0xf1867c21abfa4c88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d002f expref: 15 pid: 20361 timeout: 812 lvb_type: 1 00000100:00100000:0.0:1746066743.825096:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984289792:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066743.825174:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa4d3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0091 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.825181:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa4d3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0091 expref: 20 pid: 9592 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066743.825188:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984289920:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066743.825208:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa4c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe2 expref: 29 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.825215:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa4c3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe2 expref: 29 pid: 12255 timeout: 812 lvb_type: 1 00000100:00100000:0.0:1746066743.825221:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984290048:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066743.825236:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.828257:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984289792:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066743.829166:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.829207:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.829269:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982828544 00000100:00100000:1.0:1746066743.829272:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982828544 00010000:00010000:1.0:1746066743.829290:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa4c3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe2 expref: 29 pid: 12255 timeout: 812 lvb_type: 1 00000100:00100000:1.0:1746066743.829335:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6642 00000100:00100000:1.0:1746066743.829340:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882982828544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.829349:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.829368:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa4c3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe2 expref: 29 pid: 12255 timeout: 812 lvb_type: 1 00010000:00010000:1.0:1746066743.829377:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa4c3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe2 expref: 29 pid: 12255 timeout: 812 lvb_type: 1 00010000:00010000:1.0:1746066743.829400:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa4c3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffe2 expref: 29 pid: 12255 timeout: 812 lvb_type: 1 00010000:00010000:1.0:1746066743.829420:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.829456:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882982828544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.829462:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6642 00000100:00100000:0.0:1746066743.832318:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.832357:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.832397:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.832910:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3743 00000100:00100000:1.0:1746066743.832919:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982828800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066743.841634:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.841731:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982829568 00000100:00100000:1.0:1746066743.841741:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982829568 00000100:00100000:1.0:1746066743.841794:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16112 00000100:00100000:1.0:1746066743.841802:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32550:x1830882982829568:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066743.841857:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.841901:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa4d29 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d007c expref: 9 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.841922:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.841927:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066743.841976:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.841988:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.841997:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00010000:1.0:1746066743.842094:0:7243:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ea26300 reply state ffff880129ea3000 transno 8589936404 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.842107:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.842112:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.842114:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746066743.842117:0:7243:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066743.842170:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:32550:x1830882982829568:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 368us (548us total) trans 8589936404 rc 0/0 00000100:00100000:1.0:1746066743.842176:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16112 00000100:00100000:1.0:1746066743.843520:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982828800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10599us (11206us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066743.843529:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3743 00002000:00100000:1.0:1746066743.843540:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012ea25180 x1830882982828800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/440 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066743.843549:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25180 with x1830882982828800 ext(2097152->3145727) 00002000:00010000:1.0:1746066743.843554:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea25180 00000100:00100000:0.0:1746066743.855963:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.856202:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.856735:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.856927:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14983 00000100:00100000:1.0:1746066743.856937:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982829824:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066743.857078:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066743.857081:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.857083:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066743 -> 1746066744 00002000:00010000:1.0:1746066743.857085:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066744 -> 1746066744 00002000:00010000:1.0:1746066743.857087:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:1.0:1746066743.857112:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982829824:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 177us (910us total) trans 21474841683 rc 0/0 00000100:00100000:1.0:1746066743.857121:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14983 00000100:00100000:0.0:1746066743.860463:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.860524:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.860540:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.860569:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.860591:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982830080 00000100:00100000:0.0:1746066743.860600:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982830080 00000100:00100000:0.0:1746066743.860649:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982830208 00000100:00100000:0.0:1746066743.860652:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982830208 00000100:00100000:0.0:1746066743.860664:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982830336 00000100:00100000:0.0:1746066743.860666:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982830336 00000100:00100000:0.0:1746066743.860674:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982830464 00000100:00100000:0.0:1746066743.860676:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982830464 00000100:00100000:0.0:1746066743.860689:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14985 00000100:00100000:0.0:1746066743.860695:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982830080:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066743.861871:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982830080:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 1174us (1416us total) trans 17179874257 rc 0/0 00000100:00100000:0.0:1746066743.861877:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14985 00000100:00100000:0.0:1746066743.863178:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982830592 00000100:00100000:0.0:1746066743.863185:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982830592 00010000:00010000:0.0:1746066743.863214:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa4d3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0091 expref: 21 pid: 9592 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066743.863248:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6643 00000100:00100000:0.0:1746066743.863254:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982830592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066743.863264:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066743.863278:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa4d3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0091 expref: 21 pid: 9592 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066743.863290:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa4d3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0091 expref: 21 pid: 9592 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066743.863309:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa4d3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0091 expref: 21 pid: 9592 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066743.863990:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.863992:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.864001:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.864015:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066743.864061:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.864072:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984290176:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066743.864139:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.864459:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982830976 00000100:00100000:0.0:1746066743.864463:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982830976 00000100:00100000:0.0:1746066743.864650:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5839 00000100:00100000:0.0:1746066743.864656:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:32550:x1830882982830976:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746066743.865209:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32550:x1830882982830976:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 551us (994us total) trans 8589936405 rc 0/0 00000100:00100000:0.0:1746066743.865216:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5839 00000100:00100000:0.0:1746066743.867435:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.867480:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.867509:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.867587:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.868024:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982831744 00000100:00100000:1.0:1746066743.868028:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982831744 00000100:00100000:1.0:1746066743.868054:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5840 00000100:00100000:1.0:1746066743.868060:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32550:x1830882982831744:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066743.868212:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d650050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32550:x1830882982831744:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 151us (623us total) trans 8589936406 rc 0/0 00000100:00100000:1.0:1746066743.868218:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5840 00000100:00100000:1.0:1746066743.870873:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984290176:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.871093:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.871126:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982830592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7871us (9051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.871138:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6643 00000100:00100000:0.0:1746066743.871386:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982832000 00000100:00100000:0.0:1746066743.871393:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982832000 00002000:00100000:0.0:1746066743.871427:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4333568->4337663) req@ffff88011f766a00 x1830882982832000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/0 e 0 to 0 dl 1746066754 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.871437:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766a00 with x1830882982832000 ext(4333568->4337663) 00002000:00010000:0.0:1746066743.871442:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f766a00 00000100:00100000:0.0:1746066743.871951:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3747 00000100:00100000:0.0:1746066743.871960:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982832000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066743.872059:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982832000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 100us (1286us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066743.872064:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3747 00002000:00100000:0.0:1746066743.872068:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4333568->4337663) req@ffff88011f766a00 x1830882982832000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:149/0 lens 488/4536 e 0 to 0 dl 1746066754 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066743.872075:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766a00 with x1830882982832000 ext(4333568->4337663) 00002000:00010000:0.0:1746066743.872078:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f766a00 00000100:00100000:0.0:1746066743.885227:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.887985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.888120:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982832512 00000100:00100000:1.0:1746066743.888126:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982832512 00000100:00100000:1.0:1746066743.888170:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5841 00000100:00100000:1.0:1746066743.888176:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:32560:x1830882982832512:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066743.888346:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:32560:x1830882982832512:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 169us (367us total) trans 8589936407 rc 0/0 00000100:00100000:1.0:1746066743.888351:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5841 00000100:00100000:0.0:1746066743.899122:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.899162:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.899189:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.899274:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982832640 00000100:00100000:1.0:1746066743.899284:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982832640 00000100:00100000:1.0:1746066743.899321:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982832896 00000100:00100000:1.0:1746066743.899322:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982832896 00000100:00100000:1.0:1746066743.899333:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982832768 00000100:00100000:1.0:1746066743.899335:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982832768 00000100:00100000:1.0:1746066743.899347:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14990 00000100:00100000:1.0:1746066743.899355:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982832640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.899374:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.899394:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848a000/0xf1867c21abfa4db5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d00c9 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066743.899416:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd38, atime: 0x6812dd38, ctime: 0x6812dd38, blocks: 0x800 00010000:00010000:1.0:1746066743.899436:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.899438:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.899447:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848a000/0xf1867c21abfa4db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00c9 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.899462:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848a000/0xf1867c21abfa4db5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00c9 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.899473:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a000, rc 0) 00000100:00100000:1.0:1746066743.899516:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982832640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 162us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.899522:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14990 00000100:00100000:1.0:1746066743.899536:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14991 00000100:00100000:1.0:1746066743.899541:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982832896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.899546:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.899556:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848a400/0xf1867c21abfa4dbc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d00d7 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.899593:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984290304:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.899650:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.899780:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14992 00000100:00100000:1.0:1746066743.899786:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982832768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.899793:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.899800:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848bc00/0xf1867c21abfa4dc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d00d0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.899823:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984290432:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066743.899844:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.902769:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984290432:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.902784:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848bc00/0xf1867c21abfa4dc3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00d0 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.902793:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848bc00/0xf1867c21abfa4dc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00d0 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.902801:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848bc00, rc 0) 00000100:00100000:1.0:1746066743.902822:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882982832768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3036us (3632us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.902828:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14992 00000100:00100000:0.0:1746066743.907633:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.907670:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.907695:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.907821:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.907986:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14994 00000100:00100000:1.0:1746066743.907995:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882982833280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.908002:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.908010:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa4dd1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d00ec expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.908057:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984290560:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066743.908063:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14995 00000100:00100000:0.0:1746066743.908070:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982833152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066743.908078:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.908089:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfa4dd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d00e5 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.908104:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00010000:00010000:0.0:1746066743.908105:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.908107:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066743.908112:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfa4dd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00e5 expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.908121:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5400/0xf1867c21abfa4dd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00e5 expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066743.908128:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5400, rc 0) 00000100:00100000:0.0:1746066743.908144:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982833152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 75us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066743.912408:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14995 00000100:00100000:0.0:1746066743.916135:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.916255:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.916341:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984290560:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.916369:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa4dd1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ec expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.916381:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa4dd1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ec expref: 23 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.916396:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8c00, rc 0) 00000100:00100000:1.0:1746066743.916417:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882982833280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8423us (8745us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.916423:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14994 00000100:00100000:0.0:1746066743.918969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.919017:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.920148:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982834048 00000100:00100000:1.0:1746066743.920157:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982834048 00000100:00100000:1.0:1746066743.920221:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 884 00000100:00100000:1.0:1746066743.920229:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882982834048:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:1.0:1746066743.920354:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882982834048:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 126us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.920360:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 884 00000100:00100000:0.0:1746066743.920990:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.921098:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982834176 00000100:00100000:1.0:1746066743.921102:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982834176 00000100:00100000:1.0:1746066743.921136:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14996 00000100:00100000:1.0:1746066743.921142:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:32552:x1830882982834176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.921155:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.921171:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4ddf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d00f3 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.921196:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.921203:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.921204:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.921208:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4ddf lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00f3 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.921237:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.921249:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 28 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066743.921261:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984290688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066743.921340:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066743.924409:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.924455:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.925318:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14998 00000100:00100000:0.0:1746066743.925326:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982834432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066743.925334:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.925347:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfa4ded lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0101 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.925400:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984290816:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066743.925668:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.926154:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984290688:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066743.926175:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4ddf lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00f3 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.926193:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9e00, rc 0) 00000100:00100000:1.0:1746066743.926374:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:32552:x1830882982834176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5231us (5384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.926382:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14996 00000100:00100000:1.0:1746066743.927196:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984290816:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.927217:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfa4ded lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0101 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.927226:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfa4ded lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0101 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.927237:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5c00, rc 0) 00000100:00100000:0.0:1746066743.927356:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.928309:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982834432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2981us (3850us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.928316:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14998 00000100:00100000:0.0:1746066743.932091:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.932414:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982834688 00000100:00100000:1.0:1746066743.932422:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982834688 00000100:00100000:1.0:1746066743.933407:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 14999 00000100:00100000:1.0:1746066743.933418:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:32556:x1830882982834688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066743.933437:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.933455:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0108 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.933482:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.933485:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066743.933490:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 32 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.933502:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 32 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.933513:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c000, rc 0) 00000100:00100000:1.0:1746066743.933564:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:32556:x1830882982834688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 148us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.933570:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 14999 00000100:00100000:0.0:1746066743.935479:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.935694:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982834816 00000100:00100000:1.0:1746066743.935702:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982834816 00010000:00010000:1.0:1746066743.935748:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 32 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066743.935792:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6644 00000100:00100000:1.0:1746066743.935799:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882982834816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066743.935812:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066743.935834:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 32 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066743.935846:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 32 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066743.935869:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa4d99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4337663) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00b4 expref: 32 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066743.935910:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.935912:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.935920:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4ddf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00f3 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.935934:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4ddf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00f3 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.935942:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.935943:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066743.935946:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.935953:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.935987:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.936000:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984291072:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.936852:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa4ddf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00f3 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066743.936865:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984291200:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066743.936915:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.939380:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984291200:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066743.941351:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.941870:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984291072:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066743.941920:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066743.941982:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882982834816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6183us (6506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.941994:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6644 00000100:00100000:0.0:1746066743.942084:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.942313:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982835200 00000100:00100000:0.0:1746066743.942317:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982835200 00000100:00100000:0.0:1746066743.942343:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15000 00000100:00100000:0.0:1746066743.942349:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982835200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066743.942359:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066743.942377:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4000/0xf1867c21abfa4dfb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d010f expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066743.942427:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984291328:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066743.942487:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066743.950211:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984291328:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066743.950249:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4000/0xf1867c21abfa4dfb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d010f expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.950262:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4000/0xf1867c21abfa4dfb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d010f expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066743.950327:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4000, rc 0) 00000100:00100000:1.0:1746066743.951079:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982835200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8728us (8992us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066743.951087:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15000 00000100:00100000:0.0:1746066743.960617:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.961179:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.975564:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.989871:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066743.995504:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982836352 00000100:00100000:1.0:1746066743.995515:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982836352 00000100:00100000:1.0:1746066743.995562:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16114 00000100:00100000:1.0:1746066743.995571:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32568:x1830882982836352:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066743.995598:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066743.995617:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d011d expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.995680:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995693:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995704:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995728:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995733:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995738:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995808:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541200/0xf1867c21abfa4e3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995817:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541200/0xf1867c21abfa4e3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995822:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541200/0xf1867c21abfa4e3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066743.995861:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066743.995865:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066743.995879:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094541200/0xf1867c21abfa4e3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995914:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541200/0xf1867c21abfa4e3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995922:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995927:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995932:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995941:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995947:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094540000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066743.995950:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995957:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995968:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066743.995971:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066743.995975:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995981:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995995:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.995999:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.996003:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.996007:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094541a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066743.996009:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.996014:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.996022:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096476b00) 00010000:00010000:1.0:1746066743.996024:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066743.996026:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.996030:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066743.996054:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d011d expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.996064:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541200/0xf1867c21abfa4e3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d011d expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066743.996071:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066743.996072:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066743.996074:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541200, rc 0) 00000100:00100000:1.0:1746066743.996125:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32568:x1830882982836352:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 555us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066743.996131:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16114 00000100:00100000:0.0:1746066743.999967:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066743.999997:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.000020:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.000031:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.000072:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.000579:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15004 00000100:00100000:1.0:1746066744.000585:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982836864:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066744.000591:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.000598:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa4e56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0139 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.000609:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.000610:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.000615:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa4e56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0139 expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.000623:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa4e56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0139 expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.000630:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094540e00, rc 0) 00000100:00100000:0.0:1746066744.000661:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15005 00000100:00100000:0.0:1746066744.000667:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+16:32567:x1830882982836992:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066744.000675:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066744.000681:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0140 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.000696:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfa4d8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00a6 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.000703:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa4e56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0139 expref: 17 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066744.000710:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa4d92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ad expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.000880:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982836864:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 294us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.000901:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15004 00010000:00010000:0.0:1746066744.001095:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.001097:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.001101:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3256320->3407871] (req 3256320->3407871) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.001137:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa4d92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ad expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.001149:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa4d92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ad expref: 30 pid: 12255 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.001158:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984291584:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066744.001189:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa4e56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0139 expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066744.001201:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa4e56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0139 expref: 16 pid: 11630 timeout: 812 lvb_type: 1 00000100:00100000:0.0:1746066744.001209:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984291712:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066744.001232:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfa4d8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00a6 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.001239:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589ae00/0xf1867c21abfa4d8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00a6 expref: 17 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.001247:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984291840:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066744.001262:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.006206:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984291456:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066744.006242:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfa4e48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d012b expref: 20 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066744.006258:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b200/0xf1867c21abfa4e48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d012b expref: 20 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066744.006274:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:0.0:1746066744.006322:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982836608:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5980us (6322us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066744.006330:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15002 00000100:00100000:0.0:1746066744.006425:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6646 00000100:00100000:0.0:1746066744.006432:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982837248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066744.006440:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066744.006493:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984291584:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066744.006503:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa4e56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0139 expref: 16 pid: 11630 timeout: 812 lvb_type: 1 00000100:00100000:1.0:1746066744.006517:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984291712:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066744.006525:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984291840:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066744.006676:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa4d92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ad expref: 31 pid: 12255 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.006722:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3256320->3407871] (req 3256320->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.006731:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece600, rc 0) 00000100:00100000:1.0:1746066744.006753:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+16:32567:x1830882982836992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6087us (6679us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.006758:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15005 00010000:00010000:0.0:1746066744.006820:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa4d92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ad expref: 31 pid: 12255 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.006835:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa4d92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00ad expref: 31 pid: 12255 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.006845:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.006847:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.006853:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.006861:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.007449:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.007471:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984291968:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066744.007537:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066744.010994:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.012139:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984291968:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066744.012160:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.012184:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982837248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5753us (5977us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.012193:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6646 00000100:00100000:0.0:1746066744.017290:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.017321:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.017410:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.017872:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982838016 00000100:00100000:1.0:1746066744.017905:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982838016 00010000:00010000:1.0:1746066744.017943:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094541200/0xf1867c21abfa4e3a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d011d expref: 15 pid: 7243 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.018590:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982838144 00000100:00100000:1.0:1746066744.018594:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982838144 00010000:00010000:1.0:1746066744.018611:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d600/0xf1867c21abfa4e17 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0116 expref: 12 pid: 13370 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.018903:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.019046:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982838656 00000100:00100000:1.0:1746066744.019050:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982838656 00000100:00100000:1.0:1746066744.019072:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16116 00000100:00100000:1.0:1746066744.019077:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:32571:x1830882982838656:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066744.019100:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.019112:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094540800/0xf1867c21abfa4e72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d014e expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.019178:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019187:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019194:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019206:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019211:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019216:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019309:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019316:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019321:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066744.019329:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066744.019395:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019400:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019405:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019411:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019416:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094541600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066744.019419:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019426:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019433:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066744.019435:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066744.019438:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019442:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541600/0xf1867c21abfa4e79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019454:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019458:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019462:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019465:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094541a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066744.019467:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019471:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019476:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096476100) 00010000:00010000:1.0:1746066744.019478:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066744.019480:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019484:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa4e80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.019516:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094540800/0xf1867c21abfa4e72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 32 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.019526:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.019532:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066744.019534:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066744.019535:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094540000, rc 0) 00000100:00100000:1.0:1746066744.019570:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:32571:x1830882982838656:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 493us (668us total) trans 8589936411 rc 0/0 00000100:00100000:1.0:1746066744.019576:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16116 00000100:00100000:0.0:1746066744.024750:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.025813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.027791:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.034586:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.034809:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.034863:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982839424 00000100:00100000:1.0:1746066744.034871:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982839424 00000100:00100000:1.0:1746066744.034941:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15006 00000100:00100000:1.0:1746066744.034950:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982839424:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066744.034969:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.034985:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfa4eb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0163 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.035037:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984292608:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066744.036498:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00002000:00010000:1.0:1746066744.037539:0:13363:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066744 -> 1746066745 00002000:00010000:1.0:1746066744.037542:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066744 -> 1746066745 00000100:00100000:1.0:1746066744.037555:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984292608:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066744.037571:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfa4eb1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0163 expref: 17 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.037581:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfa4eb1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0163 expref: 17 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.037632:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094540800, rc 0) 00000100:00100000:1.0:1746066744.037655:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982839424:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2706us (2846us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066744.037660:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15006 00000100:00100000:0.0:1746066744.043321:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.048310:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982839936 00000100:00100000:0.0:1746066744.048319:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982839936 00000100:00100000:0.0:1746066744.048591:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5845 00000100:00100000:0.0:1746066744.048599:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:32568:x1830882982839936:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:0.0:1746066744.050248:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:32568:x1830882982839936:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 1641us (2015us total) trans 8589936414 rc 0/0 00000100:00100000:0.0:1746066744.050259:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5845 00000100:00100000:0.0:1746066744.085054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.085275:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982840064 00000100:00100000:1.0:1746066744.085286:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982840064 00000100:00100000:1.0:1746066744.085349:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15008 00000100:00100000:1.0:1746066744.085358:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:32571:x1830882982840064:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066744.085380:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.085400:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0171 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.085432:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.085440:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066744.085442:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066744.085445:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 31 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.085477:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3407871) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.085494:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece600/0xf1867c21abfa4e5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3256320->3407871) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0140 expref: 15 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.085507:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984292736:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066744.086220:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066744.087080:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984292736:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066744.087109:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3710976->4194303] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 31 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.087126:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541600, rc 0) 00000100:00100000:1.0:1746066744.087179:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+31:32571:x1830882982840064:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1823us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.087186:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15008 00000100:00100000:0.0:1746066744.092320:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.095964:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.106727:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.108495:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.108556:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.108585:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982840960 00000100:00100000:0.0:1746066744.108588:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982840960 00010000:00010000:0.0:1746066744.108600:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 32 pid: 9591 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.108614:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6653 00000100:00100000:0.0:1746066744.108618:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882982840960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066744.108625:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.108631:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 32 pid: 9591 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.108672:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 32 pid: 9591 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.108690:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa4df4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0108 expref: 32 pid: 9591 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.108727:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.108757:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982840960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 138us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.108763:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6653 00000100:00100000:0.0:1746066744.110229:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.114865:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.117423:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.192908:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.198559:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.198608:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.206184:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.207398:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16120 00000100:00100000:0.0:1746066744.207407:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:32580:x1830882982842368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066744.207430:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066744.207446:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa4f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0194 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.207569:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207581:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207592:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207604:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207610:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207615:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207734:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfa4f1a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207744:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfa4f1a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207750:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfa4f1a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:0.0:1746066744.207758:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066744.207830:0:13370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207837:0:13370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207845:0:13370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.207850:0:13370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe5000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066744.208088:0:13370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208096:0:13370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208107:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066744.208110:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066744.208113:0:13370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208117:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208137:0:13370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208142:0:13370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208146:0:13370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208150:0:13370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe4200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066744.208152:0:13370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208156:0:13370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208166:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9c00) 00010000:00010000:0.0:1746066744.208167:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066744.208169:0:13370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208173:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.208207:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa4f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0194 expref: 35 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.208217:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfa4f1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0194 expref: 34 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.208222:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066744.208225:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066744.208227:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4a00, rc 0) 00000100:00100000:0.0:1746066744.208254:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:32580:x1830882982842368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 849us (2083us total) trans 8589936417 rc 0/0 00000100:00100000:0.0:1746066744.208260:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16120 00000100:00100000:1.0:1746066744.215960:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.216016:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.216050:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982842496 00000100:00100000:1.0:1746066744.216059:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982842496 00000100:00100000:1.0:1746066744.218545:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15013 00000100:00100000:1.0:1746066744.218561:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982842496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066744.218578:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.218597:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfa4f2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d019b expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.218653:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984293888:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066744.219638:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.222258:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066744.224173:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066744 -> 1746066745 00000100:00100000:1.0:1746066744.224196:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984293888:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066744.224228:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfa4f2f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d019b expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.224240:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094541200/0xf1867c21abfa4f2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d019b expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.224252:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541200, rc 0) 00000100:00100000:1.0:1746066744.224295:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982842496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5740us (8347us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066744.224303:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15013 00000100:00100000:1.0:1746066744.224837:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.224867:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.224925:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.224949:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982843136 00000100:00100000:1.0:1746066744.224954:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982843136 00002000:00100000:1.0:1746066744.224985:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a03d6a00 x1830882982843136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.224995:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6a00 with x1830882982843136 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.225000:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6a00 00000100:00100000:1.0:1746066744.225021:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982843392 00000100:00100000:1.0:1746066744.225024:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982843392 00002000:00100000:1.0:1746066744.225035:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800a03d4700 x1830882982843392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.225041:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882982843392 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.225044:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:0.0:1746066744.225187:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3757 00000100:00100000:0.0:1746066744.225196:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882982843136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066744.226688:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3759 00000100:00100000:1.0:1746066744.226698:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982843392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.233060:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.235993:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.236047:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.237132:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882982842880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14522us (14879us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066744.237152:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3756 00002000:00100000:0.0:1746066744.237159:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d5c00 x1830882982842880/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.237166:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5c00 with x1830882982842880 ext(0->1048575) 00002000:00010000:0.0:1746066744.237170:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5c00 00000100:00100000:0.0:1746066744.237189:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3761 00000100:00100000:0.0:1746066744.237197:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882982844160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066744.254592:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882982843392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27883us (29711us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066744.254606:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3759 00002000:00100000:1.0:1746066744.254619:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800a03d4700 x1830882982843392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.254629:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882982843392 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.254635:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:0.0:1746066744.255940:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982844672 00000100:00100000:0.0:1746066744.255950:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982844672 00000100:00100000:0.0:1746066744.255989:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16121 00000100:00100000:0.0:1746066744.255997:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:32582:x1830882982844672:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066744.256019:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066744.256037:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d01a9 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.256145:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.256161:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa4ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0155 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.256168:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa4ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d017f expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.256175:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfa4f1a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0194 expref: 35 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.256187:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.256217:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfa4f1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0194 expref: 35 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.256230:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4a00/0xf1867c21abfa4f1a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0194 expref: 35 pid: 13370 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.256241:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984294016:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066744.256328:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa4ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d017f expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.256336:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa4ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d017f expref: 13 pid: 17253 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.256343:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984294144:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066744.256364:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa4ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0155 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.256371:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa4ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0155 expref: 14 pid: 17253 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.256377:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984294272:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066744.256388:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.266066:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.266184:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984294016:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066744.266221:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984294272:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066744.266242:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984294144:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066744.266267:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:1.0:1746066744.266270:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982844160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29072us (32383us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066744.266280:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3761 00002000:00100000:1.0:1746066744.266291:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800945d5880 x1830882982844160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066744.266296:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746066744.266300:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5880 with x1830882982844160 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.266305:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d5880 00000100:00100000:1.0:1746066744.266363:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982845184 00000100:00100000:1.0:1746066744.266369:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982845184 00010000:00010000:1.0:1746066744.266393:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa4ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0155 expref: 15 pid: 17253 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.266412:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.266421:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982845312 00000100:00100000:1.0:1746066744.266424:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982845312 00010000:00010000:1.0:1746066744.266433:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa4ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d017f expref: 14 pid: 17253 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.266433:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6655 00000100:00100000:0.0:1746066744.266441:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982845184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066744.266447:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6656 00000100:00100000:1.0:1746066744.266452:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882982845312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066744.266454:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066744.266458:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.266461:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa4ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0155 expref: 15 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.266462:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa4ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d017f expref: 14 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.266470:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa4ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0155 expref: 15 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.267686:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa4ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d017f expref: 16 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.267703:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa4ee9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d017f expref: 16 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.267730:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066744.267735:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066744.267743:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066744.267748:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066744.267776:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882982845312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1324us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.267782:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6656 00010000:00010000:0.0:1746066744.267987:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa4ea3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0155 expref: 15 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.268058:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066744.268062:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.268069:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.268073:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.268109:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982845184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1669us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.268116:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6655 00010000:00010000:0.0:1746066744.269073:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066744.269081:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:0.0:1746066744.269094:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066744.269157:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa4f36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01a9 expref: 36 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.269184:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01a9 expref: 35 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.269190:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066744.269192:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066744.269194:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5000, rc 0) 00000100:00100000:1.0:1746066744.282374:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.282430:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.284846:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.287052:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.294619:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.299749:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.307245:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982846592 00000100:00100000:1.0:1746066744.307253:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982846592 00002000:00100000:1.0:1746066744.307297:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88009d9b1f80 x1830882982846592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.307308:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1f80 with x1830882982846592 ext(2097152->3145727) 00002000:00010000:1.0:1746066744.307314:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1f80 00000100:00100000:1.0:1746066744.307334:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982846464 00000100:00100000:1.0:1746066744.307336:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982846464 00002000:00100000:1.0:1746066744.307345:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d9b1880 x1830882982846464/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.307352:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1880 with x1830882982846464 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.307355:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1880 00000100:00100000:1.0:1746066744.307364:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3763 00000100:00100000:1.0:1746066744.307370:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982846592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.313584:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.322431:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982846592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15048us (15281us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066744.322443:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3763 00002000:00100000:1.0:1746066744.322454:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88009d9b1f80 x1830882982846592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.322464:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1f80 with x1830882982846592 ext(2097152->3145727) 00002000:00010000:1.0:1746066744.322470:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1f80 00000100:00100000:0.0:1746066744.324736:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.329129:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.329174:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.332659:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982847232 00000100:00100000:1.0:1746066744.332667:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982847232 00000100:00100000:1.0:1746066744.332713:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15019 00000100:00100000:1.0:1746066744.332720:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+17:32577:x1830882982847232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066744.332739:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.332754:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfa4f83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d01da expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.332779:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.332787:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066744.332788:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066744.332791:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfa4f83 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01da expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.332816:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.332826:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 30 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.332837:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984295424:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066744.333623:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.333834:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984295296:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066744.333851:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.333903:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982847104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3995us (4728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.333913:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6661 00000100:00100000:1.0:1746066744.334847:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984295424:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066744.334866:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfa4f83 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01da expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.334880:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbea200, rc 0) 00000100:00100000:1.0:1746066744.334929:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+17:32577:x1830882982847232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2209us (4300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.335387:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15019 00000100:00100000:0.0:1746066744.335577:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982847616 00000100:00100000:0.0:1746066744.335583:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982847616 00002000:00100000:0.0:1746066744.335606:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3710976->4194303) req@ffff880097a8b100 x1830882982847616/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.335613:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b100 with x1830882982847616 ext(3710976->4194303) 00010000:00010000:0.0:1746066744.335620:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 31 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.335741:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 31 pid: 13363 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746066744.335749:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a8b100 00000100:00100000:0.0:1746066744.335773:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 794 00000100:00100000:0.0:1746066744.335779:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982847616:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066744.340436:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.341117:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982847872 00000100:00100000:1.0:1746066744.341128:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982847872 00002000:00100000:1.0:1746066744.341180:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012faf2680 x1830882982847872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.341195:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2680 with x1830882982847872 ext(2097152->3145727) 00002000:00010000:1.0:1746066744.341203:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf2680 00000100:00100000:1.0:1746066744.341241:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3766 00000100:00100000:1.0:1746066744.341250:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882982847872:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.344938:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.347202:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982847616:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11414us (11646us total) trans 17179874259 rc 0/0 00000100:00100000:1.0:1746066744.347212:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 794 00002000:00100000:1.0:1746066744.347221:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3710976->4194303) req@ffff880097a8b100 x1830882982847616/t17179874259(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/448 e 0 to 0 dl 1746066755 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.347229:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b100 with x1830882982847616 ext(3710976->4194303) 00010000:00010000:1.0:1746066744.347240:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 33 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.347254:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094541600/0xf1867c21abfa4ec6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0171 expref: 33 pid: 13363 timeout: 812 lvb_type: 0 00002000:00010000:1.0:1746066744.347261:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a8b100 00000100:00100000:1.0:1746066744.348467:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882982847872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7215us (8040us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066744.348476:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3766 00002000:00100000:1.0:1746066744.348483:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012faf2680 x1830882982847872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.348491:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2680 with x1830882982847872 ext(2097152->3145727) 00002000:00010000:1.0:1746066744.348495:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf2680 00000100:00100000:0.0:1746066744.355016:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.360145:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.360269:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982848384 00000100:00100000:1.0:1746066744.360274:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982848384 00000100:00100000:1.0:1746066744.360298:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15020 00000100:00100000:1.0:1746066744.360303:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:32580:x1830882982848384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066744.360318:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.360330:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfa4f8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d01e1 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.360344:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.360345:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.360349:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfa4f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e1 expref: 34 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.360361:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfa4f8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e1 expref: 34 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.360369:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb800, rc 0) 00000100:00100000:1.0:1746066744.360403:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+34:32580:x1830882982848384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.360408:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15020 00000100:00100000:0.0:1746066744.364039:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a89180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984295552:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066744.364249:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.364304:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982848256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4758us (9296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.364315:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6662 00000100:00100000:0.0:1746066744.368057:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.368424:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.368533:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982848640 00000100:00100000:1.0:1746066744.368544:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982848640 00002000:00100000:1.0:1746066744.368591:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d8c9c00 x1830882982848640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.368602:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9c00 with x1830882982848640 ext(2097152->4194303) 00002000:00010000:1.0:1746066744.368607:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c9c00 00000100:00100000:1.0:1746066744.368633:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982848896 00000100:00100000:1.0:1746066744.368636:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982848896 00002000:00100000:1.0:1746066744.368648:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d8c9880 x1830882982848896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.368655:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9880 with x1830882982848896 ext(2097152->4194303) 00002000:00010000:1.0:1746066744.368657:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c9880 00000100:00100000:1.0:1746066744.368681:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3768 00000100:00100000:1.0:1746066744.368688:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882982848640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.390512:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882982848896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21718us (22077us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066744.390525:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3769 00002000:00100000:0.0:1746066744.390537:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d8c9880 x1830882982848896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.390547:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9880 with x1830882982848896 ext(2097152->4194303) 00002000:00010000:0.0:1746066744.390553:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c9880 00000100:00100000:0.0:1746066744.393484:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.396384:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882982848640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27684us (28327us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066744.396396:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3768 00002000:00100000:1.0:1746066744.396408:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d8c9c00 x1830882982848640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.396417:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9c00 with x1830882982848640 ext(2097152->4194303) 00002000:00010000:1.0:1746066744.396424:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c9c00 00000100:00100000:0.0:1746066744.400659:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.400846:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982849152 00000100:00100000:1.0:1746066744.400856:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982849152 00000100:00100000:1.0:1746066744.401000:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15022 00000100:00100000:1.0:1746066744.401009:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882982849152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066744.401028:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.401048:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa4f98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d01ef expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.401108:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984296064:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066744.401193:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.405734:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.405762:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.405773:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.405833:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.405857:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982849280 00000100:00100000:1.0:1746066744.405865:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982849280 00010000:00010000:1.0:1746066744.405920:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa4dae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00c2 expref: 26 pid: 3528 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.405929:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984296064:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066744.405942:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982849408 00000100:00100000:1.0:1746066744.405944:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982849408 00010000:00010000:1.0:1746066744.405953:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfa4da7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00bb expref: 34 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.405957:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa4f98 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01ef expref: 34 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066744.405963:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982849536 00000100:00100000:1.0:1746066744.405965:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982849536 00010000:00010000:0.0:1746066744.405967:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa4f98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01ef expref: 34 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.405971:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36200/0xf1867c21abfa4f75 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01cc expref: 27 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.405981:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbeb200, rc 0) 00000100:00100000:1.0:1746066744.405983:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6663 00000100:00100000:1.0:1746066744.405988:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982849280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066744.405999:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066744.406006:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa4dae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00c2 expref: 27 pid: 3528 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.406014:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa4dae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00c2 expref: 27 pid: 3528 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.406020:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982849152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5014us (5370us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066744.406027:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15022 00010000:00010000:1.0:1746066744.406036:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa4dae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00c2 expref: 27 pid: 3528 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.406044:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982849664 00000100:00100000:0.0:1746066744.406047:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982849664 00010000:00010000:1.0:1746066744.406050:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066744.406064:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982849280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.406066:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15023 00000100:00100000:1.0:1746066744.406069:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6663 00000100:00100000:0.0:1746066744.406070:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:32577:x1830882982849664:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066744.406077:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6664 00000100:00100000:1.0:1746066744.406080:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882982849408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066744.406084:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.406084:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.406090:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfa4da7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00bb expref: 32 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.406094:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa4f9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d01f6 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.406096:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c7e00/0xf1867c21abfa4da7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00bb expref: 32 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.406105:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066744.406107:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.406111:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.406115:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882982849408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 35us (353us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066744.406117:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746066744.406120:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6664 00010000:00010000:0.0:1746066744.406121:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa4f9f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01f6 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.406126:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6665 00000100:00100000:1.0:1746066744.406130:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982849536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066744.406137:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066744.406141:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36200/0xf1867c21abfa4f75 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01cc expref: 27 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.406146:0:20361:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.406149:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa36200/0xf1867c21abfa4f75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01cc expref: 27 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.406158:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.406158:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa4f9f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01f6 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.406159:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.406164:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60080000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.406171:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60080000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.407516:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9c200, rc 0) 00000100:00100000:0.0:1746066744.407555:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:32577:x1830882982849664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1482us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.407561:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15023 00010000:00010000:1.0:1746066744.407879:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 25 pid: 11630 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.407900:0:11928:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 25 pid: 11630 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.407912:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984296320:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066744.407970:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.410855:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.411114:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982849920 00000100:00100000:1.0:1746066744.411124:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982849920 00002000:00100000:1.0:1746066744.411170:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4386816->5033983) req@ffff88009d8c8380 x1830882982849920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.411180:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8380 with x1830882982849920 ext(4386816->5033983) 00002000:00010000:1.0:1746066744.411187:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c8380 00000100:00100000:1.0:1746066744.411220:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3770 00000100:00100000:1.0:1746066744.411229:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982849920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.416102:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.417976:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982849920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6743us (7125us total) trans 0 rc 647168/647168 00000100:00100000:1.0:1746066744.417983:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3770 00002000:00100000:1.0:1746066744.417990:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4386816->5033983) req@ffff88009d8c8380 x1830882982849920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 647168/647168 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.417997:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8380 with x1830882982849920 ext(4386816->5033983) 00002000:00010000:1.0:1746066744.418001:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c8380 00000100:00100000:0.0:1746066744.423112:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.427275:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.427322:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.427350:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982850560 00000100:00100000:1.0:1746066744.427359:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982850560 00002000:00100000:1.0:1746066744.427403:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3809280->4194303) req@ffff88006e213100 x1830882982850560/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.427414:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213100 with x1830882982850560 ext(3809280->4194303) 00010000:00010000:1.0:1746066744.427422:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 24 pid: 11630 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.427756:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 24 pid: 11630 timeout: 812 lvb_type: 0 00002000:00010000:1.0:1746066744.427763:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e213100 00000100:00100000:1.0:1746066744.427777:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 796 00000100:00100000:1.0:1746066744.427783:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982850560:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066744.431215:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.437437:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982850560:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9652us (10171us total) trans 21474841688 rc 0/0 00000100:00100000:1.0:1746066744.437450:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 796 00002000:00100000:1.0:1746066744.437459:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3809280->4194303) req@ffff88006e213100 x1830882982850560/t21474841688(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/448 e 0 to 0 dl 1746066755 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.437468:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213100 with x1830882982850560 ext(3809280->4194303) 00010000:00010000:1.0:1746066744.437477:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 26 pid: 11630 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.437487:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa4f91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3809280->4194303] (req 3809280->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e8 expref: 26 pid: 11630 timeout: 812 lvb_type: 0 00002000:00010000:1.0:1746066744.437494:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e213100 00000100:00100000:0.0:1746066744.437802:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.437906:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.438341:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982850944 00000100:00100000:1.0:1746066744.438348:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982850944 00010000:00010000:1.0:1746066744.438375:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfa4f83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01da expref: 18 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.438404:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982851072 00000100:00100000:1.0:1746066744.438406:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982851072 00010000:00010000:1.0:1746066744.438414:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbeb800/0xf1867c21abfa4f8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01e1 expref: 33 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.438426:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6666 00000100:00100000:1.0:1746066744.438432:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137020c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982850944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066744.438444:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066744.438461:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfa4f83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01da expref: 18 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.438474:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfa4f83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01da expref: 18 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.438493:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbea200/0xf1867c21abfa4f83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01da expref: 18 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.438510:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066744.438532:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137020c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882982850944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.438537:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6666 00000100:00100000:0.0:1746066744.441687:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.442764:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.445029:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.445407:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982851712 00000100:00100000:0.0:1746066744.445410:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982851712 00002000:00100000:0.0:1746066744.445441:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3481600->3485695) req@ffff8800a03d7100 x1830882982851712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.445451:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7100 with x1830882982851712 ext(3481600->3485695) 00002000:00010000:0.0:1746066744.445455:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7100 00000100:00100000:0.0:1746066744.445480:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3771 00000100:00100000:0.0:1746066744.445485:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982851712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066744.445608:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982851712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 122us (578us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066744.445614:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3771 00002000:00100000:0.0:1746066744.445619:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3481600->3485695) req@ffff8800a03d7100 x1830882982851712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.445626:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7100 with x1830882982851712 ext(3481600->3485695) 00002000:00010000:0.0:1746066744.445629:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7100 00000100:00100000:0.0:1746066744.451504:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.467516:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.480304:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.480346:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.480375:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.486827:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.491170:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.499509:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.507032:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.515542:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.519854:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.526241:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982853760 00000100:00100000:0.0:1746066744.526252:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982853760 00000100:00100000:0.0:1746066744.526304:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5848 00000100:00100000:0.0:1746066744.526312:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:32577:x1830882982853760:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066744.578985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.585335:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.586612:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.591134:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.593674:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.594394:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.594455:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.594491:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982855040 00000100:00100000:0.0:1746066744.594498:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982855040 00000100:00100000:0.0:1746066744.594542:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 772 00000100:00100000:0.0:1746066744.594549:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882982855040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066744.594562:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.594586:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093506e00/0xf1867c21abfa501d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0243 expref: 40 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.596151:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066744.596156:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.596190:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982855040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1641us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.596198:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 772 00000100:00100000:0.0:1746066744.603963:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.610035:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.615669:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.620278:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982855552:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4303us (4608us total) trans 17179874260 rc 0/0 00000100:00100000:0.0:1746066744.620292:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 798 00002000:00100000:0.0:1746066744.620304:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3485695) req@ffff880096e68380 x1830882982855552/t17179874260(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/448 e 0 to 0 dl 1746066755 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.620313:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e68380 with x1830882982855552 ext(3145728->3485695) 00010000:00010000:0.0:1746066744.620324:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa4fad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0204 expref: 19 pid: 11630 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.620339:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa4fad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0204 expref: 19 pid: 11630 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746066744.620346:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096e68380 00000100:00100000:0.0:1746066744.622095:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.624865:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.625216:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982855936 00000100:00100000:0.0:1746066744.625224:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982855936 00010000:00010000:0.0:1746066744.625257:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa4fad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0204 expref: 19 pid: 11630 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.625354:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6670 00000100:00100000:0.0:1746066744.625362:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882982855936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066744.625379:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.625397:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa4fad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0204 expref: 19 pid: 11630 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.625408:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa4fad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0204 expref: 19 pid: 11630 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.625431:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa4fad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0204 expref: 19 pid: 11630 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.626037:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.626040:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.626049:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa5039 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3715071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0258 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.626060:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa5039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3715071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0258 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.626118:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa5039 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3715071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0258 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.626132:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984298240:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066744.626291:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066744.630815:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984298240:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066744.630841:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066744.631525:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982855936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6160us (6663us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.631603:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6670 00000100:00100000:1.0:1746066744.632463:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982856192 00000100:00100000:1.0:1746066744.632470:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982856192 00002000:00100000:1.0:1746066744.632512:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3350528->3354623) req@ffff880096ec8e00 x1830882982856192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.632522:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882982856192 ext(3350528->3354623) 00002000:00010000:1.0:1746066744.632527:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8e00 00000100:00100000:1.0:1746066744.632544:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3777 00000100:00100000:1.0:1746066744.632550:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982856192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066744.632676:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982856192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 125us (684us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066744.632682:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3777 00002000:00100000:1.0:1746066744.632686:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3350528->3354623) req@ffff880096ec8e00 x1830882982856192/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.632693:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882982856192 ext(3350528->3354623) 00002000:00010000:1.0:1746066744.632696:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8e00 00000100:00100000:0.0:1746066744.636060:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984298368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066744.636121:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066744.638753:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984298368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066744.641406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.641467:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.642501:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3779 00000100:00100000:1.0:1746066744.642509:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982856576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066744.642589:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982856576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 80us (1121us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066744.642595:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3779 00002000:00100000:1.0:1746066744.642601:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3710976->3715071) req@ffff88012ea27100 x1830882982856576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.642613:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea27100 with x1830882982856576 ext(3710976->3715071) 00002000:00010000:1.0:1746066744.642617:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea27100 00000100:00100000:0.0:1746066744.651963:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.654772:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.654796:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982857216 00000100:00100000:0.0:1746066744.654805:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982857216 00002000:00100000:0.0:1746066744.654850:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012ea25880 x1830882982857216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 504/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.654861:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25880 with x1830882982857216 ext(3145728->4194303) 00002000:00010000:0.0:1746066744.654867:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea25880 00000100:00100000:0.0:1746066744.654912:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3781 00000100:00100000:0.0:1746066744.654919:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982857216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.666070:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.666125:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.666226:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982857216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11306us (11463us total) trans 0 rc 684032/684032 00000100:00100000:1.0:1746066744.666233:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3781 00002000:00100000:1.0:1746066744.666238:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012ea25880 x1830882982857216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 504/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 684032/684032 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.666244:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25880 with x1830882982857216 ext(3145728->4194303) 00002000:00010000:1.0:1746066744.666248:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea25880 00000100:00100000:0.0:1746066744.669079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.674378:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.674395:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.674447:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982858112 00000100:00100000:1.0:1746066744.674457:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982858112 00000100:00100000:1.0:1746066744.674498:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982858368 00000100:00100000:1.0:1746066744.674501:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982858368 00000100:00100000:1.0:1746066744.674527:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5850 00000100:00100000:1.0:1746066744.674536:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:30848:x1830882982858112:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066744.674818:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:30848:x1830882982858112:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 283us (445us total) trans 8589936426 rc 0/0 00000100:00100000:1.0:1746066744.674824:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5850 00000100:00100000:0.0:1746066744.676155:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.676233:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982858496 00000100:00100000:1.0:1746066744.676239:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982858496 00010000:00010000:1.0:1746066744.676262:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01a9 expref: 40 pid: 13370 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.676337:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6671 00000100:00100000:1.0:1746066744.676343:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882982858496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066744.676355:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066744.676360:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01a9 expref: 40 pid: 13370 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.676373:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01a9 expref: 40 pid: 13370 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.676392:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa4f3d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01a9 expref: 40 pid: 13370 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.676405:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066744.676409:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066744.676417:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066744.676422:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066744.676427:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066744.677160:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982858496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 815us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.677167:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6671 00000100:00100000:0.0:1746066744.677454:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.677558:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.677815:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982858752 00000100:00100000:1.0:1746066744.677820:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982858752 00010000:00010000:1.0:1746066744.677837:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfa4f4b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01b0 expref: 19 pid: 17253 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.677939:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6672 00000100:00100000:1.0:1746066744.677946:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982858752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066744.677956:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066744.677960:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfa4f4b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01b0 expref: 19 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.677969:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfa4f4b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01b0 expref: 19 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.677985:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a03cdc00/0xf1867c21abfa4f4b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01b0 expref: 19 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.677997:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066744.678001:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066744.678008:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066744.678015:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066744.678497:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.678785:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.678877:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882982858752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 930us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.678899:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6672 00000100:00100000:1.0:1746066744.678922:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982858880 00000100:00100000:1.0:1746066744.678926:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982858880 00002000:00100000:1.0:1746066744.678953:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958ad880 x1830882982858880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.678970:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882982858880 ext(4194304->5033983) 00002000:00010000:1.0:1746066744.678975:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ad880 00000100:00100000:1.0:1746066744.680050:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3782 00000100:00100000:1.0:1746066744.680058:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982858880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.684408:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.684451:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.684494:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.684541:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982859264 00000100:00100000:1.0:1746066744.684550:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982859264 00000100:00100000:1.0:1746066744.684588:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982859392 00000100:00100000:1.0:1746066744.684590:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982859392 00000100:00100000:1.0:1746066744.684607:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982859520 00000100:00100000:1.0:1746066744.684608:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982859520 00000100:00100000:1.0:1746066744.684622:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15038 00000100:00100000:1.0:1746066744.684628:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982859264:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066744.684646:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.684663:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbea800/0xf1867c21abfa50b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0282 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.684723:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984299008:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066744.684791:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.684805:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15040 00000100:00100000:0.0:1746066744.684812:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882982859520:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066744.684818:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066744.684825:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0152200/0xf1867c21abfa50be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0290 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066744.684834:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.684835:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066744.684840:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0152200/0xf1867c21abfa50be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0290 expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066744.684849:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0152200/0xf1867c21abfa50be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0290 expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066744.684856:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152200, rc 0) 00000100:00100000:0.0:1746066744.684870:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882982859520:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 60us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.684876:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15040 00000100:00100000:0.0:1746066744.687847:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.688559:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.695868:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982858880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15810us (18414us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066744.695874:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3782 00002000:00100000:1.0:1746066744.695880:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958ad880 x1830882982858880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.695906:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882982858880 ext(4194304->5033983) 00002000:00010000:1.0:1746066744.695910:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958ad880 00000100:00100000:0.0:1746066744.700465:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.702406:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.702540:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982860160 00000100:00100000:1.0:1746066744.702544:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982860160 00000100:00100000:1.0:1746066744.702585:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16128 00000100:00100000:1.0:1746066744.702591:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:32598:x1830882982860160:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066744.702601:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.702613:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa50da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d02a5 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.702711:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.702724:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130800c00/0xf1867c21abfa50a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d027b expref: 19 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.702730:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0266 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.702737:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066744.702758:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0266 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.702769:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0266 expref: 16 pid: 17253 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.702777:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984299520:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066744.702824:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130800c00/0xf1867c21abfa50a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d027b expref: 19 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.702832:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130800c00/0xf1867c21abfa50a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d027b expref: 19 pid: 13370 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.702840:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984299648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066744.703530:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066744.705667:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.705731:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.705928:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982860544 00000100:00100000:0.0:1746066744.705935:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982860544 00010000:00010000:0.0:1746066744.705963:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130800c00/0xf1867c21abfa50a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d027b expref: 20 pid: 13370 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.705993:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982860416 00000100:00100000:0.0:1746066744.705996:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982860416 00010000:00010000:0.0:1746066744.706005:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0266 expref: 17 pid: 17253 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.706018:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6673 00000100:00100000:0.0:1746066744.706023:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882982860544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066744.706034:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.706039:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130800c00/0xf1867c21abfa50a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d027b expref: 20 pid: 13370 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.706052:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130800c00/0xf1867c21abfa50a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d027b expref: 20 pid: 13370 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.706069:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130800c00/0xf1867c21abfa50a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d027b expref: 20 pid: 13370 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.706086:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066744.706091:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.706099:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.706104:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.706130:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982860544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.706135:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6673 00000100:00100000:0.0:1746066744.706147:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6674 00000100:00100000:0.0:1746066744.706151:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982860416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066744.706157:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.706160:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0266 expref: 17 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.706166:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0266 expref: 17 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.706176:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77c00/0xf1867c21abfa507f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0266 expref: 17 pid: 17253 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.706185:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066744.706188:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.706194:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.706200:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.706213:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.706225:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982860416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 73us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.706230:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6674 00000100:00100000:0.0:1746066744.709981:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.710465:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.711156:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982860928 00000100:00100000:1.0:1746066744.711161:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982860928 00010000:00010000:1.0:1746066744.711179:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfa4f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01d3 expref: 36 pid: 13363 timeout: 812 lvb_type: 0 00000100:00100000:1.0:1746066744.711211:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6675 00000100:00100000:1.0:1746066744.711218:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982860928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066744.711227:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066744.711237:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfa4f7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01d3 expref: 36 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.711246:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfa4f7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01d3 expref: 36 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.711261:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36600/0xf1867c21abfa4f7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->1925119) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01d3 expref: 36 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.711277:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.711280:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.711287:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.711294:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.711317:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066744.711326:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984300032:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066744.711362:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066744.717034:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.717061:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982861056 00000100:00100000:1.0:1746066744.717065:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984300032:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066744.717067:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982861056 00010000:00010000:1.0:1746066744.717087:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066744.717099:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02a5 expref: 18 pid: 7243 timeout: 812 lvb_type: 0 00000100:00100000:0.0:1746066744.717125:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6676 00000100:00100000:0.0:1746066744.717133:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982861056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066744.717135:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882982860928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5917us (6669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.717142:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6675 00010000:00010000:0.0:1746066744.717144:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066744.717150:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02a5 expref: 18 pid: 7243 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.717166:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbebc00/0xf1867c21abfa50e1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02a5 expref: 18 pid: 7243 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.717188:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066744.717193:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.717203:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.717209:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066744.717222:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066744.717236:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982861056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 104us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066744.717241:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6676 00000100:00100000:1.0:1746066744.717251:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.717272:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982861312 00000100:00100000:0.0:1746066744.717275:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982861312 00000100:00100000:0.0:1746066744.720497:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.720544:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.720583:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982861824 00000100:00100000:1.0:1746066744.720592:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982861824 00002000:00100000:1.0:1746066744.720629:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a4ed7100 x1830882982861824/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.720639:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7100 with x1830882982861824 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.720645:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed7100 00000100:00100000:1.0:1746066744.720664:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3783 00000100:00100000:1.0:1746066744.720671:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882982861824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.722692:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.736281:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.736454:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882982861824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15782us (15962us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066744.736466:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3783 00002000:00100000:1.0:1746066744.736478:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a4ed7100 x1830882982861824/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.736487:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7100 with x1830882982861824 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.736492:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed7100 00000100:00100000:1.0:1746066744.736853:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982862336 00000100:00100000:1.0:1746066744.736860:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982862336 00002000:00100000:1.0:1746066744.736910:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (3350528->3715071) req@ffff8800a4ed7800 x1830882982862336/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.736917:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7800 with x1830882982862336 ext(3350528->3715071) 00010000:00010000:1.0:1746066744.736925:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa5039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0258 expref: 34 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:1.0:1746066744.736940:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa5039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0258 expref: 34 pid: 13363 timeout: 812 lvb_type: 0 00002000:00010000:1.0:1746066744.736946:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ed7800 00000100:00100000:1.0:1746066744.737855:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 800 00000100:00100000:1.0:1746066744.737865:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882982862336:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066744.745263:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.746733:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982862336:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8865us (10457us total) trans 17179874262 rc 0/0 00000100:00100000:0.0:1746066744.746743:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 800 00002000:00100000:0.0:1746066744.746752:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (3350528->3715071) req@ffff8800a4ed7800 x1830882982862336/t17179874262(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/448 e 0 to 0 dl 1746066755 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.746763:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7800 with x1830882982862336 ext(3350528->3715071) 00010000:00010000:0.0:1746066744.746772:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa5039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0258 expref: 36 pid: 13363 timeout: 812 lvb_type: 0 00010000:00010000:0.0:1746066744.746786:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa5039 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3715071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0258 expref: 36 pid: 13363 timeout: 812 lvb_type: 0 00002000:00010000:0.0:1746066744.746793:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ed7800 00000100:00100000:0.0:1746066744.746808:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982862848 00000100:00100000:0.0:1746066744.746814:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982862848 00002000:00100000:0.0:1746066744.746845:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098481f80 x1830882982862848/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066744.746852:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098481f80 with x1830882982862848 ext(2097152->3145727) 00002000:00010000:0.0:1746066744.746855:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098481f80 00000100:00100000:0.0:1746066744.746871:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3785 00000100:00100000:0.0:1746066744.746877:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982862848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066744.757958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.758420:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982862848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11539us (13154us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066744.758432:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3785 00002000:00100000:1.0:1746066744.758445:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098481f80 x1830882982862848/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.758454:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098481f80 with x1830882982862848 ext(2097152->3145727) 00002000:00010000:1.0:1746066744.758461:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098481f80 00000100:00100000:0.0:1746066744.761083:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.761325:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982863488 00000100:00100000:1.0:1746066744.761331:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982863488 00002000:00100000:1.0:1746066744.761362:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2572288->2576383) req@ffff880098481c00 x1830882982863488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.761371:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098481c00 with x1830882982863488 ext(2572288->2576383) 00002000:00010000:1.0:1746066744.761375:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098481c00 00000100:00100000:1.0:1746066744.761393:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3786 00000100:00100000:1.0:1746066744.761397:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882982863488:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066744.761511:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882982863488:12345-192.168.204.16@tcp:3:cat.0 Request processed in 113us (435us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066744.761516:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3786 00002000:00100000:1.0:1746066744.761520:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2572288->2576383) req@ffff880098481c00 x1830882982863488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.761526:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098481c00 with x1830882982863488 ext(2572288->2576383) 00002000:00010000:1.0:1746066744.761528:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098481c00 00000100:00100000:0.0:1746066744.763506:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.764224:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982863744 00000100:00100000:1.0:1746066744.764233:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982863744 00002000:00100000:1.0:1746066744.764273:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff880098481180 x1830882982863744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 504/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.764281:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098481180 with x1830882982863744 ext(2097152->3145727) 00002000:00010000:1.0:1746066744.764287:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098481180 00000100:00100000:1.0:1746066744.764711:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3787 00000100:00100000:1.0:1746066744.764719:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982863744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066744.776035:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982863744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11306us (12524us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746066744.776048:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3787 00002000:00100000:1.0:1746066744.776061:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff880098481180 x1830882982863744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:150/0 lens 504/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.776070:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098481180 with x1830882982863744 ext(2097152->3145727) 00002000:00010000:1.0:1746066744.776077:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098481180 00000100:00100000:0.0:1746066744.783071:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.788653:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.878024:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.919380:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.920673:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.927005:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.930525:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.942606:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.946596:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.953787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066744.955003:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984301184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066744.955015:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984301312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066744.955053:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa5174 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->2449407] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f2 expref: 34 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066744.955072:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46e00, rc 0) 00000100:00100000:3.0:1746066744.955116:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+34:32608:x1830882982865920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8123us (8532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066744.955125:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15049 00000100:00100000:0.0:1746066744.958729:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.960368:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.965828:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066744.966147:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982866560 00000100:00100000:3.0:1746066744.966158:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982866560 00000100:00100000:3.0:1746066744.966239:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16133 00000100:00100000:3.0:1746066744.966250:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+42:32613:x1830882982866560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066744.966292:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066744.966316:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece200/0xf1867c21abfa517b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d02f9 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066744.966435:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066744.966453:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066744.966465:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066744.966478:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066744.966601:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ece200/0xf1867c21abfa517b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066744.966630:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 44 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066744.966639:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066744.966642:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746066744.966646:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf200, rc 0) 00000100:00100000:3.0:1746066744.968969:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:32613:x1830882982866560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2719us (3149us total) trans 8589936436 rc 0/0 00000100:00100000:3.0:1746066744.968976:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16133 00000100:00100000:0.0:1746066744.970010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.970059:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982866816 00000100:00100000:1.0:1746066744.970067:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982866816 00002000:00100000:1.0:1746066744.970105:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2445312->2449407) req@ffff8800a4d09f80 x1830882982866816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.970114:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d09f80 with x1830882982866816 ext(2445312->2449407) 00002000:00010000:1.0:1746066744.970120:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d09f80 00000100:00100000:1.0:1746066744.970856:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3790 00000100:00100000:1.0:1746066744.970865:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982866816:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066744.971035:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982866816:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 166us (1025us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066744.971041:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3790 00002000:00100000:1.0:1746066744.971047:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2445312->2449407) req@ffff8800a4d09f80 x1830882982866816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/4536 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.971060:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d09f80 with x1830882982866816 ext(2445312->2449407) 00002000:00010000:1.0:1746066744.971063:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d09f80 00000100:00100000:0.0:1746066744.971440:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.971541:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.971591:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982867072 00000100:00100000:1.0:1746066744.971595:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982867072 00000100:00100000:0.0:1746066744.971601:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.971640:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982866944 00000100:00100000:1.0:1746066744.971642:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982866944 00000100:00100000:1.0:1746066744.971653:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982867200 00000100:00100000:1.0:1746066744.971654:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982867200 00000100:00100000:1.0:1746066744.971665:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15050 00000100:00100000:1.0:1746066744.971669:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982867072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066744.971678:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.971703:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa5190 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0307 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.971728:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa5190 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0307 expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.971737:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa5190 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0307 expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.971749:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82a00, rc 0) 00000100:00100000:1.0:1746066744.971769:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982867072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 99us (332us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066744.971773:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15050 00000100:00100000:1.0:1746066744.971781:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15051 00000100:00100000:1.0:1746066744.971784:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982866944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066744.971791:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.971799:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0300 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066744.971801:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15052 00000100:00100000:3.0:1746066744.971809:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982867200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066744.971809:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066744.971811:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066744.971816:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066744.971819:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066744.971823:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa519e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d030e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066744.971832:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066744.971840:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82600, rc 0) 00000100:00100000:1.0:1746066744.971849:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982866944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066744.971854:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15051 00000100:00100000:3.0:1746066744.971860:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984301568:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066744.972018:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066744.974042:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984301568:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066744.974071:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa519e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d030e expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066744.974082:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa519e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d030e expref: 37 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066744.974103:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf800, rc 0) 00000100:00100000:3.0:1746066744.974141:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982867200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2333us (2540us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066744.974148:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15052 00000100:00100000:0.0:1746066744.980074:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.987047:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066744.987095:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066744.987097:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982867840 00000100:00100000:1.0:1746066744.987341:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982867840 00002000:00100000:1.0:1746066744.987363:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880093ccd500 x1830882982867840/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/0 e 0 to 0 dl 1746066755 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066744.987370:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd500 with x1830882982867840 ext(1048576->2097151) 00002000:00010000:1.0:1746066744.987374:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccd500 00000100:00100000:1.0:1746066744.987398:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3792 00000100:00100000:1.0:1746066744.987406:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982867840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066744.999112:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982867968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11847us (12013us total) trans 0 rc 892928/892928 00000100:00100000:3.0:1746066744.999120:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3791 00002000:00100000:3.0:1746066744.999127:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1941503) req@ffff880093ccdc00 x1830882982867968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:150/0 lens 488/440 e 0 to 0 dl 1746066755 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066744.999134:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdc00 with x1830882982867968 ext(1048576->1941503) 00002000:00010000:3.0:1746066744.999137:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccdc00 00000100:00100000:0.0:1746066745.006770:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.006813:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.007094:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982868096 00000100:00100000:3.0:1746066745.007104:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982868096 00000100:00100000:0.0:1746066745.007122:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.007162:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982868224 00000100:00100000:3.0:1746066745.007164:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982868224 00000100:00100000:1.0:1746066745.007175:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982868352 00000100:00100000:1.0:1746066745.007179:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982868352 00000100:00100000:3.0:1746066745.007182:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15053 00000100:00100000:3.0:1746066745.007189:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982868096:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066745.007206:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15054 00010000:00010000:3.0:1746066745.007207:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066745.007212:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:32610:x1830882982868224:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066745.007220:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.007226:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0315 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.007228:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d031c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.008264:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa4f9f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01f6 expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.008273:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066745.008274:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066745.008278:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.008295:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51a5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0315 expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.008301:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa4f9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01f6 expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.008313:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa4f9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d01f6 expref: 26 pid: 20361 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.008322:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0315 expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066745.008322:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984301824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.008347:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ece400, rc 0) 00000100:00100000:1.0:1746066745.008364:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.008375:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982868096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1185us (1617us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066745.008381:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15053 00000100:00100000:0.0:1746066745.010190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.010211:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984301824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.010230:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.010242:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5e82a00, rc 0) 00000100:00100000:3.0:1746066745.010263:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:32610:x1830882982868224:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3052us (3449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.010269:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15054 00000100:00080000:0.0:1746066745.011647:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066745.016394:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.016520:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.016548:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.016557:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982868992 00000100:00100000:0.0:1746066745.016566:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982868992 00000100:00100000:3.0:1746066745.016568:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982869120 00000100:00100000:3.0:1746066745.016572:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982869120 00000100:00100000:3.0:1746066745.016608:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15056 00002000:00100000:0.0:1746066745.016613:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2449408->3145727) req@ffff88008e332680 x1830882982868992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066745.016616:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982869120:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:0.0:1746066745.016623:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332680 with x1830882982868992 ext(2449408->3145727) 00002000:00010000:0.0:1746066745.016629:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e332680 00010000:00010000:3.0:1746066745.016630:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066745.016644:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3793 00010000:00010000:3.0:1746066745.016648:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfa51cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0331 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.016649:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982868992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066745.016707:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984301952:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066745.016793:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.016834:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.016850:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982869248 00000100:00100000:3.0:1746066745.016853:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982869248 00000100:00100000:3.0:1746066745.016870:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15057 00000100:00100000:3.0:1746066745.016874:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982869248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.016880:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.016906:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfa51d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0338 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.016923:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfa51d6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0338 expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.016931:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf800/0xf1867c21abfa51d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0338 expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.016947:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf800, rc 0) 00000100:00100000:3.0:1746066745.016969:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982869248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 94us (134us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066745.016975:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15057 00002000:00010000:3.0:1746066745.018728:0:12237:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066745 -> 1746066746 00002000:00010000:3.0:1746066745.018731:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066745 -> 1746066746 00002000:00010000:3.0:1746066745.018733:0:12237:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066745 -> 1746066746 00000100:00100000:3.0:1746066745.018746:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984301952:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066745.018766:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfa51cf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0331 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.018778:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfa51cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0331 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.018784:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecec00, rc 0) 00000100:00100000:3.0:1746066745.018816:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982869120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2201us (2267us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066745.018820:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15056 00000100:00100000:3.0:1746066745.022833:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984302080:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066745.022855:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.022877:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882982868736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5711us (6494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.022929:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6684 00000100:00100000:0.0:1746066745.023639:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.025048:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.025542:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982869632 00000100:00100000:3.0:1746066745.025550:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982869632 00000100:00100000:3.0:1746066745.025599:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15058 00000100:00100000:3.0:1746066745.025606:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+36:32613:x1830882982869632:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.025621:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.025638:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d033f expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.025667:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.025675:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.025677:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.025681:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 37 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.025725:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.025737:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 19 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.025750:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984302208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066745.025760:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.025834:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.033720:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.033741:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984302208:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.033771:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 37 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.033791:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecfe00, rc 0) 00000100:00100000:3.0:1746066745.033837:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+37:32613:x1830882982869632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8231us (8793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.033846:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15058 00000100:00100000:1.0:1746066745.033990:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982870144 00000100:00100000:1.0:1746066745.033997:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982870144 00002000:00100000:1.0:1746066745.034048:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2572288->3145727) req@ffff880093cce680 x1830882982870144/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.034057:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cce680 with x1830882982870144 ext(2572288->3145727) 00010000:00010000:1.0:1746066745.034064:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 20 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.034076:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 20 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746066745.034082:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cce680 00000100:00100000:1.0:1746066745.034097:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 801 00000100:00100000:1.0:1746066745.034104:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982870144:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066745.034336:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.034432:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982870016 00000100:00100000:3.0:1746066745.034436:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982870016 00000100:00100000:3.0:1746066745.034454:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15059 00000100:00100000:3.0:1746066745.034458:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:32617:x1830882982870016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.034468:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.034482:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0346 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.034505:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.034512:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.034513:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.034517:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.034540:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.034549:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 32 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.034560:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984302336:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.034617:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.038676:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.038814:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984302336:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.038846:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.038863:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ece400, rc 0) 00000100:00100000:3.0:1746066745.038940:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:32617:x1830882982870016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4479us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.038949:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15059 00000100:00100000:3.0:1746066745.044058:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882982870272:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4922us (5393us total) trans 21474841690 rc 0/0 00000100:00100000:3.0:1746066745.044066:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 802 00002000:00100000:3.0:1746066745.044071:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1941504->2097151) req@ffff88006e210700 x1830882982870272/t21474841690(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.044078:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210700 with x1830882982870272 ext(1941504->2097151) 00010000:00010000:3.0:1746066745.044084:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 35 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.044092:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 35 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.044098:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e210700 00000100:00100000:0.0:1746066745.048007:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.048158:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982870400 00000100:00100000:3.0:1746066745.048168:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982870400 00010000:00010000:3.0:1746066745.048210:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 35 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.050069:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6685 00000100:00100000:3.0:1746066745.050082:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882982870400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.050101:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.050123:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 35 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.050135:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 35 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.050162:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfc00/0xf1867c21abfa514a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02e4 expref: 35 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.050195:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.050198:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.050205:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 25 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.050214:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 25 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.050247:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 25 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.050259:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984302464:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066745.050355:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.050594:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.050634:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982870528 00000100:00100000:1.0:1746066745.050641:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982870528 00010000:00010000:1.0:1746066745.050664:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 22 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.050682:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6686 00000100:00100000:1.0:1746066745.050687:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982870528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.050705:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.050717:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 22 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.050725:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 22 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.050737:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa5104 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2572288->3026943) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c1 expref: 22 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.050753:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.050755:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.050759:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 36 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.050766:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 36 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.050783:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 36 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.050791:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984302592:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066745.050820:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.053068:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e211180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984302592:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066745.053093:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.053132:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982870528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2444us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.053136:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984302464:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066745.053142:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6686 00010000:00010000:3.0:1746066745.053148:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.053167:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882982870400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3090us (5170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.053174:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6685 00000100:00100000:0.0:1746066745.054813:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.055997:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.056248:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3796 00000100:00100000:1.0:1746066745.056256:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982871040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.066225:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.068545:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982871168 00000100:00100000:3.0:1746066745.068558:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982871168 00000100:00100000:3.0:1746066745.068620:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16135 00000100:00100000:3.0:1746066745.068629:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:32619:x1830882982871168:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066745.068656:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.068676:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfa51eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d034d expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.068754:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068770:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068780:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068793:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068797:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068802:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068863:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5200 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068871:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5200 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068875:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5200 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066745.068922:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066745.068926:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066745.068939:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5200 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068948:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5200 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068955:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068960:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068965:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068970:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068975:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066745.068978:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068983:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.068992:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066745.068995:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066745.068998:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069002:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa51f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069026:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069030:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069035:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069039:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5993c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066745.069042:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069046:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069051:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800957ea200) 00010000:00010000:3.0:1746066745.069053:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066745.069055:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069060:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa51f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.069091:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2800/0xf1867c21abfa51eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d034d expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.069101:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5200 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d034d expref: 18 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.069107:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.069109:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066745.069111:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992800, rc 0) 00000100:00100000:3.0:1746066745.069171:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32619:x1830882982871168:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 543us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.069177:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16135 00000100:00100000:1.0:1746066745.071088:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982871040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14827us (15088us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066745.071096:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3796 00002000:00100000:1.0:1746066745.071104:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093ccc700 x1830882982871040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.071114:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccc700 with x1830882982871040 ext(1048576->2097151) 00002000:00010000:1.0:1746066745.071119:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccc700 00000100:00100000:0.0:1746066745.074474:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.074643:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982871296 00000100:00100000:3.0:1746066745.074655:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982871296 00000100:00100000:3.0:1746066745.074717:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 773 00000100:00100000:3.0:1746066745.074725:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982871296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.074744:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.074773:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5200 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d034d expref: 18 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.074791:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.074795:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.074826:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982871296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.076231:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 773 00000100:00100000:0.0:1746066745.076815:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.076904:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.076930:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.077017:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982871680 00000100:00100000:3.0:1746066745.077024:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982871680 00000100:00100000:3.0:1746066745.077048:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982871552 00000100:00100000:3.0:1746066745.077050:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982871552 00000100:00100000:3.0:1746066745.077167:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15060 00000100:00100000:3.0:1746066745.077174:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982871680:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066745.077193:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.077209:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0362 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.077231:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.077233:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.077241:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 17 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.077260:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 17 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.077270:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993600, rc 0) 00000100:00100000:3.0:1746066745.077306:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982871680:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 133us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.077311:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15060 00000100:00100000:3.0:1746066745.077321:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15062 00000100:00100000:3.0:1746066745.077325:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982871552:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066745.077330:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.077335:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5992000/0xf1867c21abfa5215 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d035b expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.077370:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984302720:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066745.077417:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.078056:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.081245:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.081282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:3.0:1746066745.081388:0:12237:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066745 -> 1746066746 00002000:00010000:3.0:1746066745.081393:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066745 -> 1746066746 00002000:00010000:3.0:1746066745.081395:0:12237:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066745 -> 1746066746 00000100:00100000:3.0:1746066745.081414:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984302720:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066745.081447:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992000/0xf1867c21abfa5215 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d035b expref: 20 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.081459:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992000/0xf1867c21abfa5215 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d035b expref: 20 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.081485:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992000, rc 0) 00000100:00100000:3.0:1746066745.081528:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982871552:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4201us (4596us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066745.081536:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15062 00000100:00100000:3.0:1746066745.083010:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982872064 00000100:00100000:3.0:1746066745.083019:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982872064 00000100:00100000:3.0:1746066745.083059:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15064 00000100:00100000:3.0:1746066745.083065:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:32613:x1830882982872064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.083078:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.083091:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa5223 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0370 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.083113:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.083120:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.083122:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.083126:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa5223 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0370 expref: 36 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.083150:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 26 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.083159:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 26 pid: 12237 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.083174:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984302976:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.083221:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.086256:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.086553:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982872320 00000100:00100000:3.0:1746066745.086562:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982872320 00000100:00100000:3.0:1746066745.086615:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16136 00000100:00100000:3.0:1746066745.086626:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:32619:x1830882982872320:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066745.086647:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.086664:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993200/0xf1867c21abfa522a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0377 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.087367:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.087382:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02ba expref: 18 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.087389:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfa513c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02dd expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.087395:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa5166 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02eb expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.087401:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.087433:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa5166 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02eb expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.087446:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa5166 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02eb expref: 25 pid: 7243 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.087457:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303104:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.087548:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfa513c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02dd expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.087556:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfa513c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02dd expref: 44 pid: 17253 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.087564:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303232:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.087589:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02ba expref: 18 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.087596:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02ba expref: 18 pid: 7243 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.087603:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea27800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303360:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.087620:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.088469:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.088530:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982872448 00000100:00100000:1.0:1746066745.088536:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982872448 00002000:00100000:1.0:1746066745.088566:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3338239) req@ffff88012c490a80 x1830882982872448/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.088574:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490a80 with x1830882982872448 ext(3145728->3338239) 00010000:00010000:1.0:1746066745.088582:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 27 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.088591:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 27 pid: 12237 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746066745.088598:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c490a80 00000100:00100000:1.0:1746066745.088615:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 804 00000100:00100000:1.0:1746066745.088621:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882982872448:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066745.089361:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984302976:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.089384:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa5223 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0370 expref: 39 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.089399:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992e00, rc 0) 00000100:00100000:3.0:1746066745.089425:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+39:32613:x1830882982872064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6360us (8142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.089433:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15064 00000100:00100000:3.0:1746066745.089512:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882982871936:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6385us (8277us total) trans 21474841691 rc 0/0 00000100:00100000:3.0:1746066745.089518:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 803 00002000:00100000:3.0:1746066745.089524:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2449407) req@ffff88012c490e00 x1830882982871936/t21474841691(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.089531:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490e00 with x1830882982871936 ext(2097152->2449407) 00010000:00010000:3.0:1746066745.089536:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa5174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f2 expref: 37 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.089543:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa5174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f2 expref: 37 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.089548:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c490e00 00000100:00100000:0.0:1746066745.091457:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.091472:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.091490:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.091927:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982872576 00000100:00100000:3.0:1746066745.091935:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982872576 00010000:00010000:3.0:1746066745.091968:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa5166 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02eb expref: 26 pid: 7243 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.091990:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982872704 00000100:00100000:3.0:1746066745.091992:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982872704 00010000:00010000:3.0:1746066745.092058:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfa513c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02dd expref: 45 pid: 17253 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.092072:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982872832 00000100:00100000:3.0:1746066745.092074:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982872832 00010000:00010000:3.0:1746066745.092083:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02ba expref: 19 pid: 7243 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.092101:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6687 00000100:00100000:3.0:1746066745.092107:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982872576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.092119:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.092123:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa5166 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02eb expref: 26 pid: 7243 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.092132:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa5166 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02eb expref: 26 pid: 7243 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.092153:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.092157:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.092165:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.092169:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.092204:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982872576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.092209:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6687 00000100:00100000:3.0:1746066745.092226:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6689 00000100:00100000:3.0:1746066745.092230:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982872832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.092236:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.092239:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02ba expref: 19 pid: 7243 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.092484:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02ba expref: 19 pid: 7243 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.092496:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.092499:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.092505:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT flags: 0x50290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.092512:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT flags: 0x50290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.092528:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.092544:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982872832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 312us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.092550:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6689 00010000:00010000:3.0:1746066745.092589:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8d2000/0xf1867c21abfa5166 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02eb expref: 25 pid: 7243 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.092605:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303104:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.092617:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47200/0xf1867c21abfa513c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02dd expref: 44 pid: 17253 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.092625:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303232:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.092634:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46200/0xf1867c21abfa50fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02ba expref: 18 pid: 7243 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.092647:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea27800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.092667:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.092675:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.092679:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066745.092705:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000100:00100000:0.0:1746066745.092779:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066745.092795:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993200/0xf1867c21abfa522a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0377 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.092797:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982872960 00000100:00100000:0.0:1746066745.092800:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982872960 00010000:00010000:3.0:1746066745.092806:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0377 expref: 18 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.092812:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.092815:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066745.092817:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992800, rc 0) 00010000:00010000:0.0:1746066745.092817:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa5174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f2 expref: 37 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.092845:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6690 00000100:00100000:0.0:1746066745.092851:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882982872960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066745.092853:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32619:x1830882982872320:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6227us (6608us total) trans 8589936440 rc 0/0 00010000:00010000:0.0:1746066745.092858:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066745.092859:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16136 00010000:00010000:0.0:1746066745.092870:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa5174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f2 expref: 37 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.092878:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa5174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2449407) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f2 expref: 37 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.092907:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa5174 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2449407) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f2 expref: 37 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.092929:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.092932:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.092938:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa521c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0369 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.092945:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa521c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0369 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.092971:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa521c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0369 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.092982:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984303488:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066745.093034:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.094310:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982872448:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5685us (5838us total) trans 21474841692 rc 0/0 00000100:00100000:1.0:1746066745.094318:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 804 00002000:00100000:1.0:1746066745.094979:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3338239) req@ffff88012c490a80 x1830882982872448/t21474841692(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.094989:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490a80 with x1830882982872448 ext(3145728->3338239) 00010000:00010000:1.0:1746066745.094996:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 29 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.095010:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5e82a00/0xf1867c21abfa51ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d031c expref: 29 pid: 12237 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746066745.095017:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c490a80 00000100:00100000:0.0:1746066745.097598:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.097641:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.097729:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982873216 00000100:00100000:3.0:1746066745.097737:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982873216 00000100:00100000:3.0:1746066745.097774:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16137 00000100:00100000:3.0:1746066745.097781:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32619:x1830882982873216:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066745.097996:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.098012:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa523f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d037e expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.098369:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.098383:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0377 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.098388:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 15 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.098413:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0377 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.098423:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5231 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0377 expref: 19 pid: 17253 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.098432:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea27800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303744:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.098457:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.100127:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea27800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984303744:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.100144:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066745.101909:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.102578:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.102613:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982873600 00000100:00100000:1.0:1746066745.102617:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982873600 00002000:00100000:1.0:1746066745.102647:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8801310f2680 x1830882982873600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.102656:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2680 with x1830882982873600 ext(2097152->3145727) 00002000:00010000:1.0:1746066745.102659:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f2680 00010000:00010000:3.0:1746066745.102731:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.102737:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066745.102792:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066745.102796:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066745.102812:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.102857:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa523f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d037e expref: 20 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.102857:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3797 00000100:00100000:1.0:1746066745.102863:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882982873600:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066745.102871:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d037e expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.102877:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.102879:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066745.102897:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a000, rc 0) 00000100:00100000:3.0:1746066745.103933:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32619:x1830882982873216:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6149us (6334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.103939:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16137 00000100:00100000:0.0:1746066745.110737:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.110777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.111073:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3799 00000100:00100000:3.0:1746066745.111081:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982874112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.111991:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.112089:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882982873600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9224us (9509us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066745.112097:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3797 00002000:00100000:1.0:1746066745.112104:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8801310f2680 x1830882982873600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.112114:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2680 with x1830882982873600 ext(2097152->3145727) 00002000:00010000:1.0:1746066745.112118:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f2680 00000100:00100000:0.0:1746066745.128549:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982874624 00000100:00100000:0.0:1746066745.128558:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982874624 00000100:00100000:3.0:1746066745.128564:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982874112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17483us (17784us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.128575:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3799 00002000:00100000:3.0:1746066745.128586:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8801310f0e00 x1830882982874112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.128594:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0e00 with x1830882982874112 ext(3145728->4194303) 00000100:00100000:0.0:1746066745.128599:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15066 00002000:00010000:3.0:1746066745.128600:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f0e00 00000100:00100000:0.0:1746066745.128605:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+21:32617:x1830882982874624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.128622:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066745.128655:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066745.128836:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0393 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.128862:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.128864:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.128872:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0393 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.128905:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0393 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.128916:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b226de00, rc 0) 00000100:00100000:0.0:1746066745.128934:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:32617:x1830882982874624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 329us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.128939:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15066 00000100:00100000:3.0:1746066745.129290:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982874496 00000100:00100000:3.0:1746066745.129294:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982874496 00000100:00100000:3.0:1746066745.129319:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16138 00000100:00100000:3.0:1746066745.129324:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32619:x1830882982874496:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066745.129334:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.129346:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576be00/0xf1867c21abfa525b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d038c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.129447:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5262 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.129461:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5262 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.129470:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5262 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066745.129481:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066745.129575:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576be00/0xf1867c21abfa525b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d038c expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.129606:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5262 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d038c expref: 20 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.129613:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.129616:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066745.129618:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:3.0:1746066745.129652:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:32619:x1830882982874496:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 327us (996us total) trans 8589936441 rc 0/0 00000100:00100000:3.0:1746066745.129658:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16138 00000100:00100000:1.0:1746066745.133311:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.134027:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.134079:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.135064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.135098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.135341:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982874880 00000100:00100000:0.0:1746066745.135348:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982874880 00000100:00100000:0.0:1746066745.135379:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982875008 00000100:00100000:0.0:1746066745.135381:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982875008 00000100:00100000:3.0:1746066745.135382:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982875520 00000100:00100000:3.0:1746066745.135387:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982875520 00000100:00100000:0.0:1746066745.135393:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982875136 00000100:00100000:0.0:1746066745.135395:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982875136 00000100:00100000:0.0:1746066745.135407:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15068 00000100:00100000:0.0:1746066745.135413:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882982874880:12345-192.168.204.16@tcp:1:lfs.0 00002000:00100000:3.0:1746066745.135420:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800b40b4e00 x1830882982875520/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.135429:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b4e00 with x1830882982875520 ext(2097152->3145727) 00002000:00010000:3.0:1746066745.135435:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800b40b4e00 00010000:00010000:0.0:1746066745.135448:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b226da00/0xf1867c21abfa5277 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.135456:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3800 00000100:00100000:3.0:1746066745.135461:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882982875520:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:0.0:1746066745.135466:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa4c1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffc6 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135473:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfa4dca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00de expref: 27 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135480:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 20 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135486:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.135488:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.135490:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226da00/0xf1867c21abfa5277 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.135522:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 20 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135534:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 20 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.135548:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984303872:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066745.135631:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfa4dca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00de expref: 27 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135640:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece200/0xf1867c21abfa4dca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d00de expref: 27 pid: 13363 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.135648:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984304000:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066745.135673:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa4c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffc6 expref: 36 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135680:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa4c1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffc6 expref: 36 pid: 12255 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.135686:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984304128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066745.135713:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.135733:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15069 00000100:00100000:0.0:1746066745.135738:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982875008:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066745.135755:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.135765:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa4bf5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffb8 expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.135772:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 18 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135783:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 36 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135788:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.135789:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.135791:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.135807:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 36 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135815:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 36 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.135823:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984304256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066745.135848:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 18 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.135855:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 18 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.135862:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984304384:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066745.135896:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa4bf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffb8 expref: 23 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.135908:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa4bf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffb8 expref: 23 pid: 1893 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.135915:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984304512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066745.135941:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.136010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.136051:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.136123:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.136139:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982875264 00000100:00100000:1.0:1746066745.136142:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982875264 00000100:00100000:1.0:1746066745.136160:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982875648 00000100:00100000:1.0:1746066745.136161:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982875648 00000100:00100000:1.0:1746066745.136169:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982875776 00000100:00100000:1.0:1746066745.136171:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982875776 00000100:00100000:1.0:1746066745.136180:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15070 00000100:00100000:1.0:1746066745.136184:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982875136:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066745.136201:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136210:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136216:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136222:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47c00/0xf1867c21abfa510b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c8 expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136227:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.136228:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.136230:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136250:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47c00/0xf1867c21abfa510b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c8 expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136257:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47c00/0xf1867c21abfa510b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c8 expref: 19 pid: 3528 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.136264:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984304640:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.136288:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136295:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 36 pid: 3528 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.136303:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984304768:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.136323:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136331:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 23 pid: 3528 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.136338:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984304896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.136352:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.136368:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15071 00000100:00100000:1.0:1746066745.136373:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2015:x1830882982875264:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066745.136390:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136404:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136410:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47000/0xf1867c21abfa5270 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d039a expref: 36 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136417:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa520e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0354 expref: 22 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136422:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.136423:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.136425:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136438:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa520e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0354 expref: 22 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136445:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa520e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0354 expref: 22 pid: 20361 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.136452:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984305024:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.136471:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47000/0xf1867c21abfa5270 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d039a expref: 36 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.136481:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47000/0xf1867c21abfa5270 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d039a expref: 36 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.136488:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984305152:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.136504:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.136511:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 27 pid: 12237 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.136518:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984305280:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.136528:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009682d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.137253:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15073 00000100:00100000:0.0:1746066745.137260:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982875776:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066745.137279:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa529a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.137290:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 36 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.137296:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0393 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.137302:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 19 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.137306:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.137307:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.137308:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa529a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.137321:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 19 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.137329:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 19 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.137336:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984305792:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066745.138066:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0393 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.138075:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0393 expref: 23 pid: 3528 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.138084:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d08e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984305920:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066745.138112:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 36 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.138119:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 36 pid: 12237 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.138126:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d82300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984306048:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066745.138143:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.138335:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.147650:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.147687:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.147711:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.147723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.147730:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982876544 00000100:00100000:3.0:1746066745.147735:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982876544 00000100:00100000:0.0:1746066745.147752:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066745.147772:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47c00/0xf1867c21abfa510b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c8 expref: 20 pid: 3528 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.147796:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982876160 00000100:00100000:3.0:1746066745.147798:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982876160 00000100:00100000:1.0:1746066745.147798:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984304512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.147809:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984304256:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.147816:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984304384:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.147830:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.147850:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984304640:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.147860:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982876416 00000100:00100000:1.0:1746066745.147862:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982876416 00010000:00010000:1.0:1746066745.147875:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa4bf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffb8 expref: 24 pid: 1893 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.147905:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982876672 00000100:00100000:1.0:1746066745.147906:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982876672 00010000:00010000:1.0:1746066745.147915:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa4c1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffc6 expref: 39 pid: 12255 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.147925:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6693 00000100:00100000:1.0:1746066745.147931:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882982876544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.147943:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.147962:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47c00/0xf1867c21abfa510b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c8 expref: 20 pid: 3528 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.147971:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa47c00/0xf1867c21abfa510b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c8 expref: 20 pid: 3528 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.147992:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47c00/0xf1867c21abfa510b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02c8 expref: 20 pid: 3528 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.148010:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.148049:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882982876544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.148055:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6693 00000100:00100000:1.0:1746066745.148072:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6694 00000100:00100000:1.0:1746066745.148076:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982876416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.148082:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.148090:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa4bf5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffb8 expref: 24 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.148098:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa4bf5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffb8 expref: 24 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.148109:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa4bf5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffb8 expref: 24 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.148116:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.148130:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882982876416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.148146:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6694 00000100:00100000:1.0:1746066745.148158:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6695 00000100:00100000:1.0:1746066745.148163:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982876672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.148171:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.148182:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa4c1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffc6 expref: 39 pid: 12255 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.148190:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa4c1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffc6 expref: 39 pid: 12255 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.148201:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa4c1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffc6 expref: 39 pid: 12255 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.148211:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.148226:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982876672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.148231:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6695 00010000:00010000:3.0:1746066745.148484:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 23 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.148501:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6697 00000100:00100000:3.0:1746066745.148506:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2015:x1830882982876160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.148515:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.148524:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 23 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.148532:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 23 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.148548:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d93c800/0xf1867c21abfa4c7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0013 expref: 23 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.148562:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.148564:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.148569:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b226da00/0xf1867c21abfa5277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.148578:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b226da00/0xf1867c21abfa5277 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.148607:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.148624:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2015:x1830882982876160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.148629:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6697 00000100:00100000:0.0:1746066745.151434:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984305664:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066745.152802:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984305408:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066745.152825:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984305536:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066745.152853:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.152902:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.153178:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984305024:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.153188:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984305152:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.153195:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984305280:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.153213:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.153236:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984304768:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.153244:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984304896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.153259:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.153281:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982876800 00000100:00100000:1.0:1746066745.153287:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982876800 00010000:00010000:1.0:1746066745.153319:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 19 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.153345:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6698 00000100:00100000:1.0:1746066745.153352:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882982876800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.153365:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.153386:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 19 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.153403:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 19 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.153426:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310f7000/0xf1867c21abfa4c8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d001a expref: 19 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.153443:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.153482:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882982876800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.153488:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6698 00000100:00100000:3.0:1746066745.153809:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982875520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18345us (18708us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.153818:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3800 00002000:00100000:3.0:1746066745.153826:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800b40b4e00 x1830882982875520/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.153834:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b4e00 with x1830882982875520 ext(2097152->3145727) 00010000:00010000:3.0:1746066745.153840:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0393 expref: 21 pid: 3528 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.153851:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b226de00/0xf1867c21abfa5254 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0393 expref: 21 pid: 3528 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.153858:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b40b4e00 00000100:00100000:0.0:1746066745.158001:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.158042:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.158121:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877056 00000100:00100000:3.0:1746066745.158130:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877056 00010000:00010000:3.0:1746066745.158166:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 18 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.158183:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877312 00000100:00100000:1.0:1746066745.158188:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877312 00000100:00100000:3.0:1746066745.158204:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6699 00010000:00010000:1.0:1746066745.158206:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 37 pid: 3528 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.158211:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982877056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.158224:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066745.158226:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6700 00000100:00100000:1.0:1746066745.158232:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882982877312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.158239:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.158243:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 18 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.158248:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 37 pid: 3528 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.158254:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 18 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.158277:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993600/0xf1867c21abfa5207 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0362 expref: 18 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.158412:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 37 pid: 3528 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.158425:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa5197 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0300 expref: 37 pid: 3528 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.158439:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.158490:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982877312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 258us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.158496:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6700 00000100:00100000:1.0:1746066745.158521:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.158530:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877568 00000100:00100000:1.0:1746066745.158533:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877568 00010000:00010000:1.0:1746066745.158545:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47000/0xf1867c21abfa5270 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d039a expref: 38 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.158568:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6701 00000100:00100000:1.0:1746066745.158573:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882982877568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.158581:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.158592:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47000/0xf1867c21abfa5270 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d039a expref: 38 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.158600:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47000/0xf1867c21abfa5270 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d039a expref: 38 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.158613:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47000/0xf1867c21abfa5270 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d039a expref: 38 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.158622:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.158637:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882982877568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.158645:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6701 00010000:00010000:3.0:1746066745.158760:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.158779:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982877056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 568us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.158785:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6699 00000100:00100000:1.0:1746066745.159081:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.159144:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.159221:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.159304:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.159439:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982876928 00000100:00100000:3.0:1746066745.159442:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982876928 00010000:00010000:3.0:1746066745.159455:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 36 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.159484:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877184 00000100:00100000:3.0:1746066745.159486:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877184 00010000:00010000:3.0:1746066745.159495:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 37 pid: 12237 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.159512:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877440 00000100:00100000:3.0:1746066745.159514:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877440 00010000:00010000:3.0:1746066745.159522:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa520e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0354 expref: 21 pid: 20361 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.159535:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6702 00000100:00100000:3.0:1746066745.159540:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882982876928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.159547:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.159556:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 37 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.159563:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 37 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.159575:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa4c26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cffcd expref: 37 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.159586:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.159588:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.159593:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159605:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159635:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066745.159640:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.159647:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.159653:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982876928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.159658:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6702 00010000:00010000:1.0:1746066745.159663:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.159666:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877952 00000100:00100000:3.0:1746066745.159668:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877952 00010000:00010000:1.0:1746066745.159671:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159676:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 21 pid: 3528 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.159678:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.159684:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6703 00010000:00010000:1.0:1746066745.159685:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b944c00 already unused, calling callback (ffffffffa0898d70) 00000100:00100000:3.0:1746066745.159688:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882982877184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.159689:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159707:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.159709:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159713:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 35 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.159720:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 35 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.159723:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.159728:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944c00/0xf1867c21abfa527e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159729:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfe00/0xf1867c21abfa51dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d033f expref: 35 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.159736:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.159749:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882982877184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.159753:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6703 00000100:00100000:3.0:1746066745.159762:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6704 00000100:00100000:3.0:1746066745.159766:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2016:x1830882982877440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066745.159767:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982875008:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 24030us (25688us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066745.159772:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066745.159775:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15069 00010000:00010000:3.0:1746066745.159780:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa520e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0354 expref: 21 pid: 20361 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.159787:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa520e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0354 expref: 21 pid: 20361 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.159797:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066745.159798:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa520e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0354 expref: 21 pid: 20361 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.159807:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.159819:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882982877440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.159821:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.159825:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6704 00000100:00100000:3.0:1746066745.159832:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877696 00000100:00100000:3.0:1746066745.159835:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877696 00000100:00100000:1.0:1746066745.159838:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066745.159845:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa521c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0369 expref: 27 pid: 9590 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.159853:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982877824 00000100:00100000:3.0:1746066745.159854:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982877824 00010000:00010000:3.0:1746066745.159859:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfa524d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0385 expref: 20 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.159871:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982878080 00000100:00100000:3.0:1746066745.159873:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982878080 00010000:00010000:3.0:1746066745.159879:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 28 pid: 12237 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.159910:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6705 00000100:00100000:3.0:1746066745.159914:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882982877952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.159920:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.159926:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 21 pid: 3528 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.159934:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 21 pid: 3528 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.159944:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46c00/0xf1867c21abfa50cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d029e expref: 21 pid: 3528 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.159952:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.159953:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.159956:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159961:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.159973:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.159996:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982877952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.160001:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6705 00000100:00100000:3.0:1746066745.160029:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6706 00000100:00100000:3.0:1746066745.160034:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882982877696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.160040:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.160049:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa521c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0369 expref: 28 pid: 9590 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.160055:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6707 00010000:00010000:3.0:1746066745.160057:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa521c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0369 expref: 28 pid: 9590 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.160063:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882982877824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.160068:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa521c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0369 expref: 28 pid: 9590 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.160070:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.160078:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066745.160078:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfa524d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0385 expref: 20 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746066745.160086:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfa524d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0385 expref: 20 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.160091:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882982877696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.160096:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6706 00010000:00010000:0.0:1746066745.160096:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46800/0xf1867c21abfa524d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0385 expref: 20 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.160106:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6708 00010000:00010000:0.0:1746066745.160114:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.160131:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982878080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066745.160131:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982877824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.160137:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6707 00010000:00010000:3.0:1746066745.160138:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.160144:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 26 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.160152:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 26 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.160162:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa51e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0346 expref: 26 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.160170:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.160171:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.160174:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.160180:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.160194:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.160210:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882982878080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.160215:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6708 00010000:00010000:1.0:1746066745.160217:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160224:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160236:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160242:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160248:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160257:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066745.160260:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160266:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160275:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.160280:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5285 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.160310:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982875136:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 24126us (25250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.160316:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15070 00010000:00010000:0.0:1746066745.160454:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160461:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160473:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160479:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160485:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160491:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009575b600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066745.160493:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160499:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160506:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160512:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa528c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.160559:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982875264:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 24186us (24548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.160566:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15071 00000100:00100000:0.0:1746066745.160778:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.160793:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982878208 00000100:00100000:0.0:1746066745.160797:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982878208 00000100:00100000:0.0:1746066745.160814:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15074 00000100:00100000:0.0:1746066745.160818:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+25:32617:x1830882982878208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.160833:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.160845:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03a1 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160858:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.160861:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160866:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066745.160869:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.160879:0:9591:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.161467:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.161482:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a5c600, rc 0) 00000100:00100000:0.0:1746066745.161502:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+26:32617:x1830882982878208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 683us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.161508:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15074 00000100:00100000:0.0:1746066745.161556:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.167301:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.167342:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.167370:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.167382:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.167394:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.167437:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.167447:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982878464 00000100:00100000:0.0:1746066745.167454:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982878592 00000100:00100000:3.0:1746066745.167457:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982878464 00000100:00100000:0.0:1746066745.167458:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982878592 00000100:00100000:3.0:1746066745.167493:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982878720 00000100:00100000:3.0:1746066745.167495:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982878720 00000100:00100000:0.0:1746066745.167578:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982878976 00000100:00100000:0.0:1746066745.167581:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982878976 00000100:00100000:3.0:1746066745.167585:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982878848 00000100:00100000:3.0:1746066745.167588:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982878848 00000100:00100000:0.0:1746066745.167594:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982879104 00000100:00100000:0.0:1746066745.167596:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982879104 00000100:00100000:0.0:1746066745.167607:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15075 00000100:00100000:3.0:1746066745.167614:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15076 00000100:00100000:0.0:1746066745.167615:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982878464:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066745.167620:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982878592:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.167634:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.167634:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.167653:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03af expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.167653:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03a8 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066745.167675:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd38, atime: 0x6812dd38, ctime: 0x6812dd38, blocks: 0x808 00002000:00010000:0.0:1746066745.167675:0:12233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd38, atime: 0x6812dd38, ctime: 0x6812dd38, blocks: 0x7b0 00010000:00010000:3.0:1746066745.167702:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.167702:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.167705:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.167705:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.167713:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.167715:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.167728:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.167728:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.167738:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017c00, rc 0) 00010000:00010000:0.0:1746066745.167738:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0a00, rc 0) 00000100:00100000:3.0:1746066745.167779:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982878592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 158us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.167780:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15077 00000100:00100000:3.0:1746066745.167785:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15076 00000100:00100000:1.0:1746066745.167789:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982878720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.167796:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066745.167800:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15078 00000100:00100000:3.0:1746066745.167804:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982878976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.167804:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03b6 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.167809:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746066745.167815:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd39, atime: 0x6812dd39, ctime: 0x6812dd39, blocks: 0x800 00010000:00010000:3.0:1746066745.167816:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfa52bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03c4 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.167823:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.167824:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.167825:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.167829:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.167834:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfa52bd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03c4 expref: 39 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.167839:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.167842:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017600/0xf1867c21abfa52bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03c4 expref: 39 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.167845:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899200, rc 0) 00010000:00010000:3.0:1746066745.167856:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017600, rc 0) 00000100:00100000:0.0:1746066745.168038:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982878464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 422us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.168044:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15075 00000100:00100000:0.0:1746066745.168057:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15079 00000100:00100000:0.0:1746066745.168062:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982878848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.168072:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.168080:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03bd expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066745.168090:0:12233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd3a, atime: 0x6812dd3a, ctime: 0x6812dd39, blocks: 0x800 00010000:00010000:0.0:1746066745.168097:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.168099:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.168102:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.168111:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.168117:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:0.0:1746066745.168138:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982878848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 76us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.168144:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15079 00000100:00100000:0.0:1746066745.168153:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15080 00000100:00100000:0.0:1746066745.168157:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982879104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.168162:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.168170:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfa52cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03cb expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066745.168180:0:12233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd3a, atime: 0x6812dd39, ctime: 0x6812dd3a, blocks: 0x1000 00010000:00010000:0.0:1746066745.168187:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.168188:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.168191:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfa52cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03cb expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.168200:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfa52cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03cb expref: 38 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.168205:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1e00, rc 0) 00000100:00100000:0.0:1746066745.168217:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982879104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 60us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.168222:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15080 00000100:00100000:1.0:1746066745.169108:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982878720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1317us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.169115:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15077 00000100:00100000:3.0:1746066745.169492:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982878976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1686us (2106us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066745.169498:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15078 00000100:00100000:3.0:1746066745.172776:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982879488 00000100:00100000:3.0:1746066745.172784:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982879488 00010000:00010000:3.0:1746066745.172820:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa5223 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0370 expref: 37 pid: 12237 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.172847:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6710 00000100:00100000:3.0:1746066745.172969:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982879488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.172983:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.173006:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa5223 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0370 expref: 37 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.173018:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa5223 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0370 expref: 37 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.173039:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa5223 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0370 expref: 37 pid: 12237 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.173055:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.173057:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.173061:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.173074:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.173095:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.173134:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982879488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 167us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.173141:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6710 00000100:00100000:3.0:1746066745.173179:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982879360 00000100:00100000:3.0:1746066745.173182:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982879360 00000100:00100000:3.0:1746066745.173203:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16139 00000100:00100000:3.0:1746066745.173208:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:32621:x1830882982879360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066745.173228:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.173241:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03d2 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.173333:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.173347:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d037e expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.173355:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5262 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d038c expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.173361:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.173384:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5262 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d038c expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.173395:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5262 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d038c expref: 19 pid: 17253 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.173406:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea27800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984306176:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.173472:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d037e expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.173479:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5246 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d037e expref: 19 pid: 17253 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.173486:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984306304:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.173502:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00010000:00010000:0.0:1746066745.173629:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173637:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173658:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173665:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173672:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173678:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa46400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066745.173681:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173688:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173709:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.173710:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.173716:0:9590:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173722:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.173745:0:9590:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.173758:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984306432:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066745.173792:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.174235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.175746:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984306432:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066745.175764:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.175771:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa5293 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.175805:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982875648:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 39327us (39753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.175811:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15072 00000100:00100000:0.0:1746066745.179535:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.183356:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.183397:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.183428:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.183458:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982880256 00000100:00100000:0.0:1746066745.183461:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.183462:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982880256 00002000:00100000:3.0:1746066745.183492:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012de5ed80 x1830882982880256/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.183506:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ed80 with x1830882982880256 ext(3145728->4194303) 00002000:00010000:3.0:1746066745.183512:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ed80 00000100:00100000:3.0:1746066745.183523:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982880384 00000100:00100000:1.0:1746066745.183526:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982880640 00000100:00100000:3.0:1746066745.183529:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982880384 00000100:00100000:1.0:1746066745.183529:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982880640 00002000:00100000:3.0:1746066745.183540:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff8800945d5f80 x1830882982880384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.183546:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5f80 with x1830882982880384 ext(5029888->5033983) 00002000:00010000:3.0:1746066745.183549:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5f80 00000100:00100000:1.0:1746066745.183552:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16140 00000100:00100000:1.0:1746066745.183557:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:32619:x1830882982880640:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:3.0:1746066745.183558:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3801 00000100:00100000:3.0:1746066745.183562:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982880256:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066745.183593:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.183603:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c15a00/0xf1867c21abfa4d0d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0067 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.183616:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066745.183619:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.183645:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:32619:x1830882982880640:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 89us (184us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746066745.183651:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16140 00000100:00100000:0.0:1746066745.183719:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3802 00000100:00100000:0.0:1746066745.183725:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982880384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.183787:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982880384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 61us (358us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066745.183792:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3802 00002000:00100000:0.0:1746066745.183797:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff8800945d5f80 x1830882982880384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.183803:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5f80 with x1830882982880384 ext(5029888->5033983) 00002000:00010000:0.0:1746066745.183806:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5f80 00000100:00100000:0.0:1746066745.186143:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.191174:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982880256:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7596us (7762us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.191185:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3801 00002000:00100000:3.0:1746066745.191197:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012de5ed80 x1830882982880256/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.191206:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ed80 with x1830882982880256 ext(3145728->4194303) 00002000:00010000:3.0:1746066745.191213:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ed80 00000100:00100000:0.0:1746066745.195870:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.201212:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.208185:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.208380:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982881536 00000100:00100000:3.0:1746066745.208390:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982881536 00002000:00100000:3.0:1746066745.208438:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88009d9b1180 x1830882982881536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.208447:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1180 with x1830882982881536 ext(3145728->4194303) 00002000:00010000:3.0:1746066745.208452:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1180 00000100:00100000:3.0:1746066745.208488:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3803 00000100:00100000:3.0:1746066745.208496:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882982881536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066745.218649:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.218802:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982881792 00000100:00100000:3.0:1746066745.218812:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982881792 00000100:00100000:3.0:1746066745.218874:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16141 00000100:00100000:3.0:1746066745.218900:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:32624:x1830882982881792:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066745.218930:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.218950:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa52f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03e7 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.219058:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.219074:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066745.219085:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066745.219094:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066745.219201:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa52f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 47 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.219218:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 46 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.219225:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066745.219228:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066745.219231:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017400, rc 0) 00000100:00100000:3.0:1746066745.219250:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:32624:x1830882982881792:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 369us (613us total) trans 8589936445 rc 0/0 00000100:00100000:3.0:1746066745.219256:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16141 00000100:00100000:1.0:1746066745.228030:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.228064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.228093:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.228134:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.229347:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982881920 00000100:00100000:0.0:1746066745.229360:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982881920 00000100:00100000:0.0:1746066745.229414:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982882048 00000100:00100000:0.0:1746066745.229418:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982882048 00000100:00100000:0.0:1746066745.229436:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982882176 00000100:00100000:0.0:1746066745.229439:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982882176 00000100:00100000:0.0:1746066745.229453:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982882304 00000100:00100000:0.0:1746066745.229456:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982882304 00000100:00100000:0.0:1746066745.229478:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15083 00000100:00100000:0.0:1746066745.229488:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882982881920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.229513:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.229534:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03ee expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.229563:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.229566:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.229578:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.229595:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.229613:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3400, rc 0) 00000100:00100000:0.0:1746066745.229673:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982881920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 185us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.229679:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15083 00000100:00100000:0.0:1746066745.229721:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15084 00000100:00100000:0.0:1746066745.229728:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982882048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.229738:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.229749:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03f5 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.229764:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.229766:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.229772:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.229782:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.229791:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3e00, rc 0) 00000100:00100000:0.0:1746066745.229814:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882982882048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 86us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.229820:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15084 00000100:00100000:0.0:1746066745.229833:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15085 00000100:00100000:0.0:1746066745.229839:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882982882176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.229849:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.229856:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d03fc expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.229868:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.229869:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.229874:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.229934:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 22 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.229943:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3c00, rc 0) 00000100:00100000:0.0:1746066745.229966:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882982882176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 127us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.229971:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15085 00000100:00100000:0.0:1746066745.229984:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15086 00000100:00100000:0.0:1746066745.229990:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882982882304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.229997:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.230006:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0403 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.230016:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.230018:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.230022:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.230031:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 28 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066745.230040:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3000, rc 0) 00000100:00100000:0.0:1746066745.230061:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882982882304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 71us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.230066:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15086 00000100:00100000:0.0:1746066745.236079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.274120:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.274355:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982882688 00000100:00100000:1.0:1746066745.274365:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982882688 00000100:00100000:1.0:1746066745.275638:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15087 00000100:00100000:1.0:1746066745.275648:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:32624:x1830882982882688:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066745.275726:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066745.275746:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d040a expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.275778:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.275786:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfa52e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d9 expref: 38 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.275792:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.275793:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.275796:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2252800->2883583] (req 2252800->2883583) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.275824:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfa52e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d9 expref: 38 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.275835:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecf400/0xf1867c21abfa52e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d9 expref: 38 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.275845:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984306560:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.276850:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.276860:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 27 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.276870:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984306688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.276927:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.278257:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984306560:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.278267:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984306688:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.278292:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2252800->2883583] (req 2252800->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.278309:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575a200, rc 0) 00000100:00100000:1.0:1746066745.278341:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:32624:x1830882982882688:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2695us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.278349:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15087 00000100:00100000:0.0:1746066745.284973:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.285026:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.285368:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982882944 00000100:00100000:3.0:1746066745.285379:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982882944 00010000:00010000:3.0:1746066745.285417:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 28 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.285457:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6714 00000100:00100000:3.0:1746066745.285461:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982882944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.285475:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.285495:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 28 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.285515:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 28 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.285805:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa52a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a1 expref: 28 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.285848:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.285850:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.285857:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.285947:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.286074:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.286086:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984306816:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066745.286150:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.288567:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984306816:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066745.288588:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.288639:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882982882944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3175us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.288648:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6714 00000100:00100000:0.0:1746066745.288739:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.296867:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.314862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.315719:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982883584 00000100:00100000:1.0:1746066745.315729:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982883584 00000100:00100000:3.0:1746066745.316356:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15088 00000100:00100000:3.0:1746066745.316368:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+22:32621:x1830882982883584:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066745.316393:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.316414:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0411 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.316448:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfa52cb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03cb expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.316456:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa52ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e0 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.316461:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.316463:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.316466:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3444736->4194303] (req 3444736->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 23 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.316500:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa52ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e0 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.316511:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa52ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e0 expref: 23 pid: 9590 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.316522:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984306944:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.316670:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfa52cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03cb expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.316678:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfa52cb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03cb expref: 36 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.316696:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984307072:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.316761:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.319133:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984306944:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.319150:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984307072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.319180:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3444736->4194303] (req 3444736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 23 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.319226:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017e00, rc 0) 00000100:00100000:3.0:1746066745.319654:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+23:32621:x1830882982883584:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3287us (4801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.319663:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15088 00000100:00100000:0.0:1746066745.320470:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.321865:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066745.322004:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1e00/0xf1867c21abfa52cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03cb expref: 37 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:2.0:1746066745.322014:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.322016:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.322021:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.322029:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.322059:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.322267:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984307200:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066745.322843:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.327605:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.327818:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982884096 00000100:00100000:2.0:1746066745.327828:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982884096 00002000:00100000:2.0:1746066745.327877:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880135d62a00 x1830882982884096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.327918:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62a00 with x1830882982884096 ext(0->1048575) 00002000:00010000:2.0:1746066745.327923:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d62a00 00000100:00100000:2.0:1746066745.328004:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3807 00000100:00100000:2.0:1746066745.328013:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882982884096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066745.328709:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.328720:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984307200:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066745.328743:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066745.329031:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982883840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7055us (7165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.329262:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982884352 00000100:00100000:1.0:1746066745.329267:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982884352 00002000:00100000:1.0:1746066745.329293:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095dd6300 x1830882982884352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.329301:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6300 with x1830882982884352 ext(1048576->2097151) 00002000:00010000:1.0:1746066745.329304:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6300 00000100:00100000:1.0:1746066745.329320:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3808 00000100:00100000:1.0:1746066745.329324:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882982884352:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.330284:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6716 00000100:00100000:0.0:1746066745.331536:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.331569:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.331584:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982884608 00000100:00100000:0.0:1746066745.331584:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982884864 00000100:00100000:3.0:1746066745.331590:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982884608 00000100:00100000:0.0:1746066745.331590:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982884864 00002000:00100000:3.0:1746066745.331623:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012b165880 x1830882982884608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.331623:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880135d60000 x1830882982884864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.331633:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882982884608 ext(1048576->2097151) 00002000:00100000:0.0:1746066745.331633:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d60000 with x1830882982884864 ext(1048576->2097151) 00002000:00010000:3.0:1746066745.331638:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b165880 00002000:00010000:0.0:1746066745.331638:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d60000 00000100:00100000:3.0:1746066745.331653:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3809 00000100:00100000:3.0:1746066745.331659:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982884608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.331663:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3810 00000100:00100000:0.0:1746066745.331667:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982884864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.336115:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.336209:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982884992 00000100:00100000:2.0:1746066745.336221:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982884992 00000100:00100000:3.0:1746066745.338258:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982884096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10237us (10654us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.338271:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3807 00002000:00100000:3.0:1746066745.338283:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880135d62a00 x1830882982884096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.338292:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62a00 with x1830882982884096 ext(0->1048575) 00002000:00010000:3.0:1746066745.338345:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d62a00 00000100:00100000:2.0:1746066745.338361:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15089 00000100:00100000:2.0:1746066745.338373:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+27:32621:x1830882982884992:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066745.338389:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066745.338407:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0418 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.338436:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.338443:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066745.338445:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066745.338448:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4194304->4362239] (req 4194304->4362239) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.338476:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.338486:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 38 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.338497:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984307328:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066745.338561:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.340319:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982884352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10985us (11602us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066745.340328:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3808 00002000:00100000:1.0:1746066745.340339:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095dd6300 x1830882982884352/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.340346:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6300 with x1830882982884352 ext(1048576->2097151) 00002000:00010000:1.0:1746066745.340352:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6300 00000100:00100000:0.0:1746066745.343270:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.343389:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984307328:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066745.343421:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4194304->4362239] (req 4194304->4362239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 28 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.343439:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c200, rc 0) 00000100:00100000:2.0:1746066745.343488:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+28:32621:x1830882982884992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5117us (8039us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.343498:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15089 00000100:00100000:1.0:1746066745.343721:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982885120 00000100:00100000:1.0:1746066745.343729:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982885120 00002000:00100000:1.0:1746066745.343771:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2252800->2883583) req@ffff88012b164a80 x1830882982885120/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.343780:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164a80 with x1830882982885120 ext(2252800->2883583) 00010000:00010000:1.0:1746066745.343787:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 39 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.343799:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 39 pid: 9591 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746066745.343806:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b164a80 00000100:00100000:1.0:1746066745.343839:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 806 00000100:00100000:1.0:1746066745.343847:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982885120:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066745.346837:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982884864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15156us (15293us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066745.346848:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3810 00002000:00100000:2.0:1746066745.346860:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880135d60000 x1830882982884864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.346869:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d60000 with x1830882982884864 ext(1048576->2097151) 00002000:00010000:2.0:1746066745.346875:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d60000 00000100:00100000:3.0:1746066745.350848:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882982884608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19176us (19271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.350861:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3809 00002000:00100000:3.0:1746066745.350874:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012b165880 x1830882982884608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.350914:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882982884608 ext(1048576->2097151) 00002000:00010000:3.0:1746066745.350921:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b165880 00000100:00100000:1.0:1746066745.361191:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982885120:12345-192.168.204.16@tcp:4:cat.0 Request processed in 17332us (17919us total) trans 21474841693 rc 0/0 00000100:00100000:1.0:1746066745.361205:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 806 00002000:00100000:1.0:1746066745.361220:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2252800->2883583) req@ffff88012b164a80 x1830882982885120/t21474841693(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.361228:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164a80 with x1830882982885120 ext(2252800->2883583) 00010000:00010000:1.0:1746066745.361238:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 39 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.361255:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 39 pid: 9591 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746066745.361262:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b164a80 00000100:00100000:2.0:1746066745.364146:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.364305:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.364544:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982885376 00000100:00100000:3.0:1746066745.364554:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982885376 00000100:00100000:3.0:1746066745.364599:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15090 00000100:00100000:3.0:1746066745.364608:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982885376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.364627:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.364644:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017200/0xf1867c21abfa533b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d041f expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.364673:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.364699:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982885504 00000100:00100000:0.0:1746066745.364701:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982885504 00000100:00100000:3.0:1746066745.364710:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984307456:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066745.364733:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15091 00000100:00100000:0.0:1746066745.364739:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982885504:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066745.364746:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066745.364755:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfa5342 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0426 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.364781:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984307584:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066745.365067:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.365085:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.365278:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982885248 00000100:00100000:1.0:1746066745.365282:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982885248 00010000:00010000:1.0:1746066745.365301:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 41 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.365330:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6717 00000100:00100000:1.0:1746066745.365336:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982885248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.365346:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.365365:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 41 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.365378:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 41 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.365398:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.365400:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.365406:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 27 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.365415:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 27 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.365439:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 27 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.365448:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984307712:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066745.366247:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066745.367772:0:13363:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff88008e331f80 x1830882984307456) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 41 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.367809:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa5326 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2252800->2883583) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d040a expref: 41 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.367827:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984307456:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066745.367865:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017200/0xf1867c21abfa533b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d041f expref: 40 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.367877:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017200/0xf1867c21abfa533b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d041f expref: 40 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.367907:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017200, rc 0) 00002000:00010000:1.0:1746066745.367940:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066745 -> 1746066746 00000100:00100000:3.0:1746066745.367951:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982885376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3344us (3645us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066745.367953:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984307584:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066745.367960:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15090 00010000:00010000:1.0:1746066745.367971:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfa5342 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0426 expref: 37 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.367981:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3200/0xf1867c21abfa5342 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0426 expref: 37 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.367994:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3200, rc 0) 00000100:00100000:1.0:1746066745.368014:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882982885504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3275us (3340us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066745.368020:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15091 00000100:00100000:1.0:1746066745.368573:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984307712:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066745.368585:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.368616:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882982885248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3279us (4481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.368627:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6717 00000100:00100000:0.0:1746066745.370146:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.370234:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982885760 00000100:00100000:1.0:1746066745.370241:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982885760 00002000:00100000:1.0:1746066745.370280:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4358144->4362239) req@ffff88012b167480 x1830882982885760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.370290:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167480 with x1830882982885760 ext(4358144->4362239) 00002000:00010000:1.0:1746066745.370295:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b167480 00000100:00100000:1.0:1746066745.370325:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3811 00000100:00100000:1.0:1746066745.370332:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982885760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066745.370472:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982885760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 139us (329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066745.370478:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3811 00002000:00100000:1.0:1746066745.370484:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4358144->4362239) req@ffff88012b167480 x1830882982885760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.370490:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b167480 with x1830882982885760 ext(4358144->4362239) 00002000:00010000:1.0:1746066745.370493:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b167480 00000100:00100000:0.0:1746066745.370630:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.370700:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982885888 00000100:00100000:1.0:1746066745.370704:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982885888 00000100:00100000:1.0:1746066745.370736:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15092 00000100:00100000:1.0:1746066745.370741:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:32630:x1830882982885888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.370750:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066745.370766:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d042d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.370799:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 27 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.370807:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066745.370808:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066745.370812:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 39 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.371046:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 27 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.371058:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 27 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.371071:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984307840:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.371763:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.373623:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984307840:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.373655:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 39 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.373672:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575be00, rc 0) 00000100:00100000:1.0:1746066745.374661:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:32630:x1830882982885888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3914us (4027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.374670:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15092 00000100:00100000:0.0:1746066745.374773:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.374815:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982886144 00000100:00100000:3.0:1746066745.374822:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982886144 00002000:00100000:3.0:1746066745.374864:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4362239) req@ffff88012b166680 x1830882982886144/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.374872:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b166680 with x1830882982886144 ext(4194304->4362239) 00010000:00010000:3.0:1746066745.374899:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 28 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.374912:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 28 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.374924:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b166680 00000100:00100000:3.0:1746066745.374943:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 807 00000100:00100000:3.0:1746066745.374950:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882982886144:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066745.377799:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.378525:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982886272 00000100:00100000:1.0:1746066745.378535:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982886272 00000100:00100000:1.0:1746066745.378583:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15093 00000100:00100000:1.0:1746066745.378591:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982886272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.378609:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066745.378626:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575b000/0xf1867c21abfa5350 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0434 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.378680:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984307968:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066745.378762:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.378797:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982886144:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3846us (4023us total) trans 21474841694 rc 0/0 00000100:00100000:2.0:1746066745.378805:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 807 00002000:00100000:2.0:1746066745.378813:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4362239) req@ffff88012b166680 x1830882982886144/t21474841694(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.378822:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b166680 with x1830882982886144 ext(4194304->4362239) 00010000:00010000:2.0:1746066745.378829:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 32 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.378840:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 32 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:2.0:1746066745.378846:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b166680 00000100:00100000:2.0:1746066745.382874:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.382964:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982886400 00000100:00100000:0.0:1746066745.382972:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982886400 00010000:00010000:0.0:1746066745.383010:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 32 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.383038:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6718 00000100:00100000:0.0:1746066745.383045:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882982886400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066745.383060:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066745.383079:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 32 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.383089:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 32 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.383113:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.383115:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.383122:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.383130:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.383147:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155c200/0xf1867c21abfa5334 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4362239) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0418 expref: 32 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.383158:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066745.383169:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984308096:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066745.383227:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066745.383389:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984307968:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066745.383415:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575b000/0xf1867c21abfa5350 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0434 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.383426:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575b000/0xf1867c21abfa5350 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0434 expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066745.383433:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b000, rc 0) 00000100:00100000:1.0:1746066745.383538:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982886272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4947us (5749us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066745.383545:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15093 00000100:00100000:2.0:1746066745.386420:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984308096:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066745.386440:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066745.386491:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882982886400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3445us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.386501:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6718 00000100:00100000:0.0:1746066745.387192:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.387310:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982886656 00000100:00100000:2.0:1746066745.387317:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982886656 00002000:00100000:2.0:1746066745.387356:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012b165180 x1830882982886656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.387365:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165180 with x1830882982886656 ext(2097152->3145727) 00002000:00010000:2.0:1746066745.387370:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165180 00000100:00100000:2.0:1746066745.387397:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3812 00000100:00100000:2.0:1746066745.387404:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982886656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.394111:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.394150:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.394205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.394233:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982887040 00000100:00100000:0.0:1746066745.394234:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.394243:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982887040 00002000:00100000:2.0:1746066745.394289:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098925c00 x1830882982887040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.394304:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925c00 with x1830882982887040 ext(0->1048575) 00002000:00010000:2.0:1746066745.394309:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925c00 00000100:00100000:2.0:1746066745.394325:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982887296 00000100:00100000:3.0:1746066745.394326:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982887424 00000100:00100000:2.0:1746066745.394327:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982887296 00000100:00100000:3.0:1746066745.394329:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982887424 00002000:00100000:2.0:1746066745.394340:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800967a8000 x1830882982887296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.394342:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800967abb80 x1830882982887424/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.394347:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882982887296 ext(1048576->2097151) 00002000:00100000:3.0:1746066745.394349:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882982887424 ext(1048576->2097151) 00002000:00010000:2.0:1746066745.394351:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8000 00002000:00010000:3.0:1746066745.394352:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967abb80 00000100:00100000:2.0:1746066745.394358:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982887680 00000100:00100000:2.0:1746066745.394364:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982887680 00002000:00100000:2.0:1746066745.394374:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a8700 x1830882982887680/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.394380:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8700 with x1830882982887680 ext(1048576->2097151) 00002000:00010000:2.0:1746066745.394385:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8700 00000100:00100000:3.0:1746066745.394432:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3813 00000100:00100000:3.0:1746066745.394438:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982887040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.394522:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3814 00000100:00100000:0.0:1746066745.394528:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882982887296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066745.394610:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3815 00000100:00100000:2.0:1746066745.394615:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882982887424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.395285:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3816 00000100:00100000:0.0:1746066745.395291:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982887680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066745.395392:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982886656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7989us (8202us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066745.395398:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3812 00002000:00100000:2.0:1746066745.395404:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012b165180 x1830882982886656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.395411:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165180 with x1830882982886656 ext(2097152->3145727) 00002000:00010000:2.0:1746066745.395416:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165180 00000100:00100000:0.0:1746066745.405314:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.406359:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982887808 00000100:00100000:1.0:1746066745.406370:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982887808 00000100:00100000:1.0:1746066745.406609:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15094 00000100:00100000:1.0:1746066745.406618:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:32630:x1830882982887808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.406639:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066745.406656:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d043b expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.406695:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.406702:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066745.406704:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066745.406707:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.406738:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.406749:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 25 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.406760:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984308224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.407182:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.412192:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982887296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17652us (18029us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066745.412205:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3814 00002000:00100000:2.0:1746066745.412217:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800967a8000 x1830882982887296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.412226:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882982887296 ext(1048576->2097151) 00002000:00010000:2.0:1746066745.412232:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:2.0:1746066745.412308:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982887424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17692us (18103us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066745.412315:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3815 00002000:00100000:2.0:1746066745.412320:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800967abb80 x1830882982887424/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.412326:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882982887424 ext(1048576->2097151) 00002000:00010000:2.0:1746066745.412329:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967abb80 00000100:00100000:1.0:1746066745.412620:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984308224:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.412652:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 37 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.412669:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57000, rc 0) 00000100:00100000:1.0:1746066745.412714:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:32630:x1830882982887808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6097us (7410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.412721:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15094 00000100:00100000:1.0:1746066745.413398:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.414032:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982887936 00000100:00100000:2.0:1746066745.414040:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982887936 00002000:00100000:2.0:1746066745.414076:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3444736->4194303) req@ffff88009d8c8700 x1830882982887936/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.414084:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8700 with x1830882982887936 ext(3444736->4194303) 00010000:00010000:2.0:1746066745.414091:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 22 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.414103:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 22 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:2.0:1746066745.414110:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d8c8700 00000100:00100000:2.0:1746066745.414124:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 808 00000100:00100000:2.0:1746066745.414130:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882982887936:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066745.414300:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982887040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19860us (20198us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.414307:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3813 00002000:00100000:3.0:1746066745.414313:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098925c00 x1830882982887040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.414320:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098925c00 with x1830882982887040 ext(0->1048575) 00002000:00010000:3.0:1746066745.414323:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098925c00 00000100:00100000:1.0:1746066745.417338:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982887680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22035us (23091us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066745.417351:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3816 00002000:00100000:1.0:1746066745.417363:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a8700 x1830882982887680/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.417373:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8700 with x1830882982887680 ext(1048576->2097151) 00002000:00010000:1.0:1746066745.417379:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8700 00000100:00100000:2.0:1746066745.424872:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982887936:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10725us (11459us total) trans 17179874264 rc 0/0 00000100:00100000:2.0:1746066745.424976:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 808 00002000:00100000:2.0:1746066745.425437:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3444736->4194303) req@ffff88009d8c8700 x1830882982887936/t17179874264(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.425455:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8700 with x1830882982887936 ext(3444736->4194303) 00010000:00010000:2.0:1746066745.426712:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 24 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.426729:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 24 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:2.0:1746066745.426737:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d8c8700 00000100:00100000:0.0:1746066745.428471:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.428832:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982888064 00000100:00100000:1.0:1746066745.428842:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982888064 00000100:00100000:0.0:1746066745.428855:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.428920:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15095 00000100:00100000:1.0:1746066745.428929:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:32633:x1830882982888064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.428951:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066745.428969:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0442 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.428995:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.428996:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.429005:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 30 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.429020:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 30 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.429030:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589aa00, rc 0) 00000100:00100000:1.0:1746066745.429091:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:32633:x1830882982888064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 163us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.429097:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15095 00000100:00100000:2.0:1746066745.433467:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982888192 00000100:00100000:2.0:1746066745.433486:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982888192 00010000:00010000:2.0:1746066745.433531:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 24 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.433563:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6719 00000100:00100000:2.0:1746066745.433570:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882982888192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066745.433585:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066745.433605:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 24 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.433617:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 24 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.433640:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa532d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0411 expref: 24 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.433671:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.433674:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.433682:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.433703:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.433738:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 36 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.433750:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984308352:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066745.433833:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.433847:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.434044:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982888448 00000100:00100000:2.0:1746066745.434048:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982888448 00002000:00100000:2.0:1746066745.434079:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800967ab480 x1830882982888448/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.434088:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab480 with x1830882982888448 ext(2097152->3145727) 00002000:00010000:2.0:1746066745.434093:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967ab480 00000100:00100000:2.0:1746066745.434107:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3817 00000100:00100000:2.0:1746066745.434530:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982888448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066745.437343:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984308352:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066745.437368:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066745.437419:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882982888192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3847us (8561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.437429:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6719 00000100:00100000:0.0:1746066745.443693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.443732:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.444652:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982888832 00000100:00100000:2.0:1746066745.444667:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982888832 00002000:00100000:2.0:1746066745.444721:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967aaa00 x1830882982888832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.444732:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882982888832 ext(3145728->4194303) 00002000:00010000:2.0:1746066745.444738:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aaa00 00000100:00100000:2.0:1746066745.444755:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982888960 00000100:00100000:2.0:1746066745.444757:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982888960 00002000:00100000:2.0:1746066745.444768:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800967a8a80 x1830882982888960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.444775:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882982888960 ext(2097152->4194303) 00002000:00010000:2.0:1746066745.444778:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8a80 00000100:00100000:2.0:1746066745.445675:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3818 00000100:00100000:2.0:1746066745.445683:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982888832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.446596:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982888448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12065us (12747us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066745.446604:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3817 00002000:00100000:0.0:1746066745.446612:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800967ab480 x1830882982888448/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.446620:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab480 with x1830882982888448 ext(2097152->3145727) 00002000:00010000:0.0:1746066745.446625:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967ab480 00000100:00100000:0.0:1746066745.446641:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3819 00000100:00100000:0.0:1746066745.446648:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982888960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.453067:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.453140:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982889088 00000100:00100000:1.0:1746066745.453150:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982889088 00000100:00100000:1.0:1746066745.453210:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15096 00000100:00100000:1.0:1746066745.453219:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:32633:x1830882982889088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.453239:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066745.453258:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0449 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.453285:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.453287:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.453295:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.453309:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.453320:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cdc00, rc 0) 00000100:00100000:1.0:1746066745.453381:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+24:32633:x1830882982889088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 162us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.453387:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15096 00000100:00100000:3.0:1746066745.460929:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982888832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15233us (17243us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.460941:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3818 00002000:00100000:3.0:1746066745.460953:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967aaa00 x1830882982888832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.460963:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882982888832 ext(3145728->4194303) 00002000:00010000:3.0:1746066745.460969:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aaa00 00000100:00100000:0.0:1746066745.466583:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.467951:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982889472 00000100:00100000:3.0:1746066745.467961:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982889472 00002000:00100000:3.0:1746066745.468010:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800967ab100 x1830882982889472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.468021:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab100 with x1830882982889472 ext(2097152->4194303) 00002000:00010000:3.0:1746066745.468027:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967ab100 00000100:00100000:3.0:1746066745.468484:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3820 00000100:00100000:3.0:1746066745.468492:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982889472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.469733:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982888960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23081us (25995us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066745.469740:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3819 00002000:00100000:0.0:1746066745.469748:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800967a8a80 x1830882982888960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.469762:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882982888960 ext(2097152->4194303) 00002000:00010000:0.0:1746066745.469767:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8a80 00000100:00100000:0.0:1746066745.469818:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.469835:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982889600 00000100:00100000:0.0:1746066745.469839:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982889600 00002000:00100000:0.0:1746066745.469859:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967a9180 x1830882982889600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.469866:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9180 with x1830882982889600 ext(3145728->4194303) 00002000:00010000:0.0:1746066745.469869:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a9180 00000100:00100000:0.0:1746066745.470058:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3821 00000100:00100000:0.0:1746066745.470064:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982889600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066745.479637:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982889600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9559us (9805us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066745.479651:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3821 00002000:00100000:2.0:1746066745.479665:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967a9180 x1830882982889600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.479675:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9180 with x1830882982889600 ext(3145728->4194303) 00002000:00010000:2.0:1746066745.479682:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a9180 00010000:00010000:1.0:1746066745.482841:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066745.484009:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882982889472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15509us (17427us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066745.484021:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3820 00002000:00100000:3.0:1746066745.484032:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800967ab100 x1830882982889472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.484042:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab100 with x1830882982889472 ext(2097152->4194303) 00002000:00010000:3.0:1746066745.484049:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967ab100 00000100:00100000:0.0:1746066745.485326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.485371:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982889856 00000100:00100000:3.0:1746066745.485380:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982889856 00002000:00100000:3.0:1746066745.485429:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800967a8e00 x1830882982889856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.485438:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882982889856 ext(4194304->5033983) 00002000:00010000:3.0:1746066745.485443:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8e00 00000100:00100000:3.0:1746066745.485472:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3822 00000100:00100000:3.0:1746066745.485480:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982889856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.492784:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.492851:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982890112 00000100:00100000:2.0:1746066745.492859:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982890112 00002000:00100000:2.0:1746066745.492920:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800967aad80 x1830882982890112/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.492930:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882982890112 ext(4194304->5033983) 00002000:00010000:2.0:1746066745.492936:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:2.0:1746066745.492971:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3823 00000100:00100000:2.0:1746066745.492979:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982890112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066745.493347:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982889856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7866us (8024us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066745.493355:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3822 00002000:00100000:3.0:1746066745.493362:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800967a8e00 x1830882982889856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.493370:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882982889856 ext(4194304->5033983) 00002000:00010000:3.0:1746066745.493373:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8e00 00000100:00100000:2.0:1746066745.498712:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982890112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5722us (5925us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066745.498726:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3823 00002000:00100000:2.0:1746066745.498738:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800967aad80 x1830882982890112/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.498747:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882982890112 ext(4194304->5033983) 00002000:00010000:2.0:1746066745.498755:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:0.0:1746066745.622149:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.622260:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982890240 00000100:00100000:3.0:1746066745.622270:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982890240 00000100:00100000:3.0:1746066745.622333:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15097 00000100:00100000:3.0:1746066745.622342:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+39:32638:x1830882982890240:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066745.622362:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.622378:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0450 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.622409:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 40 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.622417:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.622423:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.622425:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.622428:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 40 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.622460:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.622472:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 29 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.622484:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984308480:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.622926:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 40 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.622934:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 40 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:3.0:1746066745.622943:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984308608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.622977:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.626954:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984308480:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.626967:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984308608:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.626998:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 40 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.627016:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0da00, rc 0) 00000100:00100000:3.0:1746066745.628103:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+40:32638:x1830882982890240:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5756us (5959us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.628117:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15097 00000100:00100000:0.0:1746066745.628187:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.628329:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.628351:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982890368 00000100:00100000:0.0:1746066745.628357:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982890368 00010000:00010000:0.0:1746066745.628388:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 40 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.628411:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982890496 00000100:00100000:0.0:1746066745.628413:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982890496 00010000:00010000:0.0:1746066745.628423:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 30 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:1.0:1746066745.628425:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6720 00000100:00100000:1.0:1746066745.628436:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882982890368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.628451:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066745.628457:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6721 00000100:00100000:0.0:1746066745.628463:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982890496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066745.628471:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.628474:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 40 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746066745.628479:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 30 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.628485:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 40 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746066745.628500:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 30 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:1.0:1746066745.628521:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa52c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03bd expref: 40 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746066745.628526:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa531f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0403 expref: 30 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:0.0:1746066745.628542:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.628544:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066745.628550:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 39 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066745.628559:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 39 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.628567:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.628597:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982890368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 163us (411us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066745.628602:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 39 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.628603:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6720 00000100:00100000:0.0:1746066745.628615:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984308736:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066745.628665:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.628796:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.628831:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982890624 00000100:00100000:3.0:1746066745.628835:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982890624 00000100:00100000:3.0:1746066745.628863:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15098 00000100:00100000:3.0:1746066745.628868:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982890624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.628896:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.628906:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa5373 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0457 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.628932:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984308864:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066745.628975:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.629650:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.629827:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982890752 00000100:00100000:1.0:1746066745.629831:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982890752 00000100:00100000:2.0:1746066745.629936:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15099 00000100:00100000:2.0:1746066745.629943:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:32646:x1830882982890752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066745.629951:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066745.629959:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d045e expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.629975:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 40 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.629981:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066745.629982:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066745.629985:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 40 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.630002:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 40 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.630017:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 40 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.630026:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984308992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066745.630216:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00002000:00010000:3.0:1746066745.630615:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066745 -> 1746066746 00000100:00100000:3.0:1746066745.630627:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984308864:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066745.630646:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa5373 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0457 expref: 31 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.630656:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa5373 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0457 expref: 31 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.630679:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecea00, rc 0) 00000100:00100000:0.0:1746066745.630701:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984308736:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066745.630712:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.630723:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982890624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1853us (1926us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066745.630728:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15098 00000100:00100000:0.0:1746066745.630728:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982890496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2265us (2400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.630735:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6721 00000100:00100000:0.0:1746066745.630772:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.631156:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982891008 00000100:00100000:3.0:1746066745.631161:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982891008 00002000:00100000:3.0:1746066745.631275:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1916928->1921023) req@ffff88012c8b8000 x1830882982891008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.631438:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8000 with x1830882982891008 ext(1916928->1921023) 00010000:00010000:3.0:1746066745.631446:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 41 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.631457:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 41 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.631463:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8b8000 00000100:00100000:3.0:1746066745.631478:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 809 00000100:00100000:3.0:1746066745.631484:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982891008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066745.632007:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984308992:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066745.632024:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.632035:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155dc00, rc 0) 00000100:00100000:1.0:1746066745.632055:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:32646:x1830882982890752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2113us (2406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.632060:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15099 00000100:00100000:3.0:1746066745.632626:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882982891008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1140us (1851us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066745.632632:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 809 00002000:00100000:3.0:1746066745.632638:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1916928->1921023) req@ffff88012c8b8000 x1830882982891008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.632645:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8000 with x1830882982891008 ext(1916928->1921023) 00010000:00010000:3.0:1746066745.632651:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 40 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.632661:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 40 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.632666:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8b8000 00000100:00100000:0.0:1746066745.637822:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.637867:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.637978:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.638023:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982891392 00000100:00100000:1.0:1746066745.638033:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982891392 00000100:00100000:1.0:1746066745.638093:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982891520 00000100:00100000:1.0:1746066745.638097:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982891520 00000100:00100000:1.0:1746066745.638123:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15100 00000100:00100000:1.0:1746066745.638135:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+29:32645:x1830882982891392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066745.638159:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066745.638179:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0465 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.638210:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066745.638218:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.638231:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.638244:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eba00, rc 0) 00000100:00100000:1.0:1746066745.638306:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:32645:x1830882982891392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 171us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.638313:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15100 00000100:00100000:2.0:1746066745.638465:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15101 00000100:00100000:2.0:1746066745.638471:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:32638:x1830882982891520:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066745.638478:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066745.638485:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d046c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.638499:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 41 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.638505:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.638508:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.638509:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.638510:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->2686975] (req 2097152->2686975) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.638531:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.638542:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 29 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.638550:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984309120:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066745.638599:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 41 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.638604:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 41 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.638609:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984309248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066745.638619:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.638624:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982891264 00000100:00100000:3.0:1746066745.638629:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982891264 00002000:00100000:3.0:1746066745.638656:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1916928->2097151) req@ffff88012c8b8a80 x1830882982891264/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.638664:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8a80 with x1830882982891264 ext(1916928->2097151) 00010000:00010000:3.0:1746066745.638670:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 42 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.638679:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 42 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.638693:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8b8a80 00000100:00100000:3.0:1746066745.638720:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 810 00000100:00100000:3.0:1746066745.638725:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882982891264:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066745.645118:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984309120:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066745.645134:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984309248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066745.645165:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->2686975] (req 2097152->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.645183:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:2.0:1746066745.645231:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:32638:x1830882982891520:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6759us (7252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.645240:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15101 00000100:00100000:2.0:1746066745.645898:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.645949:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.646080:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982891648 00000100:00100000:0.0:1746066745.646138:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982891776 00000100:00100000:0.0:1746066745.646228:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982891776 00010000:00010000:0.0:1746066745.646259:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 43 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:0.0:1746066745.646293:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6722 00000100:00100000:0.0:1746066745.646299:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882982891776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066745.646310:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066745.646329:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 43 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.646339:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 43 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.646361:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5349 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d042d expref: 43 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.646394:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066745.646419:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982891776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066745.646425:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6722 00000100:00100000:1.0:1746066745.646591:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982891648 00010000:00010000:1.0:1746066745.646607:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 30 pid: 9591 timeout: 813 lvb_type: 0 00000100:00100000:1.0:1746066745.646633:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6723 00000100:00100000:1.0:1746066745.646639:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982891648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.646645:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066745.646652:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 30 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.646665:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 30 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.646676:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589aa00/0xf1867c21abfa535e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0442 expref: 30 pid: 9591 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.646702:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.646704:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.646711:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.646718:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.646745:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 41 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066745.646758:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309376:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066745.648012:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.648636:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309376:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066745.648654:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066745.648694:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882982891648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2054us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.648701:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6723 00000100:00100000:3.0:1746066745.649626:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882982891264:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10899us (11814us total) trans 21474841695 rc 0/0 00000100:00100000:3.0:1746066745.649635:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 810 00002000:00100000:3.0:1746066745.649647:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1916928->2097151) req@ffff88012c8b8a80 x1830882982891264/t21474841695(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.649660:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8a80 with x1830882982891264 ext(1916928->2097151) 00010000:00010000:3.0:1746066745.649670:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 42 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.649690:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 42 pid: 13363 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.649700:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8b8a80 00000100:00100000:0.0:1746066745.652081:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.652168:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.652240:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982892032 00000100:00100000:3.0:1746066745.652249:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982892032 00002000:00100000:3.0:1746066745.652292:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2682880->2686975) req@ffff88012c8b9180 x1830882982892032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.652302:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b9180 with x1830882982892032 ext(2682880->2686975) 00002000:00010000:3.0:1746066745.652307:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8b9180 00000100:00100000:3.0:1746066745.652328:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3824 00000100:00100000:3.0:1746066745.652336:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982892032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066745.652405:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982892160 00000100:00100000:2.0:1746066745.652410:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982892160 00010000:00010000:2.0:1746066745.652429:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 43 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.652452:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6724 00000100:00100000:2.0:1746066745.652457:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982892160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066745.652466:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066745.652479:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 43 pid: 13363 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.652491:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 43 pid: 13363 timeout: 813 lvb_type: 0 00000100:00100000:3.0:1746066745.652504:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982892032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 168us (431us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066745.652511:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3824 00010000:00010000:2.0:1746066745.652514:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0da00/0xf1867c21abfa536c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0450 expref: 43 pid: 13363 timeout: 813 lvb_type: 0 00002000:00100000:3.0:1746066745.652516:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2682880->2686975) req@ffff88012c8b9180 x1830882982892032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.652523:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b9180 with x1830882982892032 ext(2682880->2686975) 00002000:00010000:3.0:1746066745.652526:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8b9180 00010000:00010000:2.0:1746066745.652532:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.652535:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.652542:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.652554:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.652563:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.652564:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.652567:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.652574:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.652604:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.652616:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309504:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066745.652679:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.652700:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309632:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066745.652722:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.657469:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309504:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066745.657482:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309632:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066745.657502:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066745.657573:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982892160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5114us (5403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.657585:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6724 00000100:00100000:0.0:1746066745.657738:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.658317:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982892416 00000100:00100000:2.0:1746066745.658324:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982892416 00002000:00100000:2.0:1746066745.658361:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c8b9880 x1830882982892416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.658371:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b9880 with x1830882982892416 ext(1048576->2097151) 00002000:00010000:2.0:1746066745.658376:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8b9880 00000100:00100000:2.0:1746066745.658407:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3825 00000100:00100000:2.0:1746066745.658414:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882982892416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066745.659037:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.659822:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982892672 00000100:00100000:3.0:1746066745.659828:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982892672 00002000:00100000:3.0:1746066745.659854:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d8cb100 x1830882982892672/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.659863:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8cb100 with x1830882982892672 ext(1048576->2097151) 00002000:00010000:3.0:1746066745.659868:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8cb100 00000100:00100000:3.0:1746066745.660078:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3826 00000100:00100000:3.0:1746066745.660086:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982892672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066745.668518:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882982892416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10087us (10764us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066745.668532:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3825 00002000:00100000:2.0:1746066745.668546:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c8b9880 x1830882982892416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.668556:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b9880 with x1830882982892416 ext(1048576->2097151) 00002000:00010000:2.0:1746066745.668563:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8b9880 00000100:00100000:3.0:1746066745.671634:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982892672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11537us (12587us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066745.671645:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3826 00002000:00100000:3.0:1746066745.671656:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d8cb100 x1830882982892672/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.671665:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8cb100 with x1830882982892672 ext(1048576->2097151) 00002000:00010000:3.0:1746066745.671671:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8cb100 00000100:00100000:0.0:1746066745.682365:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.682507:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982892800 00000100:00100000:2.0:1746066745.682517:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982892800 00000100:00100000:2.0:1746066745.682603:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15102 00000100:00100000:2.0:1746066745.682612:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+29:32645:x1830882982892800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066745.682633:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066745.682652:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0473 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.682695:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.682703:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066745.682705:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066745.682709:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.682744:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.682756:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 40 pid: 1893 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.682768:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984309760:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066745.682875:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.687847:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.688163:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982893056 00000100:00100000:3.0:1746066745.688174:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982893056 00002000:00100000:3.0:1746066745.688222:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2686976->4194303) req@ffff88012c8b9f80 x1830882982893056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.688232:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b9f80 with x1830882982893056 ext(2686976->4194303) 00010000:00010000:3.0:1746066745.688241:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 41 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.688255:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 41 pid: 1893 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.688262:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8b9f80 00000100:00100000:3.0:1746066745.688293:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 811 00000100:00100000:3.0:1746066745.688301:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982893056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.689751:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.689966:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982893184 00000100:00100000:0.0:1746066745.689973:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982893184 00002000:00100000:0.0:1746066745.690013:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2686975) req@ffff88012c8ba300 x1830882982893184/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.690023:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8ba300 with x1830882982893184 ext(2097152->2686975) 00010000:00010000:0.0:1746066745.690031:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 43 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:0.0:1746066745.690043:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 43 pid: 1893 timeout: 813 lvb_type: 0 00002000:00010000:0.0:1746066745.690050:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8ba300 00000100:00100000:0.0:1746066745.690073:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 812 00000100:00100000:0.0:1746066745.690082:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982893184:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066745.691063:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984309760:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.691091:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.691109:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097bc9800, rc 0) 00000100:00100000:3.0:1746066745.691141:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:32645:x1830882982892800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8529us (8788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.691149:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15102 00000100:00100000:3.0:1746066745.704833:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982893056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16520us (16985us total) trans 0 rc 1507328/1507328 00000100:00100000:3.0:1746066745.704846:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 811 00002000:00100000:3.0:1746066745.704857:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2686976->4194303) req@ffff88012c8b9f80 x1830882982893056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 1507328/1507328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.704867:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b9f80 with x1830882982893056 ext(2686976->4194303) 00010000:00010000:3.0:1746066745.704878:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 43 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:3.0:1746066745.704911:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 43 pid: 1893 timeout: 813 lvb_type: 0 00002000:00010000:3.0:1746066745.704918:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8b9f80 00000100:00100000:0.0:1746066745.713745:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.713815:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982893312 00000100:00100000:3.0:1746066745.713826:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982893312 00000100:00100000:3.0:1746066745.713918:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15103 00000100:00100000:3.0:1746066745.713927:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:32646:x1830882982893312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.713949:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.713968:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d047a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.714003:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.714006:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.714010:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 46 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.714022:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 46 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.714034:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf000, rc 0) 00000100:00100000:3.0:1746066745.714094:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:32646:x1830882982893312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 168us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.714100:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15103 00000100:00100000:1.0:1746066745.714235:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882982893184:12345-192.168.204.16@tcp:4:cat.0 Request processed in 24151us (24491us total) trans 21474841696 rc 0/0 00000100:00100000:1.0:1746066745.714246:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 812 00002000:00100000:1.0:1746066745.714259:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2686975) req@ffff88012c8ba300 x1830882982893184/t21474841696(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.714274:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8ba300 with x1830882982893184 ext(2097152->2686975) 00010000:00010000:1.0:1746066745.714281:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 44 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:1.0:1746066745.714294:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 44 pid: 1893 timeout: 813 lvb_type: 0 00002000:00010000:1.0:1746066745.714300:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c8ba300 00000100:00100000:0.0:1746066745.719474:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.719557:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982893440 00000100:00100000:2.0:1746066745.719571:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982893440 00010000:00010000:2.0:1746066745.719618:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 44 pid: 1893 timeout: 813 lvb_type: 0 00000100:00100000:2.0:1746066745.720486:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6725 00000100:00100000:2.0:1746066745.720498:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982893440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066745.720519:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066745.720545:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 44 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.720561:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 44 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.720587:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5388 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2686975) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d046c expref: 44 pid: 1893 timeout: 813 lvb_type: 0 00010000:00010000:2.0:1746066745.720614:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.720617:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.720626:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.720635:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.720644:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.720645:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.720649:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.720656:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.720726:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.720742:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309888:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066745.722426:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.722441:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984310016:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066745.722476:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.730203:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984309888:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066745.730215:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984310016:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066745.730236:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066745.730282:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882982893440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9786us (10822us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.730294:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6725 00000100:00100000:0.0:1746066745.733269:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.733369:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982893696 00000100:00100000:1.0:1746066745.733380:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982893696 00002000:00100000:1.0:1746066745.733427:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012c8bad80 x1830882982893696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.733438:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bad80 with x1830882982893696 ext(3145728->4194303) 00002000:00010000:1.0:1746066745.733444:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8bad80 00000100:00100000:1.0:1746066745.733475:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3827 00000100:00100000:1.0:1746066745.733484:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882982893696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.737759:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.738735:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982893952 00000100:00100000:3.0:1746066745.738748:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982893952 00002000:00100000:3.0:1746066745.738804:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012c8bb100 x1830882982893952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.738814:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bb100 with x1830882982893952 ext(2097152->4194303) 00002000:00010000:3.0:1746066745.738820:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8bb100 00000100:00100000:3.0:1746066745.738854:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3828 00000100:00100000:3.0:1746066745.738864:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982893952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066745.750411:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882982893696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16912us (17136us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066745.750426:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3827 00002000:00100000:1.0:1746066745.750442:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012c8bad80 x1830882982893696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.750452:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bad80 with x1830882982893696 ext(3145728->4194303) 00002000:00010000:1.0:1746066745.750459:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8bad80 00000100:00100000:3.0:1746066745.760332:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982893952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21459us (22573us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066745.760344:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3828 00002000:00100000:3.0:1746066745.760354:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012c8bb100 x1830882982893952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.760449:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bb100 with x1830882982893952 ext(2097152->4194303) 00002000:00010000:3.0:1746066745.760456:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8bb100 00000100:00100000:2.0:1746066745.762558:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.763268:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982894208 00000100:00100000:3.0:1746066745.763278:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982894208 00002000:00100000:3.0:1746066745.763326:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800966e2680 x1830882982894208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.763336:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2680 with x1830882982894208 ext(4194304->5033983) 00002000:00010000:3.0:1746066745.763341:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2680 00000100:00100000:3.0:1746066745.764782:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3829 00000100:00100000:3.0:1746066745.764798:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882982894208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066745.774923:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882982894208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10116us (12360us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066745.774936:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3829 00002000:00100000:3.0:1746066745.774949:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800966e2680 x1830882982894208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.774959:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2680 with x1830882982894208 ext(4194304->5033983) 00002000:00010000:3.0:1746066745.774965:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2680 00000100:00100000:0.0:1746066745.781980:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.782078:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982894336 00000100:00100000:2.0:1746066745.782087:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982894336 00000100:00100000:2.0:1746066745.782145:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15104 00000100:00100000:2.0:1746066745.782155:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:32640:x1830882982894336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066745.782178:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066745.782196:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0481 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.782230:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 42 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.782238:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.782248:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.782250:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.782253:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [974848->1048575] (req 974848->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 31 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.782282:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.782294:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 31 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:2.0:1746066745.782307:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984310144:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066745.782396:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 42 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.782404:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 42 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:2.0:1746066745.782412:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984310272:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066745.782429:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.784622:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984310144:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066745.786677:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.786706:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984310272:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066745.786738:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [974848->1048575] (req 974848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 31 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.786760:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5771200, rc 0) 00000100:00100000:2.0:1746066745.786815:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+31:32640:x1830882982894336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4662us (4846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.786823:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15104 00000100:00100000:3.0:1746066745.786959:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982894592 00000100:00100000:3.0:1746066745.786966:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982894592 00002000:00100000:3.0:1746066745.787003:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c8bb800 x1830882982894592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.787012:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bb800 with x1830882982894592 ext(4194304->5033983) 00002000:00010000:3.0:1746066745.787017:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8bb800 00000100:00100000:3.0:1746066745.787043:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3830 00000100:00100000:3.0:1746066745.787356:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982894592:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066745.789226:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.789274:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.789315:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982894720 00000100:00100000:0.0:1746066745.789322:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982894720 00010000:00010000:0.0:1746066745.789353:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 33 pid: 12237 timeout: 813 lvb_type: 1 00000100:00100000:0.0:1746066745.789989:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982894848 00000100:00100000:0.0:1746066745.789992:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982894848 00010000:00010000:0.0:1746066745.790005:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 43 pid: 12233 timeout: 813 lvb_type: 1 00000100:00100000:2.0:1746066745.790043:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6726 00000100:00100000:2.0:1746066745.790052:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882982894720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066745.790065:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066745.790084:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 33 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:2.0:1746066745.790095:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 33 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:2.0:1746066745.790118:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa530a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03ee expref: 33 pid: 12237 timeout: 813 lvb_type: 1 00010000:00010000:2.0:1746066745.790136:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.790213:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6727 00000100:00100000:3.0:1746066745.790220:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982894848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.790228:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.790237:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 43 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.790245:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 43 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.790256:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa52af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03a8 expref: 43 pid: 12233 timeout: 813 lvb_type: 1 00010000:00010000:3.0:1746066745.790270:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.790272:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066745.790273:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882982894720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 221us (1052us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066745.790279:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.790287:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.790318:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.790330:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984310400:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066745.790382:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.790649:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6726 00000100:00100000:3.0:1746066745.795643:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984310400:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066745.795676:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.795752:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882982894848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5531us (6475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.795767:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6727 00000100:00100000:1.0:1746066745.796465:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066745.796721:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982895104 00000100:00100000:0.0:1746066745.796730:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982895104 00002000:00100000:0.0:1746066745.796773:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (974848->978943) req@ffff88009d8c8000 x1830882982895104/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.796784:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8000 with x1830882982895104 ext(974848->978943) 00002000:00010000:0.0:1746066745.796791:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c8000 00000100:00100000:0.0:1746066745.796807:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3831 00000100:00100000:0.0:1746066745.796813:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982895104:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066745.796982:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982895104:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 168us (521us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066745.796992:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3831 00002000:00100000:0.0:1746066745.796996:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (974848->978943) req@ffff88009d8c8000 x1830882982895104/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066745.797002:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8000 with x1830882982895104 ext(974848->978943) 00002000:00010000:0.0:1746066745.797005:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c8000 00000100:00100000:3.0:1746066745.797155:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982894592:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9801us (10487us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066745.797161:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3830 00002000:00100000:3.0:1746066745.797165:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c8bb800 x1830882982894592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 839680/839680 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066745.797172:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bb800 with x1830882982894592 ext(4194304->5033983) 00002000:00010000:3.0:1746066745.797175:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8bb800 00000100:00100000:0.0:1746066745.800250:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.800406:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982895232 00000100:00100000:2.0:1746066745.800417:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982895232 00000100:00100000:2.0:1746066745.800475:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15105 00000100:00100000:2.0:1746066745.800483:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+24:32640:x1830882982895232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066745.800508:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066745.800526:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0488 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.800559:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 36 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.800568:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 25 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.800575:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.800577:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066745.800580:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1982463] (req 1048576->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.800612:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 25 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.800625:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 25 pid: 12237 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066745.800638:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984310528:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066745.803289:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 36 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.803307:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 36 pid: 1893 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066745.803326:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984310656:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066745.804779:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.808980:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984310528:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066745.810263:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.810312:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982895360 00000100:00100000:3.0:1746066745.810319:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982895360 00010000:00010000:3.0:1746066745.810357:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 26 pid: 12237 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066745.810746:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6728 00000100:00100000:3.0:1746066745.810754:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982895360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.810772:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.810793:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 26 pid: 12237 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066745.810804:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 26 pid: 12237 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066745.810831:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa5311 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03f5 expref: 26 pid: 12237 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066745.810861:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066745.810963:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984310656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066745.810991:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->1982463] (req 1048576->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.811001:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5771c00, rc 0) 00000100:00100000:2.0:1746066745.811040:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+25:32640:x1830882982895232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10558us (10802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066745.811047:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15105 00000100:00100000:3.0:1746066745.811600:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982895360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 845us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.811607:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6728 00000100:00100000:0.0:1746066745.811711:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.811832:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982895488 00000100:00100000:3.0:1746066745.811836:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982895488 00010000:00010000:3.0:1746066745.811851:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 37 pid: 1893 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066745.812176:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6729 00000100:00100000:3.0:1746066745.812181:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882982895488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.812191:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.812201:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 37 pid: 1893 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066745.812209:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 37 pid: 1893 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066745.812222:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017c00/0xf1867c21abfa52a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03af expref: 37 pid: 1893 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066745.812232:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.812234:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.812240:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 23 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.812247:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 23 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.812277:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 23 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.812289:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984310784:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066745.812361:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.816012:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984310784:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066745.816038:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.816095:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882982895488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3912us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.816107:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6729 00000100:00100000:0.0:1746066745.821405:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.822748:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982895744 00000100:00100000:1.0:1746066745.822759:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982895744 00002000:00100000:1.0:1746066745.822821:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1978368->1982463) req@ffff88012c8b8380 x1830882982895744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.822833:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8380 with x1830882982895744 ext(1978368->1982463) 00002000:00010000:1.0:1746066745.822839:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8b8380 00000100:00100000:1.0:1746066745.822870:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3832 00000100:00100000:1.0:1746066745.822879:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982895744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066745.824330:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882982895744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1444us (2928us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066745.824340:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3832 00002000:00100000:1.0:1746066745.824348:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1978368->1982463) req@ffff88012c8b8380 x1830882982895744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.824357:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8380 with x1830882982895744 ext(1978368->1982463) 00002000:00010000:1.0:1746066745.824362:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8b8380 00000100:00100000:0.0:1746066745.907796:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.908034:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982895872 00000100:00100000:2.0:1746066745.908044:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982895872 00000100:00100000:2.0:1746066745.908106:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15106 00000100:00100000:2.0:1746066745.908114:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982895872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066745.908136:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066745.908155:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5770c00/0xf1867c21abfa53ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d048f expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.908212:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984310912:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066745.908304:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.908457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.908471:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982896000 00000100:00100000:3.0:1746066745.908475:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982896000 00000100:00100000:3.0:1746066745.908499:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15107 00000100:00100000:3.0:1746066745.908505:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982896000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.908514:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.908525:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa53b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0496 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.908555:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311040:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066745.908600:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00002000:00010000:2.0:1746066745.910065:0:13363:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066744 -> 1746066746 00002000:00010000:2.0:1746066745.910070:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066744 -> 1746066746 00002000:00010000:2.0:1746066745.910072:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746066744 -> 1746066746 00000100:00100000:2.0:1746066745.910090:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984310912:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066745.910114:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5770c00/0xf1867c21abfa53ab lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d048f expref: 43 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.910126:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5770c00/0xf1867c21abfa53ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d048f expref: 43 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066745.910141:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5770c00, rc 0) 00000100:00100000:2.0:1746066745.910529:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982895872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2413us (2741us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066745.910538:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15106 00002000:00010000:3.0:1746066745.910821:0:1893:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066744 -> 1746066746 00002000:00010000:3.0:1746066745.910825:0:1893:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066744 -> 1746066746 00002000:00010000:3.0:1746066745.910826:0:1893:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066744 -> 1746066746 00000100:00100000:3.0:1746066745.910838:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311040:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066745.910855:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa53b2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0496 expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.910865:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa53b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0496 expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.910915:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecec00, rc 0) 00000100:00100000:3.0:1746066745.910941:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982896000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2436us (2484us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066745.910947:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15107 00000100:00100000:0.0:1746066745.914872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.915286:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982896128 00000100:00100000:3.0:1746066745.915299:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982896128 00000100:00100000:3.0:1746066745.915368:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15108 00000100:00100000:3.0:1746066745.915377:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:32656:x1830882982896128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.915398:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.915415:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d049d expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.915446:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 29 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.915453:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.915455:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.915458:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.915489:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 29 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.915502:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 29 pid: 13363 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066745.915515:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984311168:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.915592:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.917374:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.917404:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984311168:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.917431:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 43 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.917435:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982896256 00000100:00100000:2.0:1746066745.917442:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982896256 00010000:00010000:3.0:1746066745.917447:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece600, rc 0) 00002000:00100000:2.0:1746066745.917477:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (974848->1048575) req@ffff8800967a9500 x1830882982896256/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.917487:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9500 with x1830882982896256 ext(974848->1048575) 00010000:00010000:2.0:1746066745.917493:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 30 pid: 13363 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066745.917497:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:32656:x1830882982896128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2120us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.917506:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15108 00010000:00010000:2.0:1746066745.917506:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 30 pid: 13363 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066745.917512:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9500 00000100:00100000:2.0:1746066745.917537:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 813 00000100:00100000:2.0:1746066745.917544:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982896256:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066745.927986:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882982896256:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10429us (10605us total) trans 21474841697 rc 0/0 00000100:00100000:2.0:1746066745.927999:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 813 00002000:00100000:2.0:1746066745.928013:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (974848->1048575) req@ffff8800967a9500 x1830882982896256/t21474841697(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.928023:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9500 with x1830882982896256 ext(974848->1048575) 00010000:00010000:2.0:1746066745.928034:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066745.928052:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066745.928059:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9500 00000100:00100000:0.0:1746066745.934611:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.935311:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982896384 00000100:00100000:3.0:1746066745.935321:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982896384 00010000:00010000:3.0:1746066745.935361:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066745.935402:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6730 00000100:00100000:3.0:1746066745.935410:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982896384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066745.935431:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066745.935453:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066745.935465:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066745.935488:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771200/0xf1867c21abfa539d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 974848->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0481 expref: 32 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066745.935513:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.935515:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.935522:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 42 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.935530:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 42 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.935563:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 42 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066745.935577:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984311296:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066745.935666:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.941369:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984311296:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066745.941393:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066745.941456:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882982896384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6044us (6855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.941471:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6730 00000100:00100000:0.0:1746066745.944370:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.944435:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982896640 00000100:00100000:2.0:1746066745.944445:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982896640 00002000:00100000:2.0:1746066745.944492:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800967a8380 x1830882982896640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.944502:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882982896640 ext(0->1048575) 00002000:00010000:2.0:1746066745.944507:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8380 00000100:00100000:2.0:1746066745.944543:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3833 00000100:00100000:2.0:1746066745.944550:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982896640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066745.947391:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066745.949428:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982896768 00000100:00100000:3.0:1746066745.949440:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982896768 00000100:00100000:3.0:1746066745.949502:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15109 00000100:00100000:3.0:1746066745.949510:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:32653:x1830882982896768:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066745.949530:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.949549:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04a4 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.949579:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.949587:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 23 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.949593:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.949595:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066745.949598:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1400832->1990655] (req 1400832->1990655) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.949631:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 23 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.949643:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 23 pid: 12237 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066745.949654:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311424:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.949771:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066745.949780:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066745.949787:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311552:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.949808:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066745.960140:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982896640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15577us (15765us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066745.960153:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3833 00002000:00100000:2.0:1746066745.960169:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800967a8380 x1830882982896640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/440 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.960178:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882982896640 ext(0->1048575) 00002000:00010000:2.0:1746066745.960185:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8380 00000100:00100000:0.0:1746066745.960616:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.960658:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982896896 00000100:00100000:0.0:1746066745.960660:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.960667:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982896896 00000100:00100000:3.0:1746066745.960750:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311424:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.960761:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311552:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.960789:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1400832->1990655] (req 1400832->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.960807:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece000, rc 0) 00000100:00100000:3.0:1746066745.960833:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:32653:x1830882982896768:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11323us (13451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.960839:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15109 00010000:00010000:2.0:1746066745.960914:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 24 pid: 12237 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066745.960937:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982897024 00000100:00100000:2.0:1746066745.960940:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982897024 00010000:00010000:2.0:1746066745.960950:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066745.960965:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6731 00000100:00100000:2.0:1746066745.960971:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882982896896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066745.960987:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066745.961006:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 24 pid: 12237 timeout: 814 lvb_type: 1 00000100:00100000:1.0:1746066745.961011:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6732 00010000:00010000:2.0:1746066745.961017:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 24 pid: 12237 timeout: 814 lvb_type: 1 00000100:00100000:1.0:1746066745.961019:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882982897024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066745.961028:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066745.961040:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5318 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03fc expref: 24 pid: 12237 timeout: 814 lvb_type: 1 00010000:00010000:1.0:1746066745.961067:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 814 lvb_type: 1 00010000:00010000:1.0:1746066745.961077:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 814 lvb_type: 1 00010000:00010000:1.0:1746066745.961096:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa52b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03b6 expref: 37 pid: 12255 timeout: 814 lvb_type: 1 00010000:00010000:1.0:1746066745.961112:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.961114:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066745.961121:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066745.961130:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066745.961143:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066745.961163:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882982896896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 192us (549us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066745.961165:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066745.961169:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6731 00000100:00100000:1.0:1746066745.961177:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984311680:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066745.961222:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310ddc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066745.973200:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.973272:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982897280 00000100:00100000:2.0:1746066745.973281:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982897280 00000100:00100000:0.0:1746066745.973320:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066745.973329:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1400832->1404927) req@ffff8800a5d82300 x1830882982897280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.973339:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882982897280 ext(1400832->1404927) 00002000:00010000:2.0:1746066745.973346:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:2.0:1746066745.973370:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3834 00000100:00100000:2.0:1746066745.973377:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982897280:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066745.973529:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982897280:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 152us (340us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066745.973535:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3834 00002000:00100000:2.0:1746066745.973541:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1400832->1404927) req@ffff8800a5d82300 x1830882982897280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.973547:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882982897280 ext(1400832->1404927) 00002000:00010000:2.0:1746066745.973550:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:1.0:1746066745.973601:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984311680:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066745.973625:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066745.973659:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882982897024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12642us (12999us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066745.973668:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6732 00000100:00100000:3.0:1746066745.973686:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982897408 00000100:00100000:3.0:1746066745.973690:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982897408 00000100:00100000:3.0:1746066745.973713:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15110 00000100:00100000:3.0:1746066745.973718:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:32656:x1830882982897408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066745.973726:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066745.973743:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04ab expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.973773:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.973780:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.973782:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066745.973785:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.973814:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.973826:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 22 pid: 13363 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066745.973838:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311808:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066745.974602:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066745.983091:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984311808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066745.983126:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066745.983145:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece200, rc 0) 00000100:00100000:3.0:1746066745.983206:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:32656:x1830882982897408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9486us (9884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066745.983215:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15110 00000100:00100000:0.0:1746066745.984979:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066745.986378:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982897536 00000100:00100000:2.0:1746066745.986389:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982897536 00002000:00100000:2.0:1746066745.986446:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1982463) req@ffff88012ce06d80 x1830882982897536/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066745.986457:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06d80 with x1830882982897536 ext(1048576->1982463) 00010000:00010000:2.0:1746066745.986466:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 23 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066745.986488:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 23 pid: 13363 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066745.986496:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ce06d80 00000100:00100000:2.0:1746066745.986528:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 814 00000100:00100000:2.0:1746066745.986536:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882982897536:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066745.990556:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066745.991815:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982897792 00000100:00100000:1.0:1746066745.991828:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982897792 00002000:00100000:1.0:1746066745.991878:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1986560->1990655) req@ffff88012faf1500 x1830882982897792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/0 e 0 to 0 dl 1746066756 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.991914:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1500 with x1830882982897792 ext(1986560->1990655) 00002000:00010000:1.0:1746066745.991920:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1500 00000100:00100000:1.0:1746066745.991943:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3835 00000100:00100000:1.0:1746066745.991952:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982897792:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066745.992116:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882982897792:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 164us (1569us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066745.992123:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3835 00002000:00100000:1.0:1746066745.992129:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1986560->1990655) req@ffff88012faf1500 x1830882982897792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:151/0 lens 488/4536 e 0 to 0 dl 1746066756 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066745.992135:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1500 with x1830882982897792 ext(1986560->1990655) 00002000:00010000:1.0:1746066745.992138:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1500 00000100:00100000:2.0:1746066746.008130:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882982897536:12345-192.168.204.16@tcp:4:cat.0 Request processed in 21582us (23144us total) trans 17179874265 rc 0/0 00000100:00100000:2.0:1746066746.008144:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 814 00002000:00100000:2.0:1746066746.008157:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1982463) req@ffff88012ce06d80 x1830882982897536/t17179874265(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:151/0 lens 488/448 e 0 to 0 dl 1746066756 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.008167:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06d80 with x1830882982897536 ext(1048576->1982463) 00010000:00010000:2.0:1746066746.008177:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.008194:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.008201:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ce06d80 00000100:00100000:0.0:1746066746.012858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.013873:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982897920 00000100:00100000:1.0:1746066746.013915:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982897920 00010000:00010000:1.0:1746066746.013958:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.014000:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6733 00000100:00100000:1.0:1746066746.014011:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882982897920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.014026:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.014045:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.014056:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.014078:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771c00/0xf1867c21abfa53a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0488 expref: 25 pid: 13363 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.014108:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.014110:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.014117:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.014125:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.014155:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.014166:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984311936:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.014263:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310ddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.022225:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8cbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984311936:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.022255:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.022310:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882982897920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8298us (9462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.022322:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6733 00000100:00100000:0.0:1746066746.023295:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.023332:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.023402:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982898176 00000100:00100000:2.0:1746066746.023409:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982898176 00002000:00100000:2.0:1746066746.023450:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf2d80 x1830882982898176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.023461:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2d80 with x1830882982898176 ext(1048576->2097151) 00002000:00010000:2.0:1746066746.023467:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf2d80 00000100:00100000:2.0:1746066746.023492:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982898304 00000100:00100000:2.0:1746066746.023495:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982898304 00002000:00100000:2.0:1746066746.023505:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012faf3800 x1830882982898304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 504/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.023512:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3800 with x1830882982898304 ext(1048576->2097151) 00002000:00010000:2.0:1746066746.023515:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf3800 00000100:00100000:2.0:1746066746.024575:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3836 00000100:00100000:2.0:1746066746.024585:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982898176:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066746.025132:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3837 00000100:00100000:1.0:1746066746.025141:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982898304:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066746.026019:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.026043:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.026065:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.026280:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982898560 00000100:00100000:3.0:1746066746.026288:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982898560 00000100:00100000:3.0:1746066746.026323:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982898816 00000100:00100000:3.0:1746066746.026325:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982898816 00000100:00100000:3.0:1746066746.026343:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982898688 00000100:00100000:3.0:1746066746.026345:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982898688 00000100:00100000:3.0:1746066746.026359:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15111 00000100:00100000:3.0:1746066746.026364:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882982898560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.026376:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.026394:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04b2 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.026415:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.026416:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.026426:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 32 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.026442:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 32 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.026452:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097bc9000, rc 0) 00000100:00100000:3.0:1746066746.026482:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882982898560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 118us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.026488:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15111 00000100:00100000:3.0:1746066746.026504:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15112 00000100:00100000:3.0:1746066746.026508:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882982898816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.026514:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.026522:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa53d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04c0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.026563:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984312064:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066746.026613:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.026632:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15113 00000100:00100000:3.0:1746066746.026637:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982898688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.026643:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.026648:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04b9 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.026658:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.026659:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.026663:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 27 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.026672:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 27 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.026692:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c000, rc 0) 00000100:00100000:3.0:1746066746.026704:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882982898688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.026709:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15113 00002000:00010000:3.0:1746066746.029816:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066745 -> 1746066747 00002000:00010000:3.0:1746066746.029823:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066745 -> 1746066747 00002000:00010000:3.0:1746066746.029825:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066745 -> 1746066747 00000100:00100000:3.0:1746066746.029844:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984312064:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.029876:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa53d5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c0 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.029915:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa53d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c0 expref: 26 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.029941:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecec00, rc 0) 00000100:00100000:3.0:1746066746.029993:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882982898816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3482us (3947us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066746.030001:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15112 00000100:00100000:1.0:1746066746.031624:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982898304:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6476us (8282us total) trans 0 rc 458752/458752 00000100:00100000:1.0:1746066746.031633:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3837 00002000:00100000:1.0:1746066746.031644:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012faf3800 x1830882982898304/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 504/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 458752/458752 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.031653:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3800 with x1830882982898304 ext(1048576->2097151) 00002000:00010000:1.0:1746066746.031659:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf3800 00000100:00100000:2.0:1746066746.032790:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882982898176:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8204us (9495us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066746.032798:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3836 00002000:00100000:2.0:1746066746.032804:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf2d80 x1830882982898176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.032810:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2d80 with x1830882982898176 ext(1048576->2097151) 00002000:00010000:2.0:1746066746.032814:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf2d80 00000100:00100000:0.0:1746066746.037077:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.037131:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.037485:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982899072 00000100:00100000:2.0:1746066746.037494:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982899072 00000100:00100000:1.0:1746066746.037513:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982899328 00000100:00100000:1.0:1746066746.037518:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982899328 00002000:00100000:1.0:1746066746.037549:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009c7fe680 x1830882982899328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.037559:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fe680 with x1830882982899328 ext(1048576->2097151) 00002000:00100000:2.0:1746066746.037562:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012faf6d80 x1830882982899072/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746066746.037564:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fe680 00002000:00100000:2.0:1746066746.037571:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf6d80 with x1830882982899072 ext(0->1048575) 00002000:00010000:2.0:1746066746.037575:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf6d80 00000100:00100000:1.0:1746066746.038037:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3838 00000100:00100000:2.0:1746066746.038044:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3839 00000100:00100000:1.0:1746066746.038046:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882982899328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.038052:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882982899072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066746.046748:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.046847:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982899584 00000100:00100000:2.0:1746066746.046857:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982899584 00002000:00100000:2.0:1746066746.046914:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88009c7fc000 x1830882982899584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.046924:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc000 with x1830882982899584 ext(2097152->3145727) 00002000:00010000:2.0:1746066746.046931:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc000 00000100:00100000:1.0:1746066746.047098:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882982899328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9052us (9965us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066746.047107:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3838 00002000:00100000:1.0:1746066746.047113:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009c7fe680 x1830882982899328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.047120:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fe680 with x1830882982899328 ext(1048576->2097151) 00002000:00010000:1.0:1746066746.047124:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fe680 00000100:00100000:1.0:1746066746.047143:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3840 00000100:00100000:1.0:1746066746.047150:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982899584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.049814:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882982899072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11753us (12739us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066746.049825:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3839 00002000:00100000:3.0:1746066746.049835:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012faf6d80 x1830882982899072/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.049844:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf6d80 with x1830882982899072 ext(0->1048575) 00002000:00010000:3.0:1746066746.049849:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf6d80 00000100:00100000:0.0:1746066746.060156:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.060308:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982899712 00000100:00100000:3.0:1746066746.060317:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982899712 00000100:00100000:1.0:1746066746.060339:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982899584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13187us (13600us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066746.060349:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3840 00000100:00100000:3.0:1746066746.060360:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15114 00002000:00100000:1.0:1746066746.060362:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88009c7fc000 x1830882982899584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066746.060367:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:32664:x1830882982899712:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:1.0:1746066746.060371:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc000 with x1830882982899584 ext(2097152->3145727) 00002000:00010000:1.0:1746066746.060377:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc000 00010000:00010000:3.0:1746066746.060384:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.060401:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04c7 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.060429:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.060441:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.060442:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.060445:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.060474:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.060485:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 36 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.060497:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984312192:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.060571:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.066339:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.066392:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.066419:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982899968 00000100:00100000:1.0:1746066746.066428:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982899968 00000100:00100000:1.0:1746066746.066484:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15115 00000100:00100000:1.0:1746066746.066491:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882982899968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066746.066510:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066746.066527:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfa53ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04ce expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.066585:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984312320:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066746.066659:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.066836:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984312192:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.066859:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.066871:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c200, rc 0) 00000100:00100000:3.0:1746066746.066917:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:32664:x1830882982899712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6550us (6770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.066923:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15114 00000100:00100000:0.0:1746066746.066987:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982899840 00000100:00100000:0.0:1746066746.066991:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982899840 00002000:00100000:0.0:1746066746.067019:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1400832->1990655) req@ffff88009d8caa00 x1830882982899840/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.067029:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8caa00 with x1830882982899840 ext(1400832->1990655) 00010000:00010000:0.0:1746066746.067035:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 39 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.067047:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 39 pid: 1893 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746066746.067053:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d8caa00 00000100:00100000:0.0:1746066746.067065:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 815 00000100:00100000:0.0:1746066746.067070:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982899840:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066746.074611:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984312320:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066746.074649:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfa53ea lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ce expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.074664:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfa53ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ce expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.074878:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07a00, rc 0) 00000100:00100000:2.0:1746066746.075729:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982899968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9233us (9332us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.075738:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15115 00000100:00100000:1.0:1746066746.078716:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982899840:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11632us (12376us total) trans 17179874266 rc 0/0 00000100:00100000:1.0:1746066746.078729:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 815 00002000:00100000:1.0:1746066746.078741:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1400832->1990655) req@ffff88009d8caa00 x1830882982899840/t17179874266(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.078758:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8caa00 with x1830882982899840 ext(1400832->1990655) 00010000:00010000:1.0:1746066746.078768:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 39 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.078783:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 39 pid: 1893 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.078790:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d8caa00 00000100:00100000:2.0:1746066746.082620:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.082694:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982900096 00000100:00100000:0.0:1746066746.082704:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982900096 00000100:00100000:0.0:1746066746.082764:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15116 00000100:00100000:0.0:1746066746.082772:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982900096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066746.082792:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066746.082810:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa53f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04d5 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066746.082870:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984312448:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066746.082994:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.084064:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.084265:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982900224 00000100:00100000:1.0:1746066746.084270:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982900224 00010000:00010000:1.0:1746066746.084295:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 41 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.084315:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6734 00000100:00100000:1.0:1746066746.084320:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982900224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.084330:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.084348:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 41 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.084358:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 41 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.084379:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.084380:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.084387:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.084400:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.084421:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.084429:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984312576:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.085102:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00010000:00010000:2.0:1746066746.085558:0:9591:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff88009c7ffb80 x1830882984312448) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 41 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.085578:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa53c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1400832->1990655) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04a4 expref: 41 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.085591:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984312448:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066746.085619:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa53f1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04d5 expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.085629:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa53f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04d5 expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.085636:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718d400, rc 0) 00000100:00100000:2.0:1746066746.085667:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882982900096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2896us (3057us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.085686:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15116 00000100:00100000:1.0:1746066746.088454:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984312576:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.088474:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.088523:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982900224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4200us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.088532:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6734 00000100:00100000:0.0:1746066746.089726:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.089774:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.090370:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.090474:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982900608 00000100:00100000:1.0:1746066746.090483:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982900608 00002000:00100000:1.0:1746066746.090530:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a4380 x1830882982900608/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.090540:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4380 with x1830882982900608 ext(1048576->2097151) 00002000:00010000:1.0:1746066746.090545:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4380 00000100:00100000:1.0:1746066746.090572:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3841 00000100:00100000:1.0:1746066746.090579:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982900608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.096060:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982900352 00000100:00100000:2.0:1746066746.096076:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982900352 00000100:00100000:2.0:1746066746.096130:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982900736 00000100:00100000:2.0:1746066746.096133:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982900736 00000100:00100000:2.0:1746066746.096159:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15117 00000100:00100000:2.0:1746066746.096167:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982900352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066746.096187:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.096206:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04dc expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.096234:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.096236:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.096245:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 39 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.096260:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 39 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.096275:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750800, rc 0) 00000100:00100000:2.0:1746066746.096329:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882982900352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 163us (6608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.096335:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15117 00000100:00100000:2.0:1746066746.096350:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15118 00000100:00100000:2.0:1746066746.096355:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:32659:x1830882982900736:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066746.096363:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.096372:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04e3 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.096388:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.096396:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 42 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.096401:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.096402:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.096404:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3932160->4194303] (req 3932160->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 33 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.096431:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 42 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.096443:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 42 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.096456:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984312704:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.096517:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.096524:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 33 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.096532:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984312832:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.096550:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.102949:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982900608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12354us (13158us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066746.102966:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3841 00002000:00100000:1.0:1746066746.102981:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a4380 x1830882982900608/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.102993:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4380 with x1830882982900608 ext(1048576->2097151) 00002000:00010000:1.0:1746066746.103000:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4380 00000100:00100000:2.0:1746066746.103115:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984312704:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.103127:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984312832:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.103160:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3932160->4194303] (req 3932160->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 33 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.103185:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751600, rc 0) 00000100:00100000:2.0:1746066746.103206:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+33:32659:x1830882982900736:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6851us (12837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.103213:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15118 00000100:00100000:0.0:1746066746.105474:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.105983:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.106605:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982900864 00000100:00100000:1.0:1746066746.106615:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982900864 00010000:00010000:1.0:1746066746.106657:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.106707:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982900992 00000100:00100000:1.0:1746066746.106710:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982900992 00010000:00010000:1.0:1746066746.106721:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 33 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.106737:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6735 00000100:00100000:1.0:1746066746.106744:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982900864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.106757:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.106778:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.106789:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.106811:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5396 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d047a expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.106837:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.106900:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882982900864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 139us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.106906:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6735 00000100:00100000:1.0:1746066746.106922:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6736 00000100:00100000:1.0:1746066746.106927:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882982900992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.106936:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.106942:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 33 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.106951:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 33 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.106962:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa538f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0473 expref: 33 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.106970:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.106971:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.106978:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 32 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.106986:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 32 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.107018:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 32 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.107031:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984312960:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.107089:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.111064:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984312960:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.111088:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.111147:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982900992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4217us (5162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.111159:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6736 00000100:00100000:0.0:1746066746.111935:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.111987:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982901248 00000100:00100000:1.0:1746066746.111995:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982901248 00002000:00100000:1.0:1746066746.112035:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3932160->3936255) req@ffff8800958a4700 x1830882982901248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.112044:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882982901248 ext(3932160->3936255) 00002000:00010000:1.0:1746066746.112049:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4700 00000100:00100000:1.0:1746066746.112697:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3842 00000100:00100000:1.0:1746066746.112706:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982901248:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066746.112846:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982901248:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 140us (911us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066746.112852:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3842 00002000:00100000:1.0:1746066746.112857:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3932160->3936255) req@ffff8800958a4700 x1830882982901248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.112865:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882982901248 ext(3932160->3936255) 00002000:00010000:1.0:1746066746.112868:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4700 00000100:00100000:0.0:1746066746.115551:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.116741:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.116820:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982901632 00000100:00100000:2.0:1746066746.116829:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982901632 00000100:00100000:1.0:1746066746.117446:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982901504 00000100:00100000:1.0:1746066746.117450:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982901504 00002000:00100000:1.0:1746066746.117485:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3932159) req@ffff880096fd5880 x1830882982901504/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.117495:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5880 with x1830882982901504 ext(2097152->3932159) 00002000:00010000:1.0:1746066746.117500:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd5880 00000100:00100000:2.0:1746066746.117655:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15119 00000100:00100000:2.0:1746066746.117663:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+26:32659:x1830882982901632:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066746.117686:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.117703:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04ea expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.117735:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.117743:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.117748:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.117750:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.117753:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->3739647] (req 3145728->3739647) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.117780:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.117790:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 27 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.117800:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984313088:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.117877:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.117896:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 38 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.117903:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984313216:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.117917:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.118110:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3843 00000100:00100000:1.0:1746066746.118116:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882982901504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066746.128524:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.128588:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.129772:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982901760 00000100:00100000:3.0:1746066746.130369:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982901760 00000100:00100000:3.0:1746066746.130832:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15120 00000100:00100000:3.0:1746066746.130842:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:32667:x1830882982901760:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066746.130862:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.130880:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04f1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.130920:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 33 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.130928:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.130929:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.130933:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2334720->2482175] (req 2334720->2482175) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.130961:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 33 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.130970:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 33 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.130981:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984313344:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.131064:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.131603:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.131690:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984313088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.131700:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984313216:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.131721:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->3739647] (req 3145728->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.131732:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750c00, rc 0) 00000100:00100000:2.0:1746066746.131758:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:32659:x1830882982901632:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 14096us (15019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.131764:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15119 00000100:00100000:1.0:1746066746.133106:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982901888 00000100:00100000:1.0:1746066746.133117:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982901888 00010000:00010000:1.0:1746066746.133152:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 27 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.133181:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982902016 00000100:00100000:1.0:1746066746.133183:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982902016 00010000:00010000:1.0:1746066746.133191:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.133202:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6737 00000100:00100000:1.0:1746066746.133207:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882982901888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.133221:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.133239:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 27 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.133249:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 27 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.133274:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa5365 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0449 expref: 27 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.133291:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.133320:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982901888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (4732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.133325:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6737 00000100:00100000:1.0:1746066746.133337:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6738 00000100:00100000:1.0:1746066746.133341:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982902016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.133348:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.133353:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.133360:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.133369:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57000/0xf1867c21abfa5357 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d043b expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.133376:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.133378:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.133384:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.133391:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.133417:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.133428:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984313472:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.134574:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.134792:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984313344:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.134817:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2334720->2482175] (req 2334720->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.134830:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:3.0:1746066746.134853:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:32667:x1830882982901760:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4013us (6340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.134860:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15120 00000100:00100000:3.0:1746066746.135004:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.135020:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982902144 00000100:00100000:3.0:1746066746.135023:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982902144 00002000:00100000:3.0:1746066746.135048:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3932160->4194303) req@ffff8800a5d7ed80 x1830882982902144/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.135057:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830882982902144 ext(3932160->4194303) 00010000:00010000:3.0:1746066746.135063:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.135072:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:3.0:1746066746.135078:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ed80 00000100:00100000:3.0:1746066746.135097:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 816 00000100:00100000:3.0:1746066746.135102:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982902144:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066746.135292:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984313472:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066746.135302:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066746.135327:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982902016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1985us (3725us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066746.135335:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6738 00000100:00100000:1.0:1746066746.135444:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882982901504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17329us (19901us total) trans 0 rc 1835008/1835008 00000100:00100000:1.0:1746066746.135450:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3843 00002000:00100000:1.0:1746066746.135454:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3932159) req@ffff880096fd5880 x1830882982901504/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1835008/1835008 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.135461:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5880 with x1830882982901504 ext(2097152->3932159) 00010000:00010000:1.0:1746066746.135465:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.135473:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.135478:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd5880 00000100:00100000:0.0:1746066746.139822:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.141747:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982902400 00000100:00100000:3.0:1746066746.141758:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982902400 00002000:00100000:3.0:1746066746.141794:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3735552->3739647) req@ffff880096fd4000 x1830882982902400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.141804:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4000 with x1830882982902400 ext(3735552->3739647) 00002000:00010000:3.0:1746066746.141808:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd4000 00000100:00100000:3.0:1746066746.141827:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3844 00000100:00100000:3.0:1746066746.141834:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982902400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.141965:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882982902400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 131us (2152us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066746.141971:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3844 00002000:00100000:3.0:1746066746.141976:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3735552->3739647) req@ffff880096fd4000 x1830882982902400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.141983:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4000 with x1830882982902400 ext(3735552->3739647) 00002000:00010000:3.0:1746066746.141985:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd4000 00000100:00100000:3.0:1746066746.145020:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982902144:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9906us (10005us total) trans 21474841698 rc 0/0 00000100:00100000:3.0:1746066746.145032:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 816 00002000:00100000:3.0:1746066746.145044:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3932160->4194303) req@ffff8800a5d7ed80 x1830882982902144/t21474841698(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.145053:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830882982902144 ext(3932160->4194303) 00010000:00010000:3.0:1746066746.145063:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.145078:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:3.0:1746066746.145085:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7ed80 00000100:00100000:0.0:1746066746.151761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.151867:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982902656 00000100:00100000:3.0:1746066746.151878:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982902656 00002000:00100000:3.0:1746066746.151958:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (3739648->4194303) req@ffff880096fd7480 x1830882982902656/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.151969:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7480 with x1830882982902656 ext(3739648->4194303) 00002000:00010000:3.0:1746066746.151978:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd7480 00000100:00100000:3.0:1746066746.152000:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3845 00000100:00100000:3.0:1746066746.152008:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982902656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066746.156648:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.156703:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.156730:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982902912 00000100:00100000:2.0:1746066746.156739:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982902912 00002000:00100000:2.0:1746066746.156785:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012e421c00 x1830882982902912/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.156795:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421c00 with x1830882982902912 ext(2097152->3145727) 00002000:00010000:2.0:1746066746.156800:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421c00 00000100:00100000:2.0:1746066746.156839:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3846 00000100:00100000:2.0:1746066746.156848:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982902912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.157784:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982902656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5773us (6033us total) trans 0 rc 454656/454656 00000100:00100000:2.0:1746066746.157792:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3845 00002000:00100000:2.0:1746066746.157799:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (3739648->4194303) req@ffff880096fd7480 x1830882982902656/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 454656/454656 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.157806:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7480 with x1830882982902656 ext(3739648->4194303) 00002000:00010000:2.0:1746066746.157811:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd7480 00000100:00100000:1.0:1746066746.159049:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982903040 00000100:00100000:1.0:1746066746.159062:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982903040 00010000:00010000:1.0:1746066746.159095:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.159120:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6739 00000100:00100000:1.0:1746066746.159126:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:2013:x1830882982903040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.159142:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066746.159158:0:7232:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066746 -> 1746066747 00002000:00010000:1.0:1746066746.159161:0:7232:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066746 -> 1746066747 00010000:00010000:1.0:1746066746.159167:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.159178:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.159205:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095751600/0xf1867c21abfa53ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3932160->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04e3 expref: 34 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.159230:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.159232:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.159238:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.159246:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.159284:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.159298:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984313600:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.159368:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.165029:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882982902912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8166us (8376us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066746.165042:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3846 00002000:00100000:2.0:1746066746.165055:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012e421c00 x1830882982902912/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.165064:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421c00 with x1830882982902912 ext(2097152->3145727) 00002000:00010000:2.0:1746066746.165071:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421c00 00000100:00100000:1.0:1746066746.170659:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984313600:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.170698:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.170822:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2013:x1830882982903040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11694us (14116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.170949:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6739 00000100:00100000:1.0:1746066746.171028:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.171324:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982903296 00000100:00100000:2.0:1746066746.171331:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982903296 00002000:00100000:2.0:1746066746.171374:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2334720->2338815) req@ffff88009d8c8e00 x1830882982903296/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.171384:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8e00 with x1830882982903296 ext(2334720->2338815) 00002000:00010000:2.0:1746066746.171389:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c8e00 00000100:00100000:2.0:1746066746.171419:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3847 00000100:00100000:2.0:1746066746.171426:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982903296:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066746.171570:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982903296:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 143us (542us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066746.171576:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3847 00002000:00100000:2.0:1746066746.171581:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2334720->2338815) req@ffff88009d8c8e00 x1830882982903296/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.171588:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8e00 with x1830882982903296 ext(2334720->2338815) 00002000:00010000:2.0:1746066746.171590:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c8e00 00000100:00100000:0.0:1746066746.175254:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.175508:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982903552 00000100:00100000:2.0:1746066746.175518:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982903552 00002000:00100000:2.0:1746066746.175565:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2478080->2482175) req@ffff88012e423800 x1830882982903552/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.175575:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423800 with x1830882982903552 ext(2478080->2482175) 00002000:00010000:2.0:1746066746.175581:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423800 00000100:00100000:0.0:1746066746.175709:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.176305:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3848 00000100:00100000:2.0:1746066746.176314:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982903552:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066746.176825:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982903552:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 511us (1583us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066746.176833:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3848 00002000:00100000:2.0:1746066746.176839:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2478080->2482175) req@ffff88012e423800 x1830882982903552/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.176847:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423800 with x1830882982903552 ext(2478080->2482175) 00002000:00010000:2.0:1746066746.176852:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423800 00000100:00100000:3.0:1746066746.177331:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982903680 00000100:00100000:3.0:1746066746.177336:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982903680 00000100:00100000:3.0:1746066746.177377:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15121 00000100:00100000:3.0:1746066746.177383:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:32664:x1830882982903680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.177396:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.177413:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04f8 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.177439:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.177446:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.177448:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.177451:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.177481:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.177492:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 42 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.177504:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984313728:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.178023:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.184021:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984313728:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066746.184050:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066746.184058:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.184077:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:2.0:1746066746.184220:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982903808 00000100:00100000:2.0:1746066746.184228:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982903808 00002000:00100000:2.0:1746066746.184271:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2334720->2482175) req@ffff8800a4d0c380 x1830882982903808/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.184279:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0c380 with x1830882982903808 ext(2334720->2482175) 00010000:00010000:2.0:1746066746.184287:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 43 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.184298:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 43 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.184308:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d0c380 00000100:00100000:2.0:1746066746.184328:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 817 00000100:00100000:2.0:1746066746.184336:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982903808:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066746.184373:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:32664:x1830882982903680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6988us (8662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.184380:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15121 00000100:00100000:2.0:1746066746.190392:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882982903808:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6048us (6334us total) trans 21474841699 rc 0/0 00000100:00100000:2.0:1746066746.190404:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 817 00002000:00100000:2.0:1746066746.190414:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2334720->2482175) req@ffff8800a4d0c380 x1830882982903808/t21474841699(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.190423:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0c380 with x1830882982903808 ext(2334720->2482175) 00010000:00010000:2.0:1746066746.190431:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 45 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.190445:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 45 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.190451:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d0c380 00000001:00080000:0.0:1746066746.194141:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841699 is committed 00000001:00080000:0.0:1746066746.194159:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841698 is committed 00000001:00080000:0.0:1746066746.194219:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841685 is committed 00000001:00080000:0.0:1746066746.194226:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841682 is committed 00000100:00100000:0.0:1746066746.198319:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.198583:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982903936 00000100:00100000:1.0:1746066746.198593:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982903936 00010000:00010000:1.0:1746066746.198635:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 19 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.198687:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6740 00000100:00100000:1.0:1746066746.198696:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882982903936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.198713:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.198738:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 19 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.198751:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 19 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.198774:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa540d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2482175) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f1 expref: 19 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.199259:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.199262:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.199270:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.199283:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.199321:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.199333:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984313856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.199423:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.203866:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984313856:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.203903:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.203945:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2014:x1830882982903936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5250us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.203956:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6740 00000100:00100000:0.0:1746066746.207788:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.207916:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982904192 00000100:00100000:2.0:1746066746.207928:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982904192 00002000:00100000:2.0:1746066746.207967:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a4d0ed80 x1830882982904192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.207977:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0ed80 with x1830882982904192 ext(3145728->4194303) 00002000:00010000:2.0:1746066746.207982:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0ed80 00000100:00100000:2.0:1746066746.208005:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3849 00000100:00100000:2.0:1746066746.208011:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882982904192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.225716:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882982904192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17696us (17933us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066746.225727:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3849 00002000:00100000:2.0:1746066746.225737:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a4d0ed80 x1830882982904192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.225745:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0ed80 with x1830882982904192 ext(3145728->4194303) 00002000:00010000:2.0:1746066746.225751:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0ed80 00000100:00100000:0.0:1746066746.231213:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.231291:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.231739:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982904320 00000100:00100000:3.0:1746066746.231751:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982904320 00000100:00100000:2.0:1746066746.231787:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982904448 00000100:00100000:2.0:1746066746.231796:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982904448 00000100:00100000:3.0:1746066746.231808:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15122 00000100:00100000:3.0:1746066746.231817:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882982904320:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066746.231834:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15123 00010000:00010000:3.0:1746066746.231837:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066746.231841:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982904448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.231856:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d04ff expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.231856:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.231871:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750600/0xf1867c21abfa5422 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0506 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.231880:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.231908:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.231918:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.231932:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066746.231937:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984313984:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.231943:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf000, rc 0) 00000100:00100000:3.0:1746066746.232727:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882982904320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 910us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.232738:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15122 00000100:00100000:2.0:1746066746.233685:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.237824:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746066746.237955:0:9591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066746 -> 1746066747 00002000:00010000:2.0:1746066746.237959:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066746 -> 1746066747 00000100:00100000:3.0:1746066746.237960:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982904704 00002000:00010000:2.0:1746066746.237962:0:9591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066746 -> 1746066747 00000100:00100000:3.0:1746066746.237970:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982904704 00000100:00100000:2.0:1746066746.237982:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984313984:192.168.204.16@tcp:106: 00002000:00100000:3.0:1746066746.238010:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095801f80 x1830882982904704/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.238019:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882982904704 ext(4194304->5033983) 00002000:00010000:3.0:1746066746.238024:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801f80 00000100:00100000:3.0:1746066746.238048:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3850 00000100:00100000:3.0:1746066746.238055:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882982904704:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746066746.238074:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750600/0xf1867c21abfa5422 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0506 expref: 39 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.238094:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750600/0xf1867c21abfa5422 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0506 expref: 39 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.238118:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750600, rc 0) 00000100:00100000:2.0:1746066746.238166:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882982904448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6325us (6874us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.238174:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15123 00000100:00100000:3.0:1746066746.241448:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882982904704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3382us (3623us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066746.241460:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3850 00002000:00100000:3.0:1746066746.241471:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095801f80 x1830882982904704/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.241479:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801f80 with x1830882982904704 ext(4194304->5033983) 00002000:00010000:3.0:1746066746.241487:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801f80 00000100:00100000:0.0:1746066746.246459:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.246648:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982904960 00000100:00100000:3.0:1746066746.246659:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982904960 00002000:00100000:3.0:1746066746.246724:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095801c00 x1830882982904960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.246734:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801c00 with x1830882982904960 ext(1048576->2097151) 00002000:00010000:3.0:1746066746.246740:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801c00 00000100:00100000:3.0:1746066746.246762:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3851 00000100:00100000:3.0:1746066746.246770:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982904960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.253958:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882982904960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7164us (7490us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066746.253972:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3851 00002000:00100000:3.0:1746066746.253986:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095801c00 x1830882982904960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.253996:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801c00 with x1830882982904960 ext(1048576->2097151) 00002000:00010000:3.0:1746066746.254002:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801c00 00000100:00100000:0.0:1746066746.264455:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.265076:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982905216 00000100:00100000:3.0:1746066746.265086:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982905216 00002000:00100000:3.0:1746066746.265134:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095802680 x1830882982905216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.265144:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802680 with x1830882982905216 ext(2097152->3145727) 00002000:00010000:3.0:1746066746.265149:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095802680 00000100:00100000:3.0:1746066746.265183:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3852 00000100:00100000:3.0:1746066746.265191:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882982905216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.276981:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882982905216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11776us (12523us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066746.276993:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3852 00002000:00100000:3.0:1746066746.277006:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095802680 x1830882982905216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.277015:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802680 with x1830882982905216 ext(2097152->3145727) 00002000:00010000:3.0:1746066746.277021:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095802680 00000100:00100000:0.0:1746066746.282419:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.282608:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982905344 00000100:00100000:2.0:1746066746.282618:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982905344 00000100:00100000:2.0:1746066746.282852:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15124 00000100:00100000:2.0:1746066746.282861:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:32672:x1830882982905344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066746.282920:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.282939:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d050d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.282974:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.282982:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066746.282984:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066746.282987:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.283016:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.283031:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 25 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.283043:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984314112:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.283249:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.286466:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.286635:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984314112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.286666:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.286693:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750400, rc 0) 00000100:00100000:2.0:1746066746.286749:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:32672:x1830882982905344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3888us (4341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.286758:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15124 00000100:00100000:3.0:1746066746.287369:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982905472 00000100:00100000:3.0:1746066746.287377:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982905472 00002000:00100000:3.0:1746066746.287415:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3739647) req@ffff880095803100 x1830882982905472/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.287424:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803100 with x1830882982905472 ext(3145728->3739647) 00010000:00010000:3.0:1746066746.287431:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 26 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.287442:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 26 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:3.0:1746066746.287449:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095803100 00000100:00100000:3.0:1746066746.287477:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 818 00000100:00100000:3.0:1746066746.287483:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982905472:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066746.298130:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882982905472:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10634us (11662us total) trans 17179874267 rc 0/0 00000100:00100000:0.0:1746066746.298144:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 818 00002000:00100000:0.0:1746066746.298156:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3739647) req@ffff880095803100 x1830882982905472/t17179874267(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.298166:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803100 with x1830882982905472 ext(3145728->3739647) 00010000:00010000:0.0:1746066746.298177:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 28 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.298191:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 28 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746066746.298199:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095803100 00000100:00100000:0.0:1746066746.305451:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.305712:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982905600 00000100:00100000:1.0:1746066746.305721:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982905600 00010000:00010000:1.0:1746066746.305759:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 28 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.305802:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6741 00000100:00100000:1.0:1746066746.305810:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882982905600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.305827:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.305849:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 28 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.305865:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 28 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.306581:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750c00/0xf1867c21abfa5406 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3739647) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ea expref: 28 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.307026:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.307029:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.307038:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.307047:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.307440:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.307454:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984314240:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066746.312288:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.314136:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984314240:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066746.314159:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.314217:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982905600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8405us (8775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.314228:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6741 00000100:00100000:0.0:1746066746.320666:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.321270:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982905728 00000100:00100000:2.0:1746066746.321280:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982905728 00000100:00100000:3.0:1746066746.321500:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15125 00000100:00100000:3.0:1746066746.321510:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:32675:x1830882982905728:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066746.321531:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.321549:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0514 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.321580:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.321588:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.321590:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.321593:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2990080->3145727] (req 2990080->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.321630:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.321642:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 38 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.321654:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984314368:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.321745:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.325507:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984314368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.325543:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2990080->3145727] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.325561:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfa00, rc 0) 00000100:00100000:3.0:1746066746.325711:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:32675:x1830882982905728:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4201us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.325719:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15125 00000100:00100000:0.0:1746066746.328049:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.328149:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982905984 00000100:00100000:2.0:1746066746.328158:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982905984 00002000:00100000:2.0:1746066746.328205:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095ce3100 x1830882982905984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.328221:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3100 with x1830882982905984 ext(2097152->4194303) 00010000:00010000:2.0:1746066746.328229:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.328241:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.328249:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ce3100 00000100:00100000:2.0:1746066746.328283:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 819 00000100:00100000:2.0:1746066746.328291:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982905984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066746.329169:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.330311:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982906240 00000100:00100000:1.0:1746066746.330319:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982906240 00002000:00100000:1.0:1746066746.330355:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095ce1180 x1830882982906240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.330364:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1180 with x1830882982906240 ext(3145728->4194303) 00002000:00010000:1.0:1746066746.330369:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce1180 00000100:00100000:1.0:1746066746.330398:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3853 00000100:00100000:1.0:1746066746.330405:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882982906240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.350207:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982905984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21906us (22154us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066746.350218:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 819 00002000:00100000:2.0:1746066746.350229:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095ce3100 x1830882982905984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.350239:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3100 with x1830882982905984 ext(2097152->4194303) 00010000:00010000:2.0:1746066746.350248:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.350262:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.350269:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ce3100 00000100:00100000:1.0:1746066746.356995:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882982906240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26577us (27815us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066746.357008:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3853 00002000:00100000:1.0:1746066746.357021:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095ce1180 x1830882982906240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.357030:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1180 with x1830882982906240 ext(3145728->4194303) 00002000:00010000:1.0:1746066746.357037:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce1180 00000100:00100000:0.0:1746066746.362243:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.362301:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.362700:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982906368 00000100:00100000:2.0:1746066746.362710:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982906368 00010000:00010000:2.0:1746066746.362751:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.363351:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6742 00000100:00100000:2.0:1746066746.363360:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982906368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.363374:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.363394:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.363405:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.363426:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750400/0xf1867c21abfa5429 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d050d expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.363450:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.363452:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.363459:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.363467:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.363501:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.363513:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984314496:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066746.363695:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982906496 00000100:00100000:3.0:1746066746.363699:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982906496 00000100:00100000:3.0:1746066746.363724:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15126 00000100:00100000:3.0:1746066746.363729:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:32672:x1830882982906496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.363745:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.363755:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d051b expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.363776:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.363782:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.363784:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.363787:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.363805:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.363815:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 27 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.363824:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984314624:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.364005:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.364597:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.366495:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.366611:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984314624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.366640:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.366656:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece800, rc 0) 00000100:00100000:2.0:1746066746.366781:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984314496:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066746.366794:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.366813:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882982906368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3455us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.366824:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6742 00000100:00100000:1.0:1746066746.366913:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982906752 00000100:00100000:1.0:1746066746.366920:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982906752 00002000:00100000:1.0:1746066746.366960:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2990080->2994175) req@ffff880093ac8700 x1830882982906752/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.366969:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8700 with x1830882982906752 ext(2990080->2994175) 00010000:00010000:1.0:1746066746.366976:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.366987:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.366994:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac8700 00000100:00100000:1.0:1746066746.367014:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 820 00000100:00100000:1.0:1746066746.367021:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982906752:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066746.367263:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:32672:x1830882982906496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2979us (4408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.367269:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15126 00000100:00100000:1.0:1746066746.367702:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982906752:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 680us (1213us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066746.367711:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 820 00002000:00100000:1.0:1746066746.367716:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2990080->2994175) req@ffff880093ac8700 x1830882982906752/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.367727:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8700 with x1830882982906752 ext(2990080->2994175) 00010000:00010000:1.0:1746066746.367732:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.367741:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.367746:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac8700 00000100:00100000:0.0:1746066746.375754:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.375848:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982907136 00000100:00100000:3.0:1746066746.375858:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982907136 00000100:00100000:3.0:1746066746.377643:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15127 00000100:00100000:3.0:1746066746.377655:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:32675:x1830882982907136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066746.377689:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.377709:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0522 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.377741:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.377749:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 18 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.377756:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.377758:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.377762:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3489791] (req 3145728->3489791) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.377796:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 18 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.377807:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 18 pid: 20361 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066746.377819:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984314752:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.377953:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.377967:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 9 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.377975:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984314880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.377997:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.378755:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.378870:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982907008 00000100:00100000:1.0:1746066746.378876:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982907008 00002000:00100000:1.0:1746066746.378933:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2990080->3145727) req@ffff880093ac8e00 x1830882982907008/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.378942:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8e00 with x1830882982907008 ext(2990080->3145727) 00010000:00010000:1.0:1746066746.378950:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.378959:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.378965:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac8e00 00000100:00100000:1.0:1746066746.379351:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 821 00000100:00100000:1.0:1746066746.379358:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982907008:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066746.387524:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.387706:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982907008:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8346us (8951us total) trans 17179874268 rc 0/0 00000100:00100000:1.0:1746066746.387719:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 821 00002000:00100000:1.0:1746066746.387733:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2990080->3145727) req@ffff880093ac8e00 x1830882982907008/t17179874268(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.387741:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8e00 with x1830882982907008 ext(2990080->3145727) 00010000:00010000:1.0:1746066746.387752:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 30 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.387765:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 30 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.387772:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac8e00 00000100:00100000:3.0:1746066746.387988:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984314752:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.387998:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984314880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.388026:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3489791] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.388042:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecea00, rc 0) 00000100:00100000:3.0:1746066746.388077:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:32675:x1830882982907136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10426us (12334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.388083:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15127 00000100:00100000:2.0:1746066746.391114:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982907392 00000100:00100000:2.0:1746066746.391129:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982907392 00010000:00010000:2.0:1746066746.391175:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 19 pid: 20361 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066746.391211:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6743 00000100:00100000:2.0:1746066746.391218:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882982907392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.391233:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.391253:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 19 pid: 20361 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.391265:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 19 pid: 20361 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.391287:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa541b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ff expref: 19 pid: 20361 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.391312:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.391366:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882982907392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.391376:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6743 00000100:00100000:2.0:1746066746.392229:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.392398:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982907264 00000100:00100000:3.0:1746066746.392403:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982907264 00010000:00010000:3.0:1746066746.392425:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 9 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.392533:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6744 00000100:00100000:3.0:1746066746.392539:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2014:x1830882982907264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066746.392548:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066746.392561:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 9 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.392571:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 9 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.392586:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5414 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04f8 expref: 9 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.392611:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.392614:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.392621:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 8 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.392631:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 8 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.392665:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 8 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.392690:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984315008:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066746.392766:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.394287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.394377:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982907520 00000100:00100000:2.0:1746066746.394382:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982907520 00010000:00010000:2.0:1746066746.394407:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 30 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.394431:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6745 00000100:00100000:2.0:1746066746.394436:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882982907520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.394446:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.394462:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 30 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.394473:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 30 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.394489:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa5430 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2990080->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0514 expref: 30 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.394505:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.394507:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.394512:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.394520:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.394550:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.394560:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984315136:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066746.394632:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.395793:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984315008:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066746.395812:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066746.395851:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882982907264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3311us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.395860:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6744 00000100:00100000:3.0:1746066746.404179:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.404228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.404254:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982907904 00000100:00100000:3.0:1746066746.404263:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982907904 00000100:00100000:3.0:1746066746.404309:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15128 00000100:00100000:3.0:1746066746.404317:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:32677:x1830882982907904:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066746.404337:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.404355:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0529 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.404384:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.404393:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 29 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.404399:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.404401:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.404405:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1560576->2097151] (req 1560576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.404436:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 29 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.404448:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 29 pid: 9592 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066746.404460:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984315264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.404537:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984315136:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066746.404551:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.404555:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066746.404560:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 40 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.404567:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984315392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.404576:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882982907520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 10140us (10295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.404584:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6745 00000100:00100000:3.0:1746066746.404586:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2191780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.404624:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982907776 00000100:00100000:2.0:1746066746.404627:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982907776 00002000:00100000:2.0:1746066746.404649:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3485696->3489791) req@ffff8800a5d7f480 x1830882982907776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.404657:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830882982907776 ext(3485696->3489791) 00002000:00010000:2.0:1746066746.404662:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:1.0:1746066746.404959:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.405094:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982908160 00000100:00100000:2.0:1746066746.405097:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982908160 00000100:00100000:3.0:1746066746.405102:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3854 00000100:00100000:3.0:1746066746.405109:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882982907776:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:2.0:1746066746.405123:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012c8baa00 x1830882982908160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.405130:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8baa00 with x1830882982908160 ext(3145728->4194303) 00002000:00010000:2.0:1746066746.405133:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8baa00 00000100:00100000:2.0:1746066746.405143:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3855 00000100:00100000:2.0:1746066746.405148:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982908160:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066746.405367:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882982907776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 257us (1198us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066746.405372:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3854 00002000:00100000:3.0:1746066746.405377:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3485696->3489791) req@ffff8800a5d7f480 x1830882982907776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.405383:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830882982907776 ext(3485696->3489791) 00002000:00010000:3.0:1746066746.405386:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:3.0:1746066746.407256:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984315392:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066746.409110:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.409140:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.409218:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982908288 00000100:00100000:2.0:1746066746.409226:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982908288 00010000:00010000:2.0:1746066746.409264:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.409292:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982908416 00000100:00100000:2.0:1746066746.409294:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982908416 00010000:00010000:2.0:1746066746.409303:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 29 pid: 9592 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066746.409324:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6746 00000100:00100000:2.0:1746066746.409330:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982908288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.409343:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.409362:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.409373:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.409395:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece200/0xf1867c21abfa53c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04ab expref: 43 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.409415:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.409451:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982908288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.409458:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6746 00000100:00100000:2.0:1746066746.409472:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6747 00000100:00100000:2.0:1746066746.409477:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982908416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.409483:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.409488:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 29 pid: 9592 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.409497:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 29 pid: 9592 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.409508:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.409510:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.409517:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.409524:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.409553:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.409564:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984315520:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066746.409616:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00010000:00010000:3.0:1746066746.409725:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa53dc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b9 expref: 29 pid: 9592 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066746.409740:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984315264:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.409765:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.409778:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155ce00, rc 0) 00000100:00100000:3.0:1746066746.409815:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:32677:x1830882982907904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5499us (5586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.409822:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15128 00000100:00100000:2.0:1746066746.419155:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982908160:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 13994us (14182us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066746.419167:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3855 00002000:00100000:2.0:1746066746.419181:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012c8baa00 x1830882982908160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.419196:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8baa00 with x1830882982908160 ext(3145728->4194303) 00002000:00010000:2.0:1746066746.419202:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8baa00 00000100:00100000:3.0:1746066746.419833:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984315520:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066746.419853:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066746.419876:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882982908416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 10398us (10734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.419903:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6747 00000100:00100000:0.0:1746066746.420364:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.420423:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982908672 00000100:00100000:2.0:1746066746.420431:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982908672 00002000:00100000:2.0:1746066746.420468:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1560576->1564671) req@ffff880093ac9880 x1830882982908672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.420475:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9880 with x1830882982908672 ext(1560576->1564671) 00002000:00010000:2.0:1746066746.420479:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac9880 00000100:00100000:2.0:1746066746.420495:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3856 00000100:00100000:2.0:1746066746.420502:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982908672:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066746.420625:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982908672:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 124us (262us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066746.420631:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3856 00002000:00100000:2.0:1746066746.420635:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1560576->1564671) req@ffff880093ac9880 x1830882982908672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.420641:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9880 with x1830882982908672 ext(1560576->1564671) 00002000:00010000:2.0:1746066746.420644:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac9880 00000100:00100000:0.0:1746066746.430444:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.430661:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982908800 00000100:00100000:3.0:1746066746.430681:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982908800 00000100:00100000:3.0:1746066746.430789:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15129 00000100:00100000:3.0:1746066746.430799:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882982908800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.430820:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.430839:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0d600/0xf1867c21abfa544c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0530 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.430932:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984315648:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066746.431782:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.432199:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982908928 00000100:00100000:2.0:1746066746.432204:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982908928 00000100:00100000:2.0:1746066746.432229:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15130 00000100:00100000:2.0:1746066746.432234:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:32677:x1830882982908928:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066746.432244:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.432256:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0537 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.432277:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.432285:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.432290:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.432292:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.432295:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 40 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.432313:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 40 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.432322:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 40 pid: 9591 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066746.432330:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984315776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.432393:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066746.432503:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.432510:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 27 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.432518:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984315904:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.432537:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00002000:00010000:3.0:1746066746.432684:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066746 -> 1746066747 00000100:00100000:3.0:1746066746.432704:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984315648:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.432725:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0d600/0xf1867c21abfa544c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0530 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.432739:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0d600/0xf1867c21abfa544c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0530 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.432751:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d600, rc 0) 00000100:00100000:3.0:1746066746.432771:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882982908800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1975us (2339us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066746.432777:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15129 00000100:00100000:2.0:1746066746.436163:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984315776:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.436974:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984315904:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.437005:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1175551] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 40 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.437024:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751a00, rc 0) 00000100:00100000:2.0:1746066746.437087:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:32677:x1830882982908928:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4851us (5303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.437097:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15130 00000100:00100000:0.0:1746066746.437247:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.437765:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982909056 00000100:00100000:2.0:1746066746.437771:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982909056 00010000:00010000:2.0:1746066746.437796:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 40 pid: 9591 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066746.437822:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6748 00000100:00100000:2.0:1746066746.437827:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882982909056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.437838:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.437856:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 40 pid: 9591 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.437865:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 40 pid: 9591 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.437899:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750800/0xf1867c21abfa53f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04dc expref: 40 pid: 9591 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.437920:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.437937:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982909056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 110us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.437942:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6748 00000100:00100000:3.0:1746066746.438592:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.438619:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.438637:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982909184 00000100:00100000:1.0:1746066746.438642:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982909184 00010000:00010000:1.0:1746066746.438659:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.438700:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6749 00000100:00100000:1.0:1746066746.438706:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882982909184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.438713:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.438723:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.438733:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.438744:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982909312 00010000:00010000:1.0:1746066746.438746:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa53e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04c7 expref: 28 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.438748:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982909312 00010000:00010000:1.0:1746066746.438765:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.438766:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066746.438769:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15131 00010000:00010000:1.0:1746066746.438773:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.438774:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+18:32672:x1830882982909312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066746.438781:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.438790:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.438803:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d053e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.438813:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 38 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.438822:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.438824:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984316032:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066746.438828:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066746.438829:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066746.438832:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.438850:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.438860:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 7 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.438874:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984316160:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066746.438880:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.438924:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.442835:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984316160:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.442870:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.442921:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750200, rc 0) 00000100:00100000:1.0:1746066746.443093:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984316032:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.443107:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.443162:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882982909184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4455us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.443163:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+19:32672:x1830882982909312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4387us (4540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.443172:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15131 00000100:00100000:1.0:1746066746.443172:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6749 00000100:00100000:3.0:1746066746.443193:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.444216:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982909440 00000100:00100000:0.0:1746066746.444225:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982909440 00000100:00100000:3.0:1746066746.444324:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:0.0:1746066746.444522:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3489791) req@ffff88008e331f80 x1830882982909440/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.444532:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e331f80 with x1830882982909440 ext(3145728->3489791) 00010000:00010000:0.0:1746066746.444539:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 8 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.444551:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 8 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746066746.444558:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e331f80 00000100:00100000:0.0:1746066746.444573:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982909696 00000100:00100000:0.0:1746066746.444575:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982909696 00002000:00100000:0.0:1746066746.444588:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->1175551) req@ffff880098fbea00 x1830882982909696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.444595:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882982909696 ext(1171456->1175551) 00002000:00010000:0.0:1746066746.444598:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:0.0:1746066746.444609:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 822 00000100:00100000:0.0:1746066746.444615:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882982909440:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066746.444796:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3857 00000100:00100000:2.0:1746066746.444803:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982909696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.444915:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882982909696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 112us (591us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066746.444920:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3857 00002000:00100000:2.0:1746066746.444925:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->1175551) req@ffff880098fbea00 x1830882982909696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.444932:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882982909696 ext(1171456->1175551) 00002000:00010000:2.0:1746066746.444934:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:0.0:1746066746.453112:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982909440:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8483us (9906us total) trans 21474841700 rc 0/0 00000100:00100000:0.0:1746066746.453125:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 822 00002000:00100000:0.0:1746066746.453138:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3489791) req@ffff88008e331f80 x1830882982909440/t21474841700(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.453147:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e331f80 with x1830882982909440 ext(3145728->3489791) 00010000:00010000:0.0:1746066746.453157:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 10 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.453172:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 10 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746066746.453178:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e331f80 00000100:00100000:0.0:1746066746.459165:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.460184:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982909824 00000100:00100000:1.0:1746066746.460196:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982909824 00010000:00010000:1.0:1746066746.460240:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 10 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.460285:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6750 00000100:00100000:1.0:1746066746.460293:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982909824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.460311:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.460333:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 10 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.460344:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 10 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.460368:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa543e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3489791) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0522 expref: 10 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.460397:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.460399:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.460407:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.460417:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.460454:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 18 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.460466:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984316288:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.460559:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dda80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.463041:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984316288:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.463062:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.463109:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982909824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2816us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.463119:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6750 00000100:00100000:0.0:1746066746.465799:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.465861:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910080 00000100:00100000:2.0:1746066746.465870:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910080 00002000:00100000:2.0:1746066746.465944:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880093acaa00 x1830882982910080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.465958:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acaa00 with x1830882982910080 ext(4194304->5033983) 00002000:00010000:2.0:1746066746.465964:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acaa00 00000100:00100000:2.0:1746066746.467295:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3858 00000100:00100000:2.0:1746066746.467306:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882982910080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066746.467770:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.467804:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.467821:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910208 00000100:00100000:0.0:1746066746.467821:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.467826:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910208 00000100:00100000:0.0:1746066746.469247:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.469384:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910336 00000100:00100000:2.0:1746066746.469384:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910464 00000100:00100000:3.0:1746066746.469389:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910336 00000100:00100000:2.0:1746066746.469389:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910464 00000100:00100000:0.0:1746066746.469394:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910592 00000100:00100000:0.0:1746066746.469397:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910592 00000100:00100000:2.0:1746066746.469417:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15132 00000100:00100000:3.0:1746066746.469422:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15133 00000100:00100000:2.0:1746066746.469422:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882982910208:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066746.469428:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882982910336:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066746.469429:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15134 00010000:00010000:3.0:1746066746.469436:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.469436:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066746.469437:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:2014:x1830882982910464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066746.469444:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.469450:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5770c00/0xf1867c21abfa5461 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0545 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.469451:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa5468 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d054c expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.469453:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0553 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.469469:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.469471:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.469478:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066746.469492:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984316416:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066746.469493:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066746.469494:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984316544:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066746.469502:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04000, rc 0) 00000100:00100000:3.0:1746066746.469545:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15135 00000100:00100000:3.0:1746066746.469554:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882982910592:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.469563:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.469570:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d055a expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.469579:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.469581:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.469585:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.469595:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.469601:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c200, rc 0) 00000100:00100000:3.0:1746066746.469617:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882982910592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 67us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.469622:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15135 00000100:00100000:3.0:1746066746.469643:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.469644:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.469904:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882982910464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 468us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.469909:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15134 00000100:00100000:2.0:1746066746.474953:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882982910080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7636us (9151us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066746.474965:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3858 00002000:00100000:2.0:1746066746.474978:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880093acaa00 x1830882982910080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.474987:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acaa00 with x1830882982910080 ext(4194304->5033983) 00002000:00010000:2.0:1746066746.474993:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acaa00 00002000:00010000:2.0:1746066746.476074:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066746 -> 1746066747 00002000:00010000:2.0:1746066746.476077:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066746 -> 1746066747 00002000:00010000:2.0:1746066746.476081:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066746 -> 1746066747 00000100:00100000:2.0:1746066746.476099:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984316416:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066746.476190:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5770c00/0xf1867c21abfa5461 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0545 expref: 31 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.476234:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5770c00/0xf1867c21abfa5461 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0545 expref: 31 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.476251:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5770c00, rc 0) 00000100:00100000:2.0:1746066746.476452:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982910208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7028us (8681us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.476458:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15132 00000100:00100000:3.0:1746066746.476765:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984316544:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.476781:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa5468 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d054c expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.476789:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa5468 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d054c expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.476808:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0da00, rc 0) 00000100:00100000:3.0:1746066746.476836:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882982910336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7408us (9031us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066746.476844:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15133 00000100:00100000:0.0:1746066746.482105:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.482281:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910720 00000100:00100000:3.0:1746066746.482290:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910720 00000100:00100000:3.0:1746066746.482438:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15136 00000100:00100000:3.0:1746066746.482447:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+28:32682:x1830882982910720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.482468:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.482486:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0561 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.482519:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.482526:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.482528:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.482531:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.482563:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.482574:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 38 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.482587:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984316672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.483363:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066746.484071:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066746.490904:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984316672:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.490941:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.490960:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:3.0:1746066746.491010:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+29:32682:x1830882982910720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8562us (8913us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.491019:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15136 00000100:00100000:0.0:1746066746.491228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.491509:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910848 00000100:00100000:2.0:1746066746.491517:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910848 00002000:00100000:2.0:1746066746.491559:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1560576->2097151) req@ffff880093ac8000 x1830882982910848/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.491568:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8000 with x1830882982910848 ext(1560576->2097151) 00010000:00010000:2.0:1746066746.491574:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 39 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.491587:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 39 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.491593:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac8000 00000100:00100000:2.0:1746066746.491620:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 823 00000100:00100000:2.0:1746066746.491627:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882982910848:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066746.499227:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882982910848:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7588us (7987us total) trans 17179874269 rc 0/0 00000100:00100000:2.0:1746066746.499240:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 823 00002000:00100000:2.0:1746066746.499253:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1560576->2097151) req@ffff880093ac8000 x1830882982910848/t17179874269(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.499262:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8000 with x1830882982910848 ext(1560576->2097151) 00010000:00010000:2.0:1746066746.499273:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.499287:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.499294:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac8000 00000100:00100000:0.0:1746066746.503036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.503171:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982910976 00000100:00100000:1.0:1746066746.503181:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982910976 00010000:00010000:1.0:1746066746.503284:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.503314:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6751 00000100:00100000:1.0:1746066746.503322:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882982910976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.503340:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.503361:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.503373:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.503396:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5445 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0529 expref: 41 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.503415:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.503417:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.503676:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.503686:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.503724:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.503737:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984316800:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.503834:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dda80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.506472:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984316800:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.506496:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.506549:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882982910976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3226us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.506560:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6751 00000100:00100000:0.0:1746066746.511856:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.512062:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982911232 00000100:00100000:2.0:1746066746.512072:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982911232 00002000:00100000:2.0:1746066746.512120:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880093ac9500 x1830882982911232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.512130:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9500 with x1830882982911232 ext(1048576->2097151) 00002000:00010000:2.0:1746066746.512135:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac9500 00000100:00100000:2.0:1746066746.512166:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3859 00000100:00100000:2.0:1746066746.512175:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982911232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.525126:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982911232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12940us (13268us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066746.525139:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3859 00002000:00100000:2.0:1746066746.525152:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880093ac9500 x1830882982911232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.525161:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9500 with x1830882982911232 ext(1048576->2097151) 00002000:00010000:2.0:1746066746.525169:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac9500 00000100:00100000:2.0:1746066746.530950:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.531511:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982911360 00000100:00100000:3.0:1746066746.531521:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982911360 00000100:00100000:3.0:1746066746.531577:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15137 00000100:00100000:3.0:1746066746.531585:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+29:32682:x1830882982911360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.531603:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.531622:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0568 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.531655:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 39 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.531663:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.531679:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.531683:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.531715:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 39 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.531727:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 39 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.531745:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984316928:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.531839:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.535539:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.535813:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984316928:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.535844:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.535861:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d000, rc 0) 00000100:00100000:3.0:1746066746.536060:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:32682:x1830882982911360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4474us (5118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.536080:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982911488 00000100:00100000:2.0:1746066746.536089:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982911488 00000100:00100000:3.0:1746066746.536090:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15137 00002000:00100000:2.0:1746066746.536191:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1175551) req@ffff880095cec000 x1830882982911488/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.536201:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec000 with x1830882982911488 ext(1048576->1175551) 00010000:00010000:2.0:1746066746.536207:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 40 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.536219:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 40 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.536225:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cec000 00000100:00100000:2.0:1746066746.536248:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 824 00000100:00100000:2.0:1746066746.536255:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882982911488:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066746.540925:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982911488:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4659us (5386us total) trans 17179874270 rc 0/0 00000100:00100000:2.0:1746066746.540938:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 824 00002000:00100000:2.0:1746066746.540950:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1175551) req@ffff880095cec000 x1830882982911488/t17179874270(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.540960:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec000 with x1830882982911488 ext(1048576->1175551) 00010000:00010000:2.0:1746066746.540971:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 42 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.540985:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 42 pid: 9591 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.540992:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cec000 00000100:00100000:1.0:1746066746.546233:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.546322:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982911616 00000100:00100000:2.0:1746066746.546333:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982911616 00010000:00010000:2.0:1746066746.546371:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 42 pid: 9591 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.546483:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6752 00000100:00100000:2.0:1746066746.546492:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882982911616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.546508:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.546529:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 42 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.546540:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 42 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.546563:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa5453 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0537 expref: 42 pid: 9591 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.546588:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.546590:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.546597:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.546609:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.546641:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.546652:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984317056:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066746.548429:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.551941:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.552022:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982911872 00000100:00100000:3.0:1746066746.552032:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982911872 00002000:00100000:3.0:1746066746.552080:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095cec380 x1830882982911872/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.552091:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec380 with x1830882982911872 ext(1048576->2097151) 00002000:00010000:3.0:1746066746.552096:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cec380 00000100:00100000:3.0:1746066746.552117:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3860 00000100:00100000:3.0:1746066746.552124:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982911872:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.552438:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984317056:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066746.552456:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.552502:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882982911616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6012us (6280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.552511:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6752 00000100:00100000:3.0:1746066746.560590:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982911872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8454us (8649us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066746.560603:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3860 00002000:00100000:3.0:1746066746.560615:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095cec380 x1830882982911872/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.560631:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec380 with x1830882982911872 ext(1048576->2097151) 00002000:00010000:3.0:1746066746.560637:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cec380 00000100:00100000:0.0:1746066746.575170:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.575224:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.575303:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982912384 00000100:00100000:1.0:1746066746.575313:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982912384 00002000:00100000:1.0:1746066746.575360:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095cec700 x1830882982912384/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.575371:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec700 with x1830882982912384 ext(2097152->4194303) 00002000:00010000:1.0:1746066746.575377:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cec700 00000100:00100000:1.0:1746066746.575406:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982912128 00000100:00100000:1.0:1746066746.575409:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982912128 00002000:00100000:1.0:1746066746.575422:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095ceca80 x1830882982912128/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.575429:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceca80 with x1830882982912128 ext(2097152->4194303) 00002000:00010000:1.0:1746066746.575432:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceca80 00000100:00100000:1.0:1746066746.575445:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3861 00000100:00100000:1.0:1746066746.575452:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982912384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.575501:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3862 00000100:00100000:2.0:1746066746.575508:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982912128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.598915:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982912128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23394us (23677us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066746.598927:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3862 00002000:00100000:2.0:1746066746.598941:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095ceca80 x1830882982912128/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.598951:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceca80 with x1830882982912128 ext(2097152->4194303) 00002000:00010000:2.0:1746066746.598957:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceca80 00000100:00100000:0.0:1746066746.601050:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.601122:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982912512 00000100:00100000:3.0:1746066746.601131:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982912512 00000100:00100000:3.0:1746066746.601187:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15138 00000100:00100000:3.0:1746066746.601194:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+41:32687:x1830882982912512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066746.601215:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.601232:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d056f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.601261:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.601269:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.601276:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.601277:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.601281:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2138112->2420735] (req 2138112->2420735) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 42 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.601309:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 31 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.601320:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 31 pid: 9591 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066746.601336:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984317184:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.602697:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.602709:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 42 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:3.0:1746066746.602719:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984317312:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.602742:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.602796:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982912384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27341us (27635us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066746.602806:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3861 00002000:00100000:1.0:1746066746.602815:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095cec700 x1830882982912384/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.602830:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec700 with x1830882982912384 ext(2097152->4194303) 00010000:00010000:1.0:1746066746.602837:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 30 pid: 9591 timeout: 814 lvb_type: 1 00010000:00010000:1.0:1746066746.602847:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 30 pid: 9591 timeout: 814 lvb_type: 1 00002000:00010000:1.0:1746066746.602853:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095cec700 00000100:00100000:3.0:1746066746.606135:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984317184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.606150:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984317312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.606179:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2138112->2420735] (req 2138112->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 42 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.606197:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:3.0:1746066746.606492:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+42:32687:x1830882982912512:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5296us (5450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.606501:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15138 00000100:00100000:0.0:1746066746.612041:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.612678:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982912640 00000100:00100000:3.0:1746066746.612690:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982912640 00000100:00100000:3.0:1746066746.612754:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15139 00000100:00100000:3.0:1746066746.612763:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:32682:x1830882982912640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.612781:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.612798:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0576 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.612824:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.612831:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2138112->2420735] (req 2138112->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.612837:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746066746.612858:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066746.612908:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.612914:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982912768 00000100:00100000:2.0:1746066746.612919:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982912768 00010000:00010000:2.0:1746066746.612938:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 32 pid: 9591 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066746.612946:0:3528:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2138112->2420735] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.612959:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.612969:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6753 00010000:00010000:3.0:1746066746.612970:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155da00, rc 0) 00000100:00100000:2.0:1746066746.612975:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982912768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.612984:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.613002:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 32 pid: 9591 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.613012:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 32 pid: 9591 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.613029:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c200/0xf1867c21abfa5476 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d055a expref: 32 pid: 9591 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066746.613031:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+32:32682:x1830882982912640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 268us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.613036:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15139 00010000:00010000:2.0:1746066746.613045:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.613064:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882982912768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.613069:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6753 00000100:00100000:2.0:1746066746.613739:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.613954:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982912896 00000100:00100000:0.0:1746066746.613957:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982912896 00010000:00010000:0.0:1746066746.613974:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 42 pid: 20361 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746066746.614002:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6754 00000100:00100000:0.0:1746066746.614007:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982912896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066746.614014:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066746.614024:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 42 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.614033:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 42 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.614052:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece800/0xf1867c21abfa5437 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d051b expref: 42 pid: 20361 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.614151:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066746.614153:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066746.614160:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066746.614168:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066746.614291:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066746.614303:0:8395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00000100:00100000:0.0:1746066746.614315:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984317568:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066746.615583:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.619308:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.619359:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982913152 00000100:00100000:1.0:1746066746.619368:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982913152 00002000:00100000:1.0:1746066746.619419:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2138112->2142207) req@ffff880098fb4380 x1830882982913152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.619429:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4380 with x1830882982913152 ext(2138112->2142207) 00010000:00010000:1.0:1746066746.619439:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 42 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.619452:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 42 pid: 3528 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.619459:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fb4380 00000100:00100000:0.0:1746066746.619460:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ced880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984317568:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066746.619477:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.619480:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 825 00000100:00100000:1.0:1746066746.619488:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882982913152:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066746.619532:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982912896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5523us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066746.619542:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6754 00000100:00100000:1.0:1746066746.619740:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882982913152:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 252us (442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066746.619746:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 825 00002000:00100000:1.0:1746066746.619752:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2138112->2142207) req@ffff880098fb4380 x1830882982913152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.619759:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4380 with x1830882982913152 ext(2138112->2142207) 00010000:00010000:1.0:1746066746.619763:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.619772:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.619778:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fb4380 00000100:00100000:0.0:1746066746.635520:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.637216:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982913408 00000100:00100000:2.0:1746066746.637229:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982913408 00002000:00100000:2.0:1746066746.637282:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2416640->2420735) req@ffff880095ced500 x1830882982913408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.637293:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced500 with x1830882982913408 ext(2416640->2420735) 00010000:00010000:2.0:1746066746.637303:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.637318:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.637325:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ced500 00000100:00100000:2.0:1746066746.637368:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 826 00000100:00100000:2.0:1746066746.637375:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982913408:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066746.637534:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982913408:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 158us (2025us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066746.637540:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 826 00002000:00100000:2.0:1746066746.637546:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2416640->2420735) req@ffff880095ced500 x1830882982913408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.637553:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced500 with x1830882982913408 ext(2416640->2420735) 00010000:00010000:2.0:1746066746.637557:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.637566:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00002000:00010000:2.0:1746066746.637572:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ced500 00000100:00100000:0.0:1746066746.645096:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.645200:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982913664 00000100:00100000:1.0:1746066746.645210:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982913664 00002000:00100000:1.0:1746066746.645258:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2138112->2420735) req@ffff880095ced880 x1830882982913664/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.645268:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced880 with x1830882982913664 ext(2138112->2420735) 00010000:00010000:1.0:1746066746.645277:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:1.0:1746066746.645291:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 41 pid: 3528 timeout: 814 lvb_type: 0 00002000:00010000:1.0:1746066746.645297:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ced880 00000100:00100000:1.0:1746066746.645370:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 827 00000100:00100000:1.0:1746066746.645379:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882982913664:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066746.655240:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982913664:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9850us (10143us total) trans 17179874271 rc 0/0 00000100:00100000:0.0:1746066746.655253:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 827 00002000:00100000:0.0:1746066746.655265:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2138112->2420735) req@ffff880095ced880 x1830882982913664/t17179874271(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.655274:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced880 with x1830882982913664 ext(2138112->2420735) 00010000:00010000:0.0:1746066746.655285:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 43 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:0.0:1746066746.655301:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 43 pid: 3528 timeout: 814 lvb_type: 0 00002000:00010000:0.0:1746066746.655308:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ced880 00000100:00100000:0.0:1746066746.660680:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.661072:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982913792 00000100:00100000:2.0:1746066746.661082:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982913792 00010000:00010000:2.0:1746066746.662065:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 43 pid: 3528 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.662111:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6755 00000100:00100000:2.0:1746066746.662122:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882982913792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.662137:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.662159:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 43 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.662171:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 43 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.662196:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa548b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2138112->2420735) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d056f expref: 43 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.662231:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.662234:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.662242:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.662251:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.662291:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.662304:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984317696:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066746.662409:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.670746:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984317696:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066746.670773:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.670824:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882982913792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8704us (10166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.670836:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6755 00000100:00100000:1.0:1746066746.673217:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.673281:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982914048 00000100:00100000:0.0:1746066746.673291:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982914048 00002000:00100000:0.0:1746066746.673336:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012c8bbb80 x1830882982914048/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.673346:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bbb80 with x1830882982914048 ext(2097152->4194303) 00002000:00010000:0.0:1746066746.673353:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8bbb80 00000100:00100000:0.0:1746066746.673816:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3863 00000100:00100000:0.0:1746066746.673825:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982914048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.686192:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982914048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12356us (12971us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066746.686204:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3863 00002000:00100000:2.0:1746066746.686214:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012c8bbb80 x1830882982914048/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.686223:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bbb80 with x1830882982914048 ext(2097152->4194303) 00002000:00010000:2.0:1746066746.686230:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8bbb80 00000100:00100000:0.0:1746066746.717243:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.717450:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982914176 00000100:00100000:3.0:1746066746.717461:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982914176 00000100:00100000:3.0:1746066746.717679:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15140 00000100:00100000:3.0:1746066746.717689:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882982914176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.717711:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.717731:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d057d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.717764:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.717766:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.717776:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 43 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.717792:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 43 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.717803:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c400, rc 0) 00000100:00100000:3.0:1746066746.720249:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882982914176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2547us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.720260:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15140 00000100:00100000:2.0:1746066746.722232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.722283:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.722351:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982914560 00000100:00100000:3.0:1746066746.722362:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982914560 00000100:00100000:3.0:1746066746.722407:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982914688 00000100:00100000:3.0:1746066746.722409:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982914688 00000100:00100000:3.0:1746066746.722421:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15141 00000100:00100000:3.0:1746066746.722427:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882982914560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.722447:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.722464:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0584 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.722487:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.722489:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.722497:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 45 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.722516:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 45 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.722526:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:3.0:1746066746.722566:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882982914560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 138us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.722571:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15141 00000100:00100000:3.0:1746066746.722583:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15142 00000100:00100000:3.0:1746066746.722586:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882982914688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.722591:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.722596:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d058b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.722604:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.722605:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.722608:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 45 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.722615:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 45 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.722621:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155ce00, rc 0) 00000100:00100000:3.0:1746066746.722630:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882982914688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 44us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.722634:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15142 00000100:00100000:1.0:1746066746.725285:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.725366:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982914432 00000100:00100000:2.0:1746066746.725376:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982914432 00002000:00100000:2.0:1746066746.725421:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958a4a80 x1830882982914432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.725432:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4a80 with x1830882982914432 ext(4194304->5033983) 00002000:00010000:2.0:1746066746.725438:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4a80 00000100:00100000:2.0:1746066746.725465:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3864 00000100:00100000:2.0:1746066746.725472:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982914432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066746.741935:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.742193:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982914432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16718us (16914us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066746.742204:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3864 00002000:00100000:3.0:1746066746.742218:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958a4a80 x1830882982914432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.742227:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4a80 with x1830882982914432 ext(4194304->5033983) 00002000:00010000:3.0:1746066746.742234:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4a80 00000100:00100000:2.0:1746066746.742304:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982914816 00000100:00100000:2.0:1746066746.742313:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982914816 00000100:00100000:2.0:1746066746.742353:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15143 00000100:00100000:2.0:1746066746.742360:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:32685:x1830882982914816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066746.742376:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.742392:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0592 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.742420:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 18 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.742428:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 11 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.742434:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.742435:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.742438:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [761856->1048575] (req 761856->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.742465:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 11 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.742474:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 11 pid: 20361 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066746.742484:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984317824:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.742549:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 18 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.742556:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 18 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.742564:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984317952:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.742646:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.746825:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.746860:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984317824:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.746871:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984317952:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066746.746875:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066746.746937:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [761856->1048575] (req 761856->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.746957:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59c00, rc 0) 00000100:00100000:3.0:1746066746.746991:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982914944 00000100:00100000:3.0:1746066746.746998:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982914944 00000100:00100000:2.0:1746066746.747009:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:32685:x1830882982914816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4648us (5083us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.747017:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15143 00010000:00010000:3.0:1746066746.747036:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 11 pid: 20361 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066746.747056:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982915072 00000100:00100000:3.0:1746066746.747058:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982915072 00010000:00010000:3.0:1746066746.747067:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 19 pid: 1893 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.747068:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6756 00000100:00100000:2.0:1746066746.747076:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882982914944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066746.747081:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6757 00000100:00100000:3.0:1746066746.747085:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882982915072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.747091:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066746.747094:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.747111:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 11 pid: 20361 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066746.747112:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 19 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.747121:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 19 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.747838:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 11 pid: 20361 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066746.747865:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa53b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d049d expref: 19 pid: 1893 timeout: 814 lvb_type: 0 00010000:00010000:2.0:1746066746.747868:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa53ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d04b2 expref: 11 pid: 20361 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066746.747914:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.747917:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.747927:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.747934:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.747966:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.747978:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984318080:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066746.748475:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.749848:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882982914944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2764us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.749860:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6756 00000100:00100000:3.0:1746066746.750211:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.751090:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.751881:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.752293:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.752350:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982915200 00000100:00100000:1.0:1746066746.752359:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982915200 00000100:00100000:1.0:1746066746.752403:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15144 00000100:00100000:1.0:1746066746.752410:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982915200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066746.752431:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066746.752450:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa54b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0599 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.752505:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984318208:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066746.752572:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.752717:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982915456 00000100:00100000:0.0:1746066746.752721:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982915456 00002000:00100000:0.0:1746066746.752754:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130d88380 x1830882982915456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.752764:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88380 with x1830882982915456 ext(1048576->2097151) 00002000:00010000:0.0:1746066746.752769:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d88380 00000100:00100000:0.0:1746066746.753490:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982915584 00000100:00100000:0.0:1746066746.753494:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982915584 00002000:00100000:0.0:1746066746.753511:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009c7ffb80 x1830882982915584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.753518:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ffb80 with x1830882982915584 ext(1048576->2097151) 00002000:00010000:0.0:1746066746.753521:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ffb80 00000100:00100000:3.0:1746066746.754990:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3865 00000100:00100000:3.0:1746066746.755010:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3866 00000100:00100000:3.0:1746066746.755019:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882982915584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.755227:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984318080:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066746.755245:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066746.755254:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.755269:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982915968 00000100:00100000:0.0:1746066746.755273:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982915968 00002000:00010000:1.0:1746066746.755346:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066746 -> 1746066747 00002000:00010000:1.0:1746066746.755349:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066746 -> 1746066747 00002000:00010000:1.0:1746066746.755351:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746066746 -> 1746066747 00000100:00100000:1.0:1746066746.755367:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984318208:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066746.755395:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa54b5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0599 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066746.755406:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa54b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0599 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066746.755424:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419200, rc 0) 00000100:00100000:2.0:1746066746.755725:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982915456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.755852:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882982915072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8764us (8975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.755862:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6757 00000100:00100000:1.0:1746066746.756421:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982915200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4010us (5332us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066746.756427:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15144 00002000:00100000:0.0:1746066746.756725:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (761856->765951) req@ffff880095ceed80 x1830882982915968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.756734:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceed80 with x1830882982915968 ext(761856->765951) 00002000:00010000:0.0:1746066746.756739:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceed80 00000100:00100000:0.0:1746066746.756788:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3867 00000100:00100000:0.0:1746066746.756795:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982915968:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066746.756869:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982915968:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 75us (1615us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066746.756874:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3867 00002000:00100000:0.0:1746066746.756879:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (761856->765951) req@ffff880095ceed80 x1830882982915968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.756898:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceed80 with x1830882982915968 ext(761856->765951) 00002000:00010000:0.0:1746066746.756900:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceed80 00000100:00100000:3.0:1746066746.771263:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982915584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16235us (18957us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066746.771275:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3866 00002000:00100000:3.0:1746066746.771289:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009c7ffb80 x1830882982915584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.771299:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ffb80 with x1830882982915584 ext(1048576->2097151) 00002000:00010000:3.0:1746066746.771306:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ffb80 00000100:00100000:0.0:1746066746.778046:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.779974:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982916096 00000100:00100000:2.0:1746066746.779993:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982916096 00000100:00100000:2.0:1746066746.780057:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15145 00000100:00100000:2.0:1746066746.780066:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:32685:x1830882982916096:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066746.780086:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.780105:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05a0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.780361:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882982915456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25360us (28480us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066746.780375:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3865 00002000:00100000:1.0:1746066746.780385:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130d88380 x1830882982915456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.780394:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88380 with x1830882982915456 ext(1048576->2097151) 00002000:00010000:1.0:1746066746.780399:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d88380 00010000:00010000:2.0:1746066746.780579:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.780588:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 44 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.780595:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.780597:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.780600:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1716223] (req 1048576->1716223) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.780639:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 44 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.780653:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 44 pid: 3528 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066746.780672:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984318336:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.780749:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.780756:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 31 pid: 3528 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.780764:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984318464:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.780783:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.794180:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.794219:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.794260:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982916224 00000100:00100000:1.0:1746066746.794270:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982916224 00010000:00010000:1.0:1746066746.794308:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 32 pid: 3528 timeout: 814 lvb_type: 0 00000100:00100000:1.0:1746066746.794509:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982916352 00000100:00100000:1.0:1746066746.794512:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982916352 00010000:00010000:1.0:1746066746.794524:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 45 pid: 3528 timeout: 814 lvb_type: 1 00000100:00100000:3.0:1746066746.794553:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6758 00000100:00100000:3.0:1746066746.794564:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982916224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066746.794579:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066746.794599:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 32 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.794609:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 32 pid: 3528 timeout: 814 lvb_type: 0 00010000:00010000:3.0:1746066746.794637:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066746.794689:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982916224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 127us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.794694:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6758 00000100:00100000:3.0:1746066746.794712:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6759 00000100:00100000:3.0:1746066746.794716:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882982916352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066746.794722:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066746.794728:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 45 pid: 3528 timeout: 814 lvb_type: 1 00010000:00010000:3.0:1746066746.794736:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 45 pid: 3528 timeout: 814 lvb_type: 1 00000100:00100000:2.0:1746066746.794747:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984318336:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.794751:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5499 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d057d expref: 45 pid: 3528 timeout: 814 lvb_type: 1 00010000:00010000:2.0:1746066746.794757:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa547d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0561 expref: 31 pid: 3528 timeout: 814 lvb_type: 0 00000100:00100000:2.0:1746066746.794764:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984318464:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.794765:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.794767:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.794773:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.794780:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.794797:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.794809:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0da00, rc 0) 00010000:00010000:3.0:1746066746.794810:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.794821:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984318592:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066746.794830:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:32685:x1830882982916096:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 14767us (16796us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.794836:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15145 00000100:00100000:3.0:1746066746.794861:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.795989:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28b87956-2543-42c1-b799-d011d2dfefc7:3777:1830882984318848:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796030:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066746.796042:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984318976:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796060:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984319360:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796069:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796076:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066746.796084:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3774:1830882984319488:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796085:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3777:1830882984319872:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796100:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066746.796103:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3775:1830882984319104:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796113:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3777:1830882984320384:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796119:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796128:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066746.796131:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3775:1830882984319616:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796140:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1746066746.796143:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796144:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984318720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746066746.796155:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984320128:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796158:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796169:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800967a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984319232:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796169:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796185:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066746.796192:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984318976 00000100:00100000:2.0:1746066746.796195:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882984319744:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796196:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984318976 00000100:00100000:2.0:1746066746.796211:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066746.796217:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984318720 00000100:00100000:1.0:1746066746.796219:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984318720 00000100:00100000:2.0:1746066746.796221:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984320256:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796227:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1746066746.796232:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3774:x1830882984318976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796236:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796254:0:8138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984318848 00000100:00100000:2.0:1746066746.796257:0:8138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984318848 00000100:00100000:1.0:1746066746.796265:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3774:x1830882984318976:12345-0@lo:400:kworker.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.796269:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1746066746.796276:0:8138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1746066746.796278:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1746066746.796280:0:8138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28b87956-2543-42c1-b799-d011d2dfefc7+23:3777:x1830882984318848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796281:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882984318720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746066746.796302:0:11960:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445662720 avail 1316200448 00000100:00100000:2.0:1746066746.796304:0:8138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28b87956-2543-42c1-b799-d011d2dfefc7+23:3777:x1830882984318848:12345-0@lo:400:kworker.0 Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.796308:0:8138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1746066746.796322:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882984318720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.796326:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984319872 00000100:00100000:1.0:1746066746.796327:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1746066746.796328:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984319872 00000100:00100000:1.0:1746066746.796340:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984319104 00000100:00100000:1.0:1746066746.796342:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984319104 00000100:00100000:2.0:1746066746.796351:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984319616 00000100:00100000:1.0:1746066746.796351:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984320384 00000100:00100000:2.0:1746066746.796353:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984319616 00000100:00100000:1.0:1746066746.796353:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984320384 00000100:00100000:1.0:1746066746.796358:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984319744 00000100:00100000:1.0:1746066746.796360:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984319744 00000100:00100000:2.0:1746066746.796363:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1746066746.796367:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3777:x1830882984319872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796369:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1746066746.796372:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3775:x1830882984319104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796388:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3777:x1830882984319872:12345-0@lo:400:kworker.0 Request processed in 20us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.796389:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3775:x1830882984319104:12345-0@lo:400:kworker.0 Request processed in 17us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.796392:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1746066746.796394:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1746066746.796400:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1746066746.796402:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1746066746.796403:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3777:x1830882984320384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796405:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3775:x1830882984319616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796420:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3777:x1830882984320384:12345-0@lo:400:kworker.0 Request processed in 17us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.796420:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3775:x1830882984319616:12345-0@lo:400:kworker.0 Request processed in 14us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.796424:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1746066746.796426:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1746066746.796431:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1746066746.796434:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984319744:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1746066746.796445:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746066746.796448:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746066746.796450:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984319744:12345-0@lo:400:kworker.0 Request processed in 16us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.796454:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1746066746.796466:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984318720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746066746.796468:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796474:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882984319744:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796478:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984320000:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796481:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3777:1830882984319872:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796487:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3777:1830882984320384:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796492:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.796493:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28b87956-2543-42c1-b799-d011d2dfefc7:3777:1830882984318848:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796506:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984318976:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796517:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984320000 00000100:00100000:1.0:1746066746.796517:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984319488 00000100:00100000:2.0:1746066746.796519:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984320000 00000100:00100000:1.0:1746066746.796519:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984319488 00000100:00100000:2.0:1746066746.796533:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1746066746.796534:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1746066746.796537:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882984320000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.796537:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882984319488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796558:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882984320000:12345-0@lo:400:kworker.0 Request processed in 21us (66us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.796558:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882984319488:12345-0@lo:400:kworker.0 Request processed in 20us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.796562:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1746066746.796563:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:2.0:1746066746.796571:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066746.796577:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984319360 00000100:00100000:1.0:1746066746.796578:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3775:1830882984319104:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796579:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984319360 00000100:00100000:1.0:1746066746.796584:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3775:1830882984319616:0@lo:400:kworker.0 00000100:00080000:2.0:1746066746.796589:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066746.796599:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3774:1830882984319488:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796601:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984320128 00000100:00100000:2.0:1746066746.796603:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984320128 00000100:00100000:1.0:1746066746.796608:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984320000:0@lo:400:kworker.0 00000100:00080000:2.0:1746066746.796610:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066746.796622:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984319232 00000100:00100000:2.0:1746066746.796624:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984319232 00000100:00100000:1.0:1746066746.796624:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984320256 00000100:00100000:1.0:1746066746.796625:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984320256 00000100:00100000:2.0:1746066746.796639:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1746066746.796643:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984319360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796679:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984319360:12345-0@lo:400:kworker.0 Request processed in 35us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.796684:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1746066746.796691:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1746066746.796695:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984320128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796715:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984320128:12345-0@lo:400:kworker.0 Request processed in 20us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.796719:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1746066746.796726:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1746066746.796729:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984319232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796743:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984319232:12345-0@lo:400:kworker.0 Request processed in 14us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.796747:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1746066746.796878:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1746066746.796897:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984320256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.796914:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984320256:12345-0@lo:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.796919:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1746066746.797241:0:3775:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841682 gen 2 00000004:00080000:1.0:1746066746.797246:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098925180, transno 21474841612 00000004:00080000:1.0:1746066746.797251:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098927480, transno 21474841613 00000004:00080000:1.0:1746066746.797254:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098924380, transno 21474841614 00000004:00080000:1.0:1746066746.797256:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098924e00, transno 21474841615 00000004:00080000:1.0:1746066746.797258:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098927b80, transno 21474841616 00000004:00080000:1.0:1746066746.797259:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098926d80, transno 21474841617 00000004:00080000:1.0:1746066746.797262:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a89c00, transno 21474841618 00000004:00080000:1.0:1746066746.797264:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5ce00, transno 21474841619 00000004:00080000:1.0:1746066746.797266:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5c700, transno 21474841620 00000004:00080000:1.0:1746066746.797267:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5f480, transno 21474841621 00000004:00080000:1.0:1746066746.797269:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5c380, transno 21474841622 00000004:00080000:1.0:1746066746.797271:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5d880, transno 21474841623 00000004:00080000:1.0:1746066746.797273:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5d500, transno 21474841624 00000004:00080000:1.0:1746066746.797275:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5ca80, transno 21474841625 00000004:00080000:1.0:1746066746.797277:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5e300, transno 21474841626 00000004:00080000:1.0:1746066746.797279:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5fb80, transno 21474841627 00000004:00080000:1.0:1746066746.797280:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5c000, transno 21474841628 00000004:00080000:1.0:1746066746.797282:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677d880, transno 21474841629 00000004:00080000:1.0:1746066746.797283:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677d180, transno 21474841632 00000004:00080000:1.0:1746066746.797285:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677d500, transno 21474841633 00000004:00080000:1.0:1746066746.797286:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677ed80, transno 21474841634 00000004:00080000:1.0:1746066746.797288:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677ca80, transno 21474841635 00000004:00080000:1.0:1746066746.797290:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677e300, transno 21474841636 00000004:00080000:1.0:1746066746.797292:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677fb80, transno 21474841637 00000004:00080000:1.0:1746066746.797295:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0d880, transno 21474841638 00000004:00080000:1.0:1746066746.797297:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677c380, transno 21474841639 00000004:00080000:1.0:1746066746.797299:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098924a80, transno 21474841640 00000004:00080000:1.0:1746066746.797301:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb75c00, transno 21474841645 00000004:00080000:1.0:1746066746.797302:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb77480, transno 21474841646 00000004:00080000:1.0:1746066746.797304:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e421180, transno 21474841647 00000004:00080000:1.0:1746066746.797306:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb75180, transno 21474841648 00000004:00080000:1.0:1746066746.797308:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb77800, transno 21474841649 00000004:00080000:1.0:1746066746.797310:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb75f80, transno 21474841650 00000004:00080000:1.0:1746066746.797313:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e422300, transno 21474841651 00000004:00080000:1.0:1746066746.797315:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d89180, transno 21474841652 00000004:00080000:1.0:1746066746.797317:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb75880, transno 21474841653 00000004:00080000:1.0:1746066746.797319:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbd500, transno 21474841654 00000004:00080000:1.0:1746066746.797321:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbc700, transno 21474841655 00000004:00080000:1.0:1746066746.797551:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbe300, transno 21474841656 00000004:00080000:1.0:1746066746.797555:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbce00, transno 21474841657 00000004:00080000:1.0:1746066746.797557:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbfb80, transno 21474841658 00000004:00080000:1.0:1746066746.797560:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbf100, transno 21474841659 00000004:00080000:1.0:1746066746.797561:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbf800, transno 21474841660 00000004:00080000:1.0:1746066746.797563:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbc000, transno 21474841661 00000004:00080000:1.0:1746066746.797565:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7fce00, transno 21474841662 00000004:00080000:1.0:1746066746.797567:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ad180, transno 21474841664 00000004:00080000:1.0:1746066746.797569:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098926a00, transno 21474841665 00000004:00080000:1.0:1746066746.797571:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ad500, transno 21474841666 00000004:00080000:1.0:1746066746.797573:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958af100, transno 21474841667 00000004:00080000:1.0:1746066746.797575:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbdc00, transno 21474841668 00000004:00080000:1.0:1746066746.797577:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ac380, transno 21474841669 00000004:00080000:1.0:1746066746.797579:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ace00, transno 21474841670 00000004:00080000:1.0:1746066746.797581:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958adf80, transno 21474841671 00000004:00080000:1.0:1746066746.797583:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f766d80, transno 21474841672 00000004:00080000:1.0:1746066746.797586:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80380, transno 21474841674 00000004:00080000:1.0:1746066746.797588:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83b80, transno 21474841675 00000004:00080000:1.0:1746066746.797590:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83800, transno 21474841676 00000004:00080000:1.0:1746066746.797592:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce04700, transno 21474841677 00000004:00080000:1.0:1746066746.797594:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83480, transno 21474841678 00000004:00080000:1.0:1746066746.797596:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80000, transno 21474841679 00000004:00080000:1.0:1746066746.797597:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce04a80, transno 21474841680 00000004:00080000:1.0:1746066746.797599:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce07b80, transno 21474841681 00000004:00080000:1.0:1746066746.797601:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce06300, transno 21474841682 00000100:00100000:1.0:1746066746.797605:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984320128:0@lo:400:kworker.0 00000100:00100000:1.0:1746066746.797614:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746066746.797618:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984320512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746066746.797636:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1746066746.797692:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746066746.797695:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066746.797710:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800967a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984319232:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.797718:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984320256:0@lo:400:kworker.0 00000100:00100000:2.0:1746066746.797725:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984319360:0@lo:400:kworker.0 00000004:00080000:2.0:1746066746.798035:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 63 done 00000100:00100000:2.0:1746066746.798315:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984320512 00000100:00100000:2.0:1746066746.798318:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984320512 00000100:00100000:2.0:1746066746.798340:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1746066746.798345:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984320512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746066746.798364:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:2.0:1746066746.798391:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984320512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.798396:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1746066746.798497:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984320512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746066746.804270:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984318592:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066746.804294:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066746.804353:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882982916352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9634us (10132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.804365:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6759 00000100:00100000:0.0:1746066746.806355:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.806438:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982916608 00000100:00100000:1.0:1746066746.806446:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982916608 00002000:00100000:1.0:1746066746.806489:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095cef480 x1830882982916608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066746.806499:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef480 with x1830882982916608 ext(2097152->4194303) 00002000:00010000:1.0:1746066746.806504:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef480 00000100:00100000:0.0:1746066746.807471:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.807631:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982916864 00000100:00100000:3.0:1746066746.807636:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982916864 00002000:00100000:3.0:1746066746.807673:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095cef800 x1830882982916864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.807688:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef800 with x1830882982916864 ext(2097152->4194303) 00002000:00010000:3.0:1746066746.807693:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cef800 00000100:00100000:3.0:1746066746.807708:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3868 00000100:00100000:3.0:1746066746.807716:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882982916608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.809141:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3869 00000100:00100000:3.0:1746066746.809149:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882982916864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.810497:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.810535:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.810573:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982917248 00000100:00100000:2.0:1746066746.810579:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982917248 00000100:00100000:2.0:1746066746.810612:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15146 00000100:00100000:2.0:1746066746.810618:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:32693:x1830882982917248:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066746.810630:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.810649:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05a7 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.810693:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.810702:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 47 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.810708:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.810710:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066746.810713:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1835008->2097151] (req 1835008->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 47 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.810744:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 47 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.810755:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 47 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1746066746.810768:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984320640:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066746.810831:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.810840:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 29 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066746.810849:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984320768:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066746.810866:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.811975:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982917120 00000100:00100000:0.0:1746066746.811980:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982917120 00002000:00100000:0.0:1746066746.812011:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1712128->1716223) req@ffff880096ec9500 x1830882982917120/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066746.812020:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9500 with x1830882982917120 ext(1712128->1716223) 00002000:00010000:0.0:1746066746.812025:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9500 00000100:00100000:0.0:1746066746.812040:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3870 00000100:00100000:0.0:1746066746.812045:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982917120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066746.812154:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882982917120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 107us (1660us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066746.812160:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3870 00002000:00100000:2.0:1746066746.812166:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1712128->1716223) req@ffff880096ec9500 x1830882982917120/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.812172:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9500 with x1830882982917120 ext(1712128->1716223) 00002000:00010000:2.0:1746066746.812175:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9500 00000100:00100000:2.0:1746066746.813566:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984320896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746066746.813617:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066746.818233:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984320896 00000100:00100000:0.0:1746066746.818248:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984320896 00000100:00100000:0.0:1746066746.818311:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1746066746.818319:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984320896:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746066746.818338:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984320640:192.168.204.16@tcp:104: 00002000:00000024:0.0:1746066746.818349:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1080977856 pending 368640 free 3906453504 avail 3666493440 00000100:00100000:2.0:1746066746.818383:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.818384:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984320768:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066746.818405:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984320896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066746.818411:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00010000:00010000:3.0:1746066746.818419:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1835008->2097151] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 47 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.818426:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984320896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1746066746.818436:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0a800, rc 0) 00000100:00100000:2.0:1746066746.818456:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982917376 00000100:00100000:2.0:1746066746.818458:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982917376 00000100:00100000:3.0:1746066746.818471:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:32693:x1830882982917248:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7853us (7935us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066746.818478:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 30 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.818479:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15146 00000100:00100000:2.0:1746066746.818498:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6760 00000100:00100000:2.0:1746066746.818504:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982917376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.818513:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.818534:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 30 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.818544:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 30 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.818567:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d000/0xf1867c21abfa5484 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0568 expref: 30 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.818580:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.818598:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882982917376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.818604:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6760 00000100:00100000:2.0:1746066746.826087:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.826319:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982917504 00000100:00100000:1.0:1746066746.826329:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982917504 00010000:00010000:1.0:1746066746.826368:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 47 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746066746.826406:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6761 00000100:00100000:1.0:1746066746.826414:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882982917504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.826428:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.826449:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 47 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746066746.826461:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 47 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746066746.826485:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa54a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0584 expref: 47 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746066746.826517:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.826519:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.826527:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.826535:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.826576:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.826590:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984321024:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.826681:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.826972:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882982916608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19254us (20623us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066746.826981:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3868 00002000:00100000:3.0:1746066746.826991:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095cef480 x1830882982916608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.826999:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef480 with x1830882982916608 ext(2097152->4194303) 00002000:00010000:3.0:1746066746.827003:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef480 00000100:00100000:0.0:1746066746.834452:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.834727:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984321024:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.835497:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066746.835933:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982917760 00000100:00100000:3.0:1746066746.835941:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982917760 00000100:00100000:1.0:1746066746.835978:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882982917504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9563us (9900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.835990:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6761 00002000:00100000:3.0:1746066746.835994:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1835008->1839103) req@ffff880095cefb80 x1830882982917760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.836003:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cefb80 with x1830882982917760 ext(1835008->1839103) 00002000:00010000:3.0:1746066746.836008:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cefb80 00000100:00100000:3.0:1746066746.836113:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3871 00000100:00100000:3.0:1746066746.836120:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982917760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066746.836250:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982917760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 129us (1808us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066746.836256:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3871 00002000:00100000:3.0:1746066746.836261:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1835008->1839103) req@ffff880095cefb80 x1830882982917760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.836268:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cefb80 with x1830882982917760 ext(1835008->1839103) 00002000:00010000:3.0:1746066746.836270:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cefb80 00000100:00100000:3.0:1746066746.840462:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882982916864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 31303us (32982us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066746.840475:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3869 00002000:00100000:3.0:1746066746.840487:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095cef800 x1830882982916864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.840497:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef800 with x1830882982916864 ext(2097152->4194303) 00002000:00010000:3.0:1746066746.840503:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cef800 00000100:00100000:0.0:1746066746.842619:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.842922:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982917888 00000100:00100000:3.0:1746066746.842931:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982917888 00000100:00100000:3.0:1746066746.842985:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15147 00000100:00100000:3.0:1746066746.842993:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+18:32693:x1830882982917888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066746.843014:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.843032:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05ae expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.843063:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.843072:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.843078:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.843080:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.843083:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1191935] (req 1048576->1191935) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.843114:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.843127:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 9 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.843140:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984321152:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.843238:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.843245:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 19 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.843258:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984321280:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.843275:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.844164:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984321408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066746.844202:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066746.846005:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984321408 00000100:00100000:2.0:1746066746.846015:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984321408 00000100:00100000:2.0:1746066746.846066:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1746066746.846074:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984321408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746066746.846103:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1068416320 pending 9359360 free 3912097792 avail 3680575488 00000100:00100000:2.0:1746066746.846167:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984321408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.846173:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1746066746.846361:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984321408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746066746.846588:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984321152:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.846597:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984321280:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.846619:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1191935] (req 1048576->1191935) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.846634:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea4c00, rc 0) 00000100:00100000:3.0:1746066746.846840:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:32693:x1830882982917888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3847us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.846847:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15147 00000100:00100000:0.0:1746066746.849926:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.850047:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982918016 00000100:00100000:2.0:1746066746.850057:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982918016 00010000:00010000:2.0:1746066746.850096:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 19 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066746.850128:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6762 00000100:00100000:2.0:1746066746.850135:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882982918016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066746.850150:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066746.850173:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 19 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.850184:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 19 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.850208:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155dc00/0xf1867c21abfa537a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d045e expref: 19 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.850227:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.850280:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882982918016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 145us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066746.850286:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6762 00000100:00100000:2.0:1746066746.855005:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.855255:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982918144 00000100:00100000:0.0:1746066746.855266:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982918144 00010000:00010000:0.0:1746066746.855302:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 10 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746066746.855336:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6763 00000100:00100000:0.0:1746066746.855344:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882982918144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066746.855357:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066746.855376:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 10 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066746.855389:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 10 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066746.855411:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa5381 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0465 expref: 10 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066746.855429:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066746.855431:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066746.855439:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066746.855452:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066746.855505:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066746.855515:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984321536:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066746.855591:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.855936:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.855959:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.855977:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.855996:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982918272 00000100:00100000:3.0:1746066746.855999:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982918272 00000100:00100000:3.0:1746066746.856025:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982918400 00000100:00100000:3.0:1746066746.856027:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982918400 00000100:00100000:3.0:1746066746.856039:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982918528 00000100:00100000:3.0:1746066746.856042:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982918528 00000100:00100000:3.0:1746066746.856054:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15148 00000100:00100000:3.0:1746066746.856059:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882982918272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.856074:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.856086:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa54d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05b5 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.856118:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984321664:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066746.856153:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.856166:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15149 00000100:00100000:3.0:1746066746.856171:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982918400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.856179:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.856188:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa54d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05bc expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.856213:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984321792:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066746.856231:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.856361:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15150 00000100:00100000:1.0:1746066746.856368:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882982918528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066746.856375:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066746.856382:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa54df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05c3 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.856404:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984321920:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066746.856430:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.861610:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.861637:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982918784 00000100:00100000:3.0:1746066746.861646:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982918784 00002000:00100000:3.0:1746066746.861705:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1187840->1191935) req@ffff880094305500 x1830882982918784/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.861716:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830882982918784 ext(1187840->1191935) 00002000:00010000:3.0:1746066746.861721:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305500 00000100:00100000:3.0:1746066746.861743:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3872 00000100:00100000:3.0:1746066746.861751:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982918784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066746.861921:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982918784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 169us (322us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066746.861928:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3872 00002000:00100000:3.0:1746066746.861933:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1187840->1191935) req@ffff880094305500 x1830882982918784/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.861941:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830882982918784 ext(1187840->1191935) 00002000:00010000:3.0:1746066746.861944:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305500 00000100:00100000:3.0:1746066746.862001:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984321792:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.862031:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa54d8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05bc expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.862043:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa54d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05bc expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.862058:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9e00, rc 0) 00000100:00100000:3.0:1746066746.862098:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982918400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5926us (6138us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066746.862104:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15149 00000100:00100000:2.0:1746066746.862397:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984321664:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066746.862416:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa54d1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05b5 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.862425:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa54d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05b5 expref: 21 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.862442:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5600, rc 0) 00000100:00100000:2.0:1746066746.862474:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882982918272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6415us (6539us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.862480:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15148 00000100:00100000:0.0:1746066746.862556:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984321536:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066746.862567:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066746.862587:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+9:2014:x1830882982918144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7244us (7594us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066746.862596:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6763 00002000:00010000:1.0:1746066746.862809:0:13363:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066746 -> 1746066747 00002000:00010000:1.0:1746066746.862813:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066746 -> 1746066747 00002000:00010000:1.0:1746066746.862815:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066746 -> 1746066747 00000100:00100000:1.0:1746066746.862822:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984321920:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066746.862841:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa54df lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05c3 expref: 19 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066746.862849:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa54df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05c3 expref: 19 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066746.862860:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a200, rc 0) 00000100:00100000:1.0:1746066746.862878:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882982918528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6511us (6900us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066746.862906:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15150 00000100:00100000:0.0:1746066746.865600:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.865839:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982918912 00000100:00100000:1.0:1746066746.865848:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982918912 00000100:00100000:1.0:1746066746.867072:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15151 00000100:00100000:1.0:1746066746.867083:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882982918912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066746.867106:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066746.867125:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfa54e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05ca expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.867185:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984322048:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066746.867274:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.868376:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.868418:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982919040 00000100:00100000:2.0:1746066746.868424:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982919040 00000100:00100000:2.0:1746066746.868457:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15152 00000100:00100000:2.0:1746066746.868461:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982919040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066746.868469:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.868478:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5992a00/0xf1867c21abfa54ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05d1 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.868503:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984322176:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066746.868546:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.870205:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984322048:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066746.870239:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfa54e6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ca expref: 19 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066746.870250:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b000/0xf1867c21abfa54e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ca expref: 19 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066746.870260:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b000, rc 0) 00000100:00100000:1.0:1746066746.870294:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882982918912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3212us (4706us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066746.870301:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15151 00000100:00100000:2.0:1746066746.873475:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984322176:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066746.873513:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992a00/0xf1867c21abfa54ed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05d1 expref: 45 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.873526:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992a00/0xf1867c21abfa54ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05d1 expref: 45 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.873559:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992a00, rc 0) 00000100:00100000:2.0:1746066746.873606:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982919040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5142us (5230us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.873618:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15152 00000100:00100000:0.0:1746066746.876866:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.876956:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.879122:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982919168 00000100:00100000:2.0:1746066746.879135:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982919168 00000100:00100000:2.0:1746066746.879192:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982919296 00000100:00100000:2.0:1746066746.879195:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982919296 00000100:00100000:2.0:1746066746.879219:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15153 00000100:00100000:2.0:1746066746.879227:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+18:2014:x1830882982919168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066746.879247:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.879264:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa54f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05d8 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.879299:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15154 00000100:00100000:3.0:1746066746.879306:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982919296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.879314:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066746.879323:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984322304:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.879324:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa54fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05df expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.879346:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984322432:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066746.880195:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.880195:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.886334:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984322304:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066746.886374:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa54f4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05d8 expref: 19 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.886388:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa54f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05d8 expref: 19 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066746.886648:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984322432:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.886679:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa54fb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05df expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.886689:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa54fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05df expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.886705:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9e00, rc 0) 00000100:00100000:3.0:1746066746.886794:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882982919296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7486us (9835us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066746.886804:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15154 00010000:00010000:2.0:1746066746.887463:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993c00, rc 0) 00000100:00100000:2.0:1746066746.887497:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+18:2014:x1830882982919168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8270us (10640us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.887503:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15153 00000100:00100000:0.0:1746066746.892246:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.892290:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.892759:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982919424 00000100:00100000:2.0:1746066746.892770:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982919424 00000100:00100000:3.0:1746066746.892775:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982919552 00000100:00100000:3.0:1746066746.892778:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982919552 00000100:00100000:2.0:1746066746.893743:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15155 00000100:00100000:3.0:1746066746.893749:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15156 00000100:00100000:2.0:1746066746.893752:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882982919424:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066746.893753:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882982919552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.893772:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066746.893772:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.893788:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5509 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05ed expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066746.893788:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5992800/0xf1867c21abfa5502 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05e6 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066746.893839:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984322560:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066746.893839:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984322688:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066746.893923:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.894154:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066746.895277:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984322688:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066746.895305:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992800/0xf1867c21abfa5502 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05e6 expref: 30 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.895316:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992800/0xf1867c21abfa5502 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05e6 expref: 30 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066746.895326:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992800, rc 0) 00000100:00100000:2.0:1746066746.895367:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882982919424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1616us (3129us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066746.895373:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15155 00000100:00100000:3.0:1746066746.899045:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984322560:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066746.899082:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5509 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ed expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.899095:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5509 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ed expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.899131:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8800, rc 0) 00000100:00100000:3.0:1746066746.899178:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882982919552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5422us (6885us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066746.899185:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15156 00000100:00100000:0.0:1746066746.912388:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.915427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.915693:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982919936 00000100:00100000:2.0:1746066746.915704:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982919936 00002000:00100000:2.0:1746066746.915753:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1716224->2097151) req@ffff880093ac8380 x1830882982919936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.915762:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8380 with x1830882982919936 ext(1716224->2097151) 00002000:00010000:2.0:1746066746.915768:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac8380 00000100:00100000:2.0:1746066746.915839:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982920064 00000100:00100000:2.0:1746066746.915843:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982920064 00002000:00100000:2.0:1746066746.915859:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->761855) req@ffff880093ac8a80 x1830882982920064/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.915865:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8a80 with x1830882982920064 ext(0->761855) 00002000:00010000:2.0:1746066746.915868:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ac8a80 00000100:00100000:2.0:1746066746.915898:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3873 00000100:00100000:2.0:1746066746.915906:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982919936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066746.916306:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3874 00000100:00100000:0.0:1746066746.916313:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982920064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066746.930258:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982920064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13932us (14827us total) trans 0 rc 761856/761856 00000100:00100000:3.0:1746066746.930272:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3874 00002000:00100000:3.0:1746066746.930285:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->761855) req@ffff880093ac8a80 x1830882982920064/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 761856/761856 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066746.930294:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8a80 with x1830882982920064 ext(0->761855) 00002000:00010000:3.0:1746066746.930301:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ac8a80 00000100:00100000:2.0:1746066746.930578:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882982919936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14672us (18200us total) trans 0 rc 380928/380928 00000100:00100000:2.0:1746066746.930585:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3873 00002000:00100000:2.0:1746066746.930590:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1716224->2097151) req@ffff880093ac8380 x1830882982919936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 380928/380928 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.930597:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8380 with x1830882982919936 ext(1716224->2097151) 00002000:00010000:2.0:1746066746.930600:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac8380 00000100:00100000:0.0:1746066746.937703:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.938862:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982920192 00000100:00100000:3.0:1746066746.938874:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982920192 00000100:00100000:3.0:1746066746.939560:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15157 00000100:00100000:3.0:1746066746.939571:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:32700:x1830882982920192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.939592:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.939609:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05f4 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.939640:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 43 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.939648:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.939650:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.939654:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.939718:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 43 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.939730:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 43 pid: 9590 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.939742:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984322816:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.940718:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.946585:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984322816:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066746.946617:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066746.946619:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066746.946688:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982920320 00000100:00100000:2.0:1746066746.946696:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982920320 00002000:00100000:2.0:1746066746.946740:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1835008->2097151) req@ffff880093ac9f80 x1830882982920320/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.946749:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9f80 with x1830882982920320 ext(1835008->2097151) 00010000:00010000:2.0:1746066746.946756:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 44 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.946767:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 44 pid: 9590 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066746.946778:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac9f80 00000100:00100000:2.0:1746066746.946813:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 828 00000100:00100000:2.0:1746066746.946821:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882982920320:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746066746.946904:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9c00, rc 0) 00000100:00100000:3.0:1746066746.946953:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:32700:x1830882982920192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7384us (9261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.946960:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15157 00000100:00100000:2.0:1746066746.956900:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982920320:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8689us (8894us total) trans 17179874272 rc 0/0 00000100:00100000:2.0:1746066746.956915:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 828 00002000:00100000:2.0:1746066746.956929:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1835008->2097151) req@ffff880093ac9f80 x1830882982920320/t17179874272(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:152/0 lens 488/448 e 0 to 0 dl 1746066757 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.956939:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9f80 with x1830882982920320 ext(1835008->2097151) 00010000:00010000:2.0:1746066746.956950:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066746.956966:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066746.956973:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ac9f80 00000100:00100000:0.0:1746066746.969184:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066746.969238:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.969330:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982920576 00000100:00100000:1.0:1746066746.969341:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982920576 00010000:00010000:1.0:1746066746.969380:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.969388:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982920448 00000100:00100000:3.0:1746066746.969393:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982920448 00000100:00100000:1.0:1746066746.969514:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6764 00000100:00100000:1.0:1746066746.969522:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:2013:x1830882982920576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.969539:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.969560:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066746.969572:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066746.969596:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa54c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a7 expref: 46 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066746.969945:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.969947:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.969955:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.969963:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.969998:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.970012:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984322944:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066746.970159:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15158 00000100:00100000:3.0:1746066746.970166:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:32703:x1830882982920448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066746.970182:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.970196:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d05fb expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.970220:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.970228:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.970232:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.970233:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066746.970236:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3416064->3493887] (req 3416064->3493887) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.970253:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066746.970263:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1746066746.970271:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323072:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066746.970521:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00010000:00010000:3.0:1746066746.970530:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.970538:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 17 pid: 9591 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.970546:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323200:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.970563:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066746.975790:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.975915:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982920832 00000100:00100000:2.0:1746066746.975924:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982920832 00002000:00100000:2.0:1746066746.975969:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880093acad80 x1830882982920832/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.975980:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acad80 with x1830882982920832 ext(1048576->2097151) 00002000:00010000:2.0:1746066746.975985:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093acad80 00000100:00100000:2.0:1746066746.976004:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3875 00000100:00100000:2.0:1746066746.976011:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982920832:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066746.976283:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323072:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.976295:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323200:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066746.976322:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3416064->3493887] (req 3416064->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.976338:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9200, rc 0) 00000100:00100000:3.0:1746066746.976383:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:32703:x1830882982920448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6218us (7211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066746.976392:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15158 00000100:00100000:1.0:1746066746.978356:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984322944:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.978377:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066746.978426:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882982920576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8903us (9186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.978436:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6764 00000100:00100000:0.0:1746066746.984969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.985142:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066746.985341:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982920960 00000100:00100000:1.0:1746066746.985351:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982920960 00000100:00100000:3.0:1746066746.985460:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982921088 00000100:00100000:3.0:1746066746.985464:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982921088 00010000:00010000:3.0:1746066746.985483:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746066746.985509:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 18 pid: 9591 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.985520:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6765 00000100:00100000:3.0:1746066746.985531:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982921088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066746.985546:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066746.985565:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066746.985576:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066746.985597:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04000/0xf1867c21abfa546f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0553 expref: 10 pid: 9592 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066746.985616:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.985699:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982920832:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9686us (9917us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066746.985709:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3875 00002000:00100000:2.0:1746066746.985718:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880093acad80 x1830882982920832/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/440 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.985727:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acad80 with x1830882982920832 ext(1048576->2097151) 00002000:00010000:2.0:1746066746.985732:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093acad80 00000100:00100000:3.0:1746066746.985781:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982921088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 254us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.985867:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6766 00000100:00100000:1.0:1746066746.985874:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882982920960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066746.985898:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066746.985907:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 18 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066746.985916:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 18 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066746.985928:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095750200/0xf1867c21abfa545a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d053e expref: 18 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066746.985940:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.985942:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066746.986018:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.986026:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066746.986057:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066746.986073:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984323328:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066746.986122:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066746.988689:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6765 00000100:00100000:0.0:1746066746.993176:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066746.993357:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982921344 00000100:00100000:2.0:1746066746.993367:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982921344 00002000:00100000:2.0:1746066746.993414:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3416064->3420159) req@ffff880093acbb80 x1830882982921344/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/0 e 0 to 0 dl 1746066757 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.993423:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acbb80 with x1830882982921344 ext(3416064->3420159) 00002000:00010000:2.0:1746066746.993429:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acbb80 00000100:00100000:2.0:1746066746.993448:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3876 00000100:00100000:2.0:1746066746.993459:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982921344:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066746.994346:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984323328:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066746.994368:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066746.994429:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982921344:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 973us (1262us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066746.994437:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3876 00002000:00100000:2.0:1746066746.994444:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3416064->3420159) req@ffff880093acbb80 x1830882982921344/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:152/0 lens 488/4536 e 0 to 0 dl 1746066757 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066746.994451:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acbb80 with x1830882982921344 ext(3416064->3420159) 00002000:00010000:2.0:1746066746.994456:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acbb80 00000100:00100000:3.0:1746066746.995135:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066746.995242:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982921472 00000100:00100000:3.0:1746066746.995247:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982921472 00000100:00100000:3.0:1746066746.995274:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15159 00000100:00100000:3.0:1746066746.995280:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:32700:x1830882982921472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066746.995292:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066746.995308:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0602 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.995336:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.995343:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.995345:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066746.995349:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.995376:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066746.995389:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066746.995405:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323456:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066746.995465:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066746.995949:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+17:2016:x1830882982920960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 10073us (10989us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066746.995958:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6766 00000100:00100000:0.0:1746066747.000075:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.000245:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982921600 00000100:00100000:1.0:1746066747.000253:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982921600 00002000:00100000:1.0:1746066747.000298:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1191935) req@ffff880093aca300 x1830882982921600/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.000309:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca300 with x1830882982921600 ext(1048576->1191935) 00010000:00010000:1.0:1746066747.000318:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.000332:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 17 pid: 9590 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1746066747.000339:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093aca300 00000100:00100000:1.0:1746066747.000368:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 829 00000100:00100000:1.0:1746066747.000374:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+17:2013:x1830882982921600:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066747.000616:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323456:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.000645:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.000669:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5200, rc 0) 00000100:00100000:3.0:1746066747.000696:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:32700:x1830882982921472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5416us (5563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.000703:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15159 00000100:00100000:0.0:1746066747.002335:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.002422:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982921856 00000100:00100000:3.0:1746066747.002427:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982921856 00002000:00100000:3.0:1746066747.002464:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3489792->3493887) req@ffff880093aca680 x1830882982921856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.002474:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca680 with x1830882982921856 ext(3489792->3493887) 00002000:00010000:3.0:1746066747.002478:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093aca680 00000100:00100000:3.0:1746066747.002498:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3877 00000100:00100000:3.0:1746066747.002503:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982921856:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066747.002606:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982921856:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 103us (274us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066747.002611:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3877 00002000:00100000:3.0:1746066747.002616:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3489792->3493887) req@ffff880093aca680 x1830882982921856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.002629:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca680 with x1830882982921856 ext(3489792->3493887) 00002000:00010000:3.0:1746066747.002632:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093aca680 00000100:00080000:0.0:1746066747.002966:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066747.004745:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882982921600:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4362us (4671us total) trans 21474841701 rc 0/0 00000100:00100000:2.0:1746066747.004754:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 829 00002000:00100000:2.0:1746066747.004763:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1191935) req@ffff880093aca300 x1830882982921600/t21474841701(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.004771:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca300 with x1830882982921600 ext(1048576->1191935) 00010000:00010000:2.0:1746066747.004780:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.004796:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.004803:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093aca300 00000100:00100000:0.0:1746066747.013055:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.013328:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982921984 00000100:00100000:1.0:1746066747.013338:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982921984 00010000:00010000:1.0:1746066747.013399:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746066747.013439:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6767 00000100:00100000:1.0:1746066747.013448:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882982921984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066747.013463:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066747.013484:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.013495:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.013517:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa54ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1191935) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05ae expref: 19 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.013537:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.013539:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.013547:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.013556:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.013587:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.013600:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984323584:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066747.013689:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00080000:0.0:1746066747.013873:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066747.022393:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984323584:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066747.022417:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066747.022459:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2014:x1830882982921984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9011us (9413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.022471:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6767 00000100:00100000:0.0:1746066747.024725:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.024917:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982922240 00000100:00100000:2.0:1746066747.024927:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982922240 00002000:00100000:2.0:1746066747.024975:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009677d880 x1830882982922240/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.024984:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d880 with x1830882982922240 ext(1048576->2097151) 00002000:00010000:2.0:1746066747.024990:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677d880 00000100:00100000:2.0:1746066747.026085:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3878 00000100:00100000:2.0:1746066747.026095:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982922240:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066747.038901:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982922240:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12781us (14159us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066747.038914:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3878 00002000:00100000:3.0:1746066747.038926:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009677d880 x1830882982922240/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.038936:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d880 with x1830882982922240 ext(1048576->2097151) 00002000:00010000:3.0:1746066747.038942:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677d880 00000100:00100000:0.0:1746066747.059526:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.061598:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982922496 00000100:00100000:3.0:1746066747.061611:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982922496 00002000:00100000:3.0:1746066747.061676:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009677d180 x1830882982922496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 504/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.061686:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d180 with x1830882982922496 ext(2097152->4194303) 00002000:00010000:3.0:1746066747.061692:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677d180 00000100:00100000:3.0:1746066747.061716:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3879 00000100:00100000:3.0:1746066747.061723:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982922496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.078825:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982922496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17089us (19297us total) trans 0 rc 2019328/2019328 00000100:00100000:3.0:1746066747.078837:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3879 00002000:00100000:3.0:1746066747.078850:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009677d180 x1830882982922496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 504/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 2019328/2019328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.078865:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d180 with x1830882982922496 ext(2097152->4194303) 00002000:00010000:3.0:1746066747.078873:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677d180 00000100:00100000:0.0:1746066747.089609:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.092650:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.092753:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982922880 00000100:00100000:2.0:1746066747.092763:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982922880 00000100:00100000:2.0:1746066747.092821:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15160 00000100:00100000:2.0:1746066747.092829:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:32706:x1830882982922880:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066747.092850:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.092870:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0609 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.092919:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.092927:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.092929:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.092931:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1507328->1576959] (req 1507328->1576959) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.092964:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.092976:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 9 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.092989:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323712:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.093069:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.094382:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982922752 00000100:00100000:3.0:1746066747.094388:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982922752 00002000:00100000:3.0:1746066747.094418:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009677d500 x1830882982922752/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.094428:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d500 with x1830882982922752 ext(4194304->5033983) 00002000:00010000:3.0:1746066747.094432:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677d500 00000100:00100000:3.0:1746066747.094450:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3880 00000100:00100000:3.0:1746066747.094455:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982922752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.097393:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323712:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.097424:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1507328->1576959] (req 1507328->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.097441:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2800, rc 0) 00000100:00100000:2.0:1746066747.097496:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:32706:x1830882982922880:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4667us (4853us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.097505:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15160 00000100:00100000:0.0:1746066747.098963:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.099197:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982923008 00000100:00100000:2.0:1746066747.099205:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982923008 00010000:00010000:2.0:1746066747.099236:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 12 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.099807:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6768 00000100:00100000:2.0:1746066747.099816:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982923008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.099829:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066747.099849:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 12 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.099861:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 12 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.099907:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ea5200/0xf1867c21abfa551e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0602 expref: 12 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.099931:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.099933:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.099940:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 18 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.099947:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 18 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.099980:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 18 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.099993:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984323840:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066747.100062:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.101691:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984323840:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.101707:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066747.101737:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982922752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7280us (12137us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066747.101747:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3880 00002000:00100000:3.0:1746066747.101757:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009677d500 x1830882982922752/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.101767:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d500 with x1830882982922752 ext(4194304->5033983) 00002000:00010000:3.0:1746066747.101772:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677d500 00000100:00100000:2.0:1746066747.101998:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982923008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2182us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.102005:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6768 00000100:00100000:0.0:1746066747.102236:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.102280:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982923264 00000100:00100000:3.0:1746066747.102285:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982923264 00002000:00100000:3.0:1746066747.102310:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1507328->1511423) req@ffff88009677ed80 x1830882982923264/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.102317:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ed80 with x1830882982923264 ext(1507328->1511423) 00002000:00010000:3.0:1746066747.102321:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677ed80 00000100:00100000:3.0:1746066747.102458:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3881 00000100:00100000:3.0:1746066747.102465:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882982923264:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066747.102571:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882982923264:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 106us (335us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066747.102577:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3881 00002000:00100000:3.0:1746066747.102582:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1507328->1511423) req@ffff88009677ed80 x1830882982923264/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.102589:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ed80 with x1830882982923264 ext(1507328->1511423) 00002000:00010000:3.0:1746066747.102592:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677ed80 00000100:00100000:0.0:1746066747.108679:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.108931:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982923392 00000100:00100000:2.0:1746066747.108941:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982923392 00000100:00100000:2.0:1746066747.108991:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15161 00000100:00100000:2.0:1746066747.108998:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982923392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.109019:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.109037:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfa552c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0610 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.109096:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323968:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066747.109199:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.110968:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.111926:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982923648 00000100:00100000:2.0:1746066747.111937:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982923648 00002000:00100000:2.0:1746066747.111990:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1572864->1576959) req@ffff88009677e300 x1830882982923648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.112001:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e300 with x1830882982923648 ext(1572864->1576959) 00002000:00010000:2.0:1746066747.112006:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677e300 00000100:00100000:2.0:1746066747.112037:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3882 00000100:00100000:2.0:1746066747.112049:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882982923648:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066747.112961:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882982923648:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 909us (1997us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066747.112970:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3882 00002000:00100000:2.0:1746066747.112978:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1572864->1576959) req@ffff88009677e300 x1830882982923648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.112986:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e300 with x1830882982923648 ext(1572864->1576959) 00002000:00010000:2.0:1746066747.112990:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677e300 00000100:00100000:0.0:1746066747.113556:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.113589:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.114093:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.114416:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982923776 00000100:00100000:2.0:1746066747.114424:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982923776 00000100:00100000:2.0:1746066747.114466:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982923904 00000100:00100000:2.0:1746066747.114468:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982923904 00000100:00080000:2.0:1746066747.114487:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066747.114505:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982924032 00000100:00100000:2.0:1746066747.114507:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982924032 00000100:00100000:2.0:1746066747.114521:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15162 00000100:00100000:2.0:1746066747.114527:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882982923776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.114544:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.114561:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5533 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0617 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.114610:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984324096:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.114681:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15163 00000100:00100000:2.0:1746066747.114683:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.114690:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882982923904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.114698:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066747.114699:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15164 00000100:00100000:2.0:1746066747.114704:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982924032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.114709:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfa553a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d061e expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.114710:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.114718:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0625 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.114729:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.114731:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066747.114738:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984324224:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066747.114739:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 48 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.114754:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 48 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.114762:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6e00, rc 0) 00000100:00100000:3.0:1746066747.114763:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.114781:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882982924032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.114787:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15164 00000100:00100000:3.0:1746066747.114798:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:3.0:1746066747.114971:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066747 -> 1746066748 00002000:00010000:3.0:1746066747.114975:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066747 -> 1746066748 00000100:00100000:0.0:1746066747.114980:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982924160 00000100:00100000:0.0:1746066747.114983:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982924160 00000100:00100000:3.0:1746066747.114991:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984323968:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066747.115006:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15165 00000100:00100000:0.0:1746066747.115011:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882982924160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.115015:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfa552c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0610 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.115017:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066747.115025:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009357a800/0xf1867c21abfa5548 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d062c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.115031:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3400/0xf1867c21abfa552c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0610 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.115044:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3400, rc 0) 00000100:00100000:0.0:1746066747.115056:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096fd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984324352:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066747.115084:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.115093:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982923392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6095us (6424us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.115099:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15161 00002000:00010000:2.0:1746066747.117627:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066747 -> 1746066748 00002000:00010000:2.0:1746066747.117635:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066747 -> 1746066748 00002000:00010000:2.0:1746066747.117637:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746066747 -> 1746066748 00000100:00100000:2.0:1746066747.117675:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984324096:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066747.117706:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5533 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0617 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.117717:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5533 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0617 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.117731:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7600, rc 0) 00000100:00100000:2.0:1746066747.117770:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882982923776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3242us (4214us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066747.117781:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15162 00002000:00010000:3.0:1746066747.118552:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066747 -> 1746066748 00002000:00010000:3.0:1746066747.118555:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066747 -> 1746066748 00002000:00010000:3.0:1746066747.118557:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066747 -> 1746066748 00000100:00100000:3.0:1746066747.118569:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984324224:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.118588:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfa553a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d061e expref: 47 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.118596:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944800/0xf1867c21abfa553a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d061e expref: 47 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.118604:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944800, rc 0) 00000100:00100000:3.0:1746066747.120006:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882982923904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5313us (6410us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.120015:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15163 00000100:00100000:2.0:1746066747.120786:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.120951:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982924288 00000100:00100000:3.0:1746066747.120960:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982924288 00000100:00100000:3.0:1746066747.121002:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15166 00000100:00100000:3.0:1746066747.121008:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982924288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.121026:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.121042:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfa554f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0633 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.121091:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984324480:192.168.204.16@tcp:106: 00002000:00010000:0.0:1746066747.121853:0:12237:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066747 -> 1746066748 00002000:00010000:0.0:1746066747.121857:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066747 -> 1746066748 00002000:00010000:0.0:1746066747.121859:0:12237:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066747 -> 1746066748 00000100:00100000:0.0:1746066747.121878:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096fd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984324352:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066747.121927:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009357a800/0xf1867c21abfa5548 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d062c expref: 20 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.121939:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009357a800/0xf1867c21abfa5548 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d062c expref: 20 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.121953:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357a800, rc 0) 00000100:00100000:0.0:1746066747.121979:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882982924160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6967us (7180us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066747.121986:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15165 00000100:00100000:3.0:1746066747.122463:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.125147:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984324480:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.125185:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfa554f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0633 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.125198:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b944c00/0xf1867c21abfa554f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0633 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.125211:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944c00, rc 0) 00000100:00100000:3.0:1746066747.125373:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982924288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4362us (4586us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.125381:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15166 00000100:00100000:0.0:1746066747.126088:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.126159:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982924416 00000100:00100000:3.0:1746066747.126181:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982924416 00000100:00100000:3.0:1746066747.126293:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15167 00000100:00100000:3.0:1746066747.126301:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+19:32709:x1830882982924416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.126318:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.126333:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d063a expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.126358:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 8 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.126365:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.127348:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.127409:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.127444:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 8 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.127457:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 8 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.127468:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984324608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.128681:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.132407:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984324608:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066747.132442:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.132459:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945a00, rc 0) 00000100:00100000:0.0:1746066747.132518:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+20:32709:x1830882982924416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6217us (6429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066747.132531:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15167 00000100:00100000:0.0:1746066747.135610:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.135718:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982924544 00000100:00100000:2.0:1746066747.135728:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982924544 00002000:00100000:2.0:1746066747.135779:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (761856->1048575) req@ffff880096fd4a80 x1830882982924544/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.135789:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4a80 with x1830882982924544 ext(761856->1048575) 00010000:00010000:2.0:1746066747.135798:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 9 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.135812:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 9 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.135819:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd4a80 00000100:00100000:2.0:1746066747.135853:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 830 00000100:00100000:2.0:1746066747.135862:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882982924544:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066747.142411:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882982924544:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6539us (6798us total) trans 21474841702 rc 0/0 00000100:00100000:2.0:1746066747.142424:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 830 00002000:00100000:2.0:1746066747.142436:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (761856->1048575) req@ffff880096fd4a80 x1830882982924544/t21474841702(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.142445:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4a80 with x1830882982924544 ext(761856->1048575) 00010000:00010000:2.0:1746066747.142456:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.142613:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.142621:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd4a80 00000100:00100000:0.0:1746066747.145497:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.145589:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982924672 00000100:00100000:2.0:1746066747.145598:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982924672 00010000:00010000:2.0:1746066747.145634:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.145711:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6769 00000100:00100000:2.0:1746066747.145719:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:2014:x1830882982924672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.145798:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066747.145819:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.145830:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.145854:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096a59c00/0xf1867c21abfa54ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0592 expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.146530:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.146532:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.146542:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.146556:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.146592:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.146604:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984324736:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066747.146702:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.150603:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984324736:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.150627:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.150691:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882982924672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4970us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.150702:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6769 00000100:00100000:0.0:1746066747.150782:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.150964:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982924928 00000100:00100000:2.0:1746066747.150970:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982924928 00002000:00100000:2.0:1746066747.151006:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880096fd6d80 x1830882982924928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.151015:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd6d80 with x1830882982924928 ext(0->1048575) 00002000:00010000:2.0:1746066747.151021:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd6d80 00000100:00100000:2.0:1746066747.153641:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3883 00000100:00100000:2.0:1746066747.153665:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882982924928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.189992:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882982924928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36326us (39195us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.190010:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3883 00002000:00100000:2.0:1746066747.190030:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880096fd6d80 x1830882982924928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.190041:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd6d80 with x1830882982924928 ext(0->1048575) 00002000:00010000:2.0:1746066747.190048:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd6d80 00000100:00100000:0.0:1746066747.197766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.199489:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982925056 00000100:00100000:2.0:1746066747.199502:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982925056 00000100:00100000:2.0:1746066747.199574:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15168 00000100:00100000:2.0:1746066747.199585:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+46:32709:x1830882982925056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.199607:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.199629:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0641 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.199677:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.199685:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066747.199687:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066747.199691:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 47 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.199725:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.199738:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 29 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.199758:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984324864:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.199863:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.201752:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984324864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.201785:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 47 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.201803:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6800, rc 0) 00000100:00100000:2.0:1746066747.201860:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+47:32709:x1830882982925056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2276us (4106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.201867:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15168 00000100:00100000:0.0:1746066747.204768:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.204833:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982925184 00000100:00100000:2.0:1746066747.204842:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982925184 00002000:00100000:2.0:1746066747.204927:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1716223) req@ffff88006e210000 x1830882982925184/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.204936:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882982925184 ext(1048576->1716223) 00010000:00010000:2.0:1746066747.204945:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 30 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.204957:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 30 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.204964:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88006e210000 00000100:00100000:2.0:1746066747.204996:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 831 00000100:00100000:2.0:1746066747.205003:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882982925184:12345-192.168.204.16@tcp:4:multiop.0 00000100:00080000:0.0:1746066747.205809:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066747.217288:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982925184:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 12275us (12520us total) trans 17179874273 rc 0/0 00000100:00100000:2.0:1746066747.217301:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 831 00002000:00100000:2.0:1746066747.217312:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1716223) req@ffff88006e210000 x1830882982925184/t17179874273(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.217322:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882982925184 ext(1048576->1716223) 00010000:00010000:2.0:1746066747.217333:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 32 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.217347:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 32 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.217354:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88006e210000 00000100:00100000:2.0:1746066747.225230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.225310:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982925312 00000100:00100000:0.0:1746066747.225317:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982925312 00010000:00010000:0.0:1746066747.225377:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 32 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746066747.225409:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6770 00000100:00100000:0.0:1746066747.225416:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882982925312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066747.225427:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066747.225443:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 32 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066747.225453:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 32 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066747.225470:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0da00/0xf1867c21abfa54bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1716223) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05a0 expref: 32 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066747.225495:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.225497:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.225504:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 46 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.225511:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 46 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.225539:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 46 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066747.225550:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984324992:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066747.225618:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.227648:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984324992:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.227682:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.227722:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882982925312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2305us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.227732:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6770 00000100:00100000:0.0:1746066747.236158:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.236195:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.236225:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.236340:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982925568 00000100:00100000:3.0:1746066747.236346:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982925952 00000100:00100000:2.0:1746066747.236348:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982925568 00000100:00100000:3.0:1746066747.236357:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982925952 00002000:00100000:3.0:1746066747.236400:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c492680 x1830882982925952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.236410:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492680 with x1830882982925952 ext(1048576->2097151) 00002000:00010000:3.0:1746066747.236416:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c492680 00002000:00100000:2.0:1746066747.236470:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88006e210a80 x1830882982925568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.236480:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210a80 with x1830882982925568 ext(1048576->2097151) 00002000:00010000:2.0:1746066747.236485:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e210a80 00000100:00100000:3.0:1746066747.236537:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982926080 00000100:00100000:3.0:1746066747.236541:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982926080 00000100:00100000:2.0:1746066747.236552:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3884 00000100:00100000:2.0:1746066747.236559:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882982925952:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746066747.236561:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c493480 x1830882982926080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 504/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.236568:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882982926080 ext(1048576->2097151) 00002000:00010000:3.0:1746066747.236573:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:2.0:1746066747.237285:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3885 00000100:00100000:2.0:1746066747.237292:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882982925568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.237756:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3886 00000100:00100000:3.0:1746066747.237766:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882982926080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.252490:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882982925952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15921us (16283us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.252503:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3884 00002000:00100000:2.0:1746066747.252514:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c492680 x1830882982925952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.252524:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492680 with x1830882982925952 ext(1048576->2097151) 00002000:00010000:2.0:1746066747.252530:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c492680 00000100:00100000:2.0:1746066747.258921:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982925568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21620us (22762us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.258931:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3885 00002000:00100000:2.0:1746066747.258941:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88006e210a80 x1830882982925568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.258950:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210a80 with x1830882982925568 ext(1048576->2097151) 00002000:00010000:2.0:1746066747.258955:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e210a80 00000100:00100000:1.0:1746066747.261134:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.261774:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982926208 00000100:00100000:2.0:1746066747.261784:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982926208 00000100:00100000:0.0:1746066747.262026:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.262053:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982926336 00000100:00100000:2.0:1746066747.262057:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982926336 00000100:00100000:2.0:1746066747.262078:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15169 00000100:00100000:2.0:1746066747.262085:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882982926208:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066747.262095:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066747.262106:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.262124:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0648 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.262149:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.262151:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.262160:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.262175:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.262186:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f6600, rc 0) 00000100:00100000:2.0:1746066747.262247:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882982926208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 162us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.262254:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15169 00000100:00100000:2.0:1746066747.262268:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982926464 00000100:00100000:2.0:1746066747.262271:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982926464 00000100:00100000:3.0:1746066747.262411:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882982926080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24644us (26182us total) trans 0 rc 978944/978944 00000100:00100000:3.0:1746066747.262421:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3886 00002000:00100000:3.0:1746066747.262431:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c493480 x1830882982926080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 504/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.262439:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882982926080 ext(1048576->2097151) 00002000:00010000:3.0:1746066747.262444:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:2.0:1746066747.262509:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15170 00000100:00100000:2.0:1746066747.262516:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882982926336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.262523:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.262533:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d064f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.262546:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.262547:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.262551:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.262565:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.262571:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7200, rc 0) 00000100:00100000:2.0:1746066747.262588:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882982926336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.262593:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15170 00000100:00100000:2.0:1746066747.262602:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15171 00000100:00100000:2.0:1746066747.262606:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882982926464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.262611:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.262617:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7e00/0xf1867c21abfa5572 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0656 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.262665:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984325120:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066747.262728:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066747.266640:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066747 -> 1746066748 00000100:00100000:2.0:1746066747.266681:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984325120:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066747.266715:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7e00/0xf1867c21abfa5572 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0656 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.266727:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7e00/0xf1867c21abfa5572 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0656 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.267114:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7e00, rc 0) 00000100:00100000:2.0:1746066747.267165:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882982926464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4557us (5070us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066747.267173:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15171 00000100:00100000:0.0:1746066747.274523:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.274863:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982926592 00000100:00100000:2.0:1746066747.274873:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982926592 00000100:00100000:2.0:1746066747.274961:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15172 00000100:00100000:2.0:1746066747.274971:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+20:32709:x1830882982926592:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.274994:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.275013:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d065d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.275043:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.275051:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066747.275052:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066747.275056:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.275086:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.275098:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 10 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.275111:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984325248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.278363:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.278663:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.278770:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982926720 00000100:00100000:0.0:1746066747.278778:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982926720 00000100:00100000:0.0:1746066747.278825:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15173 00000100:00100000:0.0:1746066747.278832:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:32717:x1830882982926720:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066747.278850:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066747.278867:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0664 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.278912:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.278926:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.278933:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.278934:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.278937:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [872448->1048575] (req 872448->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.278966:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.278976:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 10 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:0.0:1746066747.278988:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984325376:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066747.279044:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.279052:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746066747.279060:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984325504:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066747.279072:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.282454:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.282827:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984325248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.282864:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.283522:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982927232 00000100:00100000:3.0:1746066747.283530:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982927232 00000100:00100000:1.0:1746066747.283585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066747.283606:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962f7600, rc 0) 00000100:00100000:1.0:1746066747.283610:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.283682:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+23:32709:x1830882982926592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8711us (9168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.283683:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982926848 00000100:00100000:1.0:1746066747.283686:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982926848 00000100:00100000:2.0:1746066747.283691:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15172 00000100:00100000:2.0:1746066747.283723:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982927360 00000100:00100000:2.0:1746066747.283725:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982927360 00002000:00100000:1.0:1746066747.283728:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3416064->3907583) req@ffff88012b165f80 x1830882982926848/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 504/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.283738:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096e69f80 x1830882982927360/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.283738:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165f80 with x1830882982926848 ext(3416064->3907583) 00002000:00100000:2.0:1746066747.283744:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69f80 with x1830882982927360 ext(1048576->2097151) 00010000:00010000:1.0:1746066747.283744:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.283747:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e69f80 00010000:00010000:1.0:1746066747.283755:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 11 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.283760:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3887 00002000:00010000:1.0:1746066747.283762:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b165f80 00000100:00100000:2.0:1746066747.283766:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982927360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.283773:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 832 00000100:00100000:1.0:1746066747.283777:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982926848:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066747.283920:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.283941:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982927488 00000100:00100000:1.0:1746066747.283944:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982927488 00010000:00010000:1.0:1746066747.283961:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746066747.283962:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984325376:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066747.283976:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984325504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066747.283979:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6771 00000100:00100000:1.0:1746066747.283984:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882982927488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066747.283994:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066747.284003:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [872448->1048575] (req 872448->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.284009:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066747.284017:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0400, rc 0) 00010000:00010000:1.0:1746066747.284019:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.284040:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b945a00/0xf1867c21abfa5556 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d063a expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.284057:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066747.284059:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:32717:x1830882982926720:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5227us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066747.284067:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15173 00000100:00100000:1.0:1746066747.284078:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882982927488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.284083:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6771 00002000:00100000:3.0:1746066747.284563:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800966e2d80 x1830882982927232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.284571:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882982927232 ext(0->1048575) 00010000:00010000:3.0:1746066747.284577:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 13 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066747.284584:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 13 pid: 3528 timeout: 815 lvb_type: 1 00002000:00010000:3.0:1746066747.284590:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e2d80 00000100:00100000:3.0:1746066747.284624:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 833 00000100:00100000:3.0:1746066747.284629:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982927232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.293747:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882982927360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9967us (10122us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.293761:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3887 00002000:00100000:2.0:1746066747.293774:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096e69f80 x1830882982927360/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.293784:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69f80 with x1830882982927360 ext(1048576->2097151) 00002000:00010000:2.0:1746066747.293790:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e69f80 00000100:00100000:3.0:1746066747.295923:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982927232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11283us (13469us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066747.295937:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 833 00002000:00100000:3.0:1746066747.295947:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800966e2d80 x1830882982927232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.295954:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882982927232 ext(0->1048575) 00010000:00010000:3.0:1746066747.295963:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 13 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066747.295976:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 13 pid: 3528 timeout: 815 lvb_type: 1 00002000:00010000:3.0:1746066747.295983:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e2d80 00000100:00100000:1.0:1746066747.297793:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982926848:12345-192.168.204.16@tcp:4:cat.0 Request processed in 14008us (14202us total) trans 21474841703 rc 0/0 00000100:00100000:1.0:1746066747.297803:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 832 00002000:00100000:1.0:1746066747.297810:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (3416064->3907583) req@ffff88012b165f80 x1830882982926848/t21474841703(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 504/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.297818:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165f80 with x1830882982926848 ext(3416064->3907583) 00010000:00010000:1.0:1746066747.297825:0:13353:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 13 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.297836:0:13353:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 13 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:1.0:1746066747.297842:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b165f80 00000100:00100000:0.0:1746066747.306982:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.307061:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982927616 00000100:00100000:1.0:1746066747.307074:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982927616 00010000:00010000:1.0:1746066747.307115:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 13 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746066747.307166:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6772 00000100:00100000:1.0:1746066747.307174:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882982927616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066747.307622:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066747.307646:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 13 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.307668:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 13 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.307692:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9200/0xf1867c21abfa5517 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3416064->3493887) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05fb expref: 13 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.307724:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.307726:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.307734:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.307747:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.307780:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.307794:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984325632:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066747.307900:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066747.311540:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984325632:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066747.311565:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066747.311607:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882982927616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4433us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.311618:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6772 00000100:00100000:0.0:1746066747.318806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.318854:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.319026:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.319053:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982928128 00000100:00100000:0.0:1746066747.319062:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982928128 00000100:00100000:0.0:1746066747.319122:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15174 00000100:00100000:0.0:1746066747.319130:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:32720:x1830882982928128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066747.319152:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066747.319170:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d066b expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.319210:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982928000 00000100:00100000:2.0:1746066747.319215:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982928000 00002000:00100000:2.0:1746066747.319244:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012de5ce00 x1830882982928000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.319253:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ce00 with x1830882982928000 ext(2097152->4194303) 00002000:00010000:2.0:1746066747.319258:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ce00 00000100:00100000:2.0:1746066747.319281:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3888 00000100:00100000:2.0:1746066747.319286:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882982928000:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066747.320709:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982927744 00000100:00100000:1.0:1746066747.320717:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982927744 00010000:00010000:1.0:1746066747.320742:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 14 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:1.0:1746066747.320771:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6773 00000100:00100000:1.0:1746066747.320777:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982927744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066747.320788:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066747.320805:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 14 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746066747.320822:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 14 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746066747.320844:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f6600/0xf1867c21abfa5564 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0648 expref: 14 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:1.0:1746066747.320864:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.320866:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.320873:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.320897:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.320932:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.320944:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984325760:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066747.321709:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.321716:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066747.321718:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066747.321722:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.321745:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.321756:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 22 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746066747.321765:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984325888:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066747.325868:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.325995:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.334498:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.334541:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984325888:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.334575:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.334592:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:1.0:1746066747.334593:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984325760:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066747.334603:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.334946:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:32720:x1830882982928128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 15816us (15919us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.334954:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15174 00000100:00100000:3.0:1746066747.334959:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982928256 00000100:00100000:3.0:1746066747.334966:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982928256 00002000:00100000:3.0:1746066747.335003:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1507328->1576959) req@ffff88012de5c380 x1830882982928256/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.335012:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5c380 with x1830882982928256 ext(1507328->1576959) 00010000:00010000:3.0:1746066747.335019:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 23 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.335030:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 23 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:3.0:1746066747.335036:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012de5c380 00000100:00100000:3.0:1746066747.335057:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 834 00000100:00100000:3.0:1746066747.335063:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882982928256:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066747.335214:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882982927744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 14436us (16418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.335221:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6773 00000100:00100000:2.0:1746066747.335412:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.335425:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982928512 00000100:00100000:2.0:1746066747.335428:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982928512 00002000:00100000:2.0:1746066747.335443:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (872448->876543) req@ffff88012bb77480 x1830882982928512/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.335450:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb77480 with x1830882982928512 ext(872448->876543) 00002000:00010000:2.0:1746066747.335453:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb77480 00000100:00100000:1.0:1746066747.336798:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3889 00000100:00100000:0.0:1746066747.336799:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882982928000:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 17508us (17941us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066747.336806:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3888 00000100:00100000:1.0:1746066747.336807:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882982928512:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:0.0:1746066747.336812:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012de5ce00 x1830882982928000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066747.336819:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ce00 with x1830882982928000 ext(2097152->4194303) 00002000:00010000:0.0:1746066747.336823:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ce00 00000100:00100000:1.0:1746066747.337181:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882982928512:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 374us (1768us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066747.337187:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3889 00002000:00100000:1.0:1746066747.337191:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (872448->876543) req@ffff88012bb77480 x1830882982928512/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.337198:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb77480 with x1830882982928512 ext(872448->876543) 00002000:00010000:1.0:1746066747.337202:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb77480 00000100:00100000:3.0:1746066747.343965:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882982928256:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8885us (9462us total) trans 21474841704 rc 0/0 00000100:00100000:3.0:1746066747.343980:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 834 00002000:00100000:3.0:1746066747.343996:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1507328->1576959) req@ffff88012de5c380 x1830882982928256/t21474841704(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.344006:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5c380 with x1830882982928256 ext(1507328->1576959) 00010000:00010000:3.0:1746066747.344019:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 23 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.344038:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 23 pid: 20361 timeout: 815 lvb_type: 0 00002000:00010000:3.0:1746066747.344046:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012de5c380 00000100:00100000:0.0:1746066747.348536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.348750:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982928640 00000100:00100000:2.0:1746066747.348763:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982928640 00000100:00100000:2.0:1746066747.348838:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15175 00000100:00100000:2.0:1746066747.348847:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:32717:x1830882982928640:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066747.348871:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.348934:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0672 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.348970:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.348978:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.348985:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.348987:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.348991:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.349028:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.349040:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 31 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1746066747.349053:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984326016:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.349165:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.349174:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 48 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.349188:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984326144:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.349208:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.353223:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.354808:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.355183:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982928896 00000100:00100000:3.0:1746066747.355192:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982928896 00000100:00100000:3.0:1746066747.355246:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15176 00000100:00100000:3.0:1746066747.355255:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882982928896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.355274:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.355291:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfa5595 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0679 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.355346:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984326272:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.355435:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066747.356609:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982928768 00000100:00100000:1.0:1746066747.356615:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982928768 00010000:00010000:1.0:1746066747.356638:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 25 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746066747.356673:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6774 00000100:00100000:1.0:1746066747.356679:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982928768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066747.356689:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066747.356709:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 25 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.356720:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 25 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.356741:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.356743:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.356750:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.356769:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.356793:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 11 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.356803:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984326400:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066747.356857:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.357188:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984326016:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.357201:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093acb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984326144:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.357227:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.357239:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba800, rc 0) 00000100:00100000:0.0:1746066747.357359:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.357396:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.357620:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982929024 00000100:00100000:3.0:1746066747.357625:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982929024 00010000:00010000:3.0:1746066747.357643:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 49 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.357681:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982929152 00000100:00100000:3.0:1746066747.357683:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982929152 00010000:00010000:3.0:1746066747.357695:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 32 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1746066747.357708:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6775 00000100:00100000:3.0:1746066747.357713:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882982929024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066747.357720:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066747.357735:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 49 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.357743:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 49 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.357757:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6800/0xf1867c21abfa555d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0641 expref: 49 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.357781:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066747.357804:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882982929024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.357810:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6775 00000100:00100000:3.0:1746066747.357827:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6776 00000100:00100000:3.0:1746066747.357831:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882982929152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066747.357837:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066747.357843:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 32 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066747.357852:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 32 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066747.357862:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7200/0xf1867c21abfa556b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d064f expref: 32 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:3.0:1746066747.357870:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.357871:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.357875:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 47 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.357903:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 47 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.357926:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 47 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.357934:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984326528:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066747.357971:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.358117:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:32717:x1830882982928640:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9270us (9589us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.358124:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15175 00010000:00010000:3.0:1746066747.362515:0:9591:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880094305f80 x1830882984326272) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 25 pid: 20361 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.362557:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be2800/0xf1867c21abfa5525 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1507328->1576959) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0609 expref: 25 pid: 20361 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.362590:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984326272:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.362625:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfa5595 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0679 expref: 24 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.362638:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5a00/0xf1867c21abfa5595 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0679 expref: 24 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.362648:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5a00, rc 0) 00000100:00100000:1.0:1746066747.363101:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984326400:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066747.363115:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066747.363155:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882982928768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6475us (9941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.363165:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6774 00000100:00100000:2.0:1746066747.363344:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984326528:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.363354:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.363370:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882982929152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5537us (5972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.363376:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6776 00000100:00100000:3.0:1746066747.363601:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982928896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8346us (8796us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.363608:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15176 00000100:00100000:0.0:1746066747.367732:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.367869:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982929408 00000100:00100000:3.0:1746066747.367992:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982929408 00002000:00100000:3.0:1746066747.368059:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012de5fb80 x1830882982929408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.368071:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5fb80 with x1830882982929408 ext(1048576->2097151) 00002000:00010000:3.0:1746066747.368079:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5fb80 00000100:00100000:3.0:1746066747.368259:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3890 00000100:00100000:3.0:1746066747.368268:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982929408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066747.372729:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.374128:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982929664 00000100:00100000:1.0:1746066747.374140:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982929664 00002000:00100000:1.0:1746066747.374190:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1314816->1318911) req@ffff88012de5c000 x1830882982929664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.374200:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5c000 with x1830882982929664 ext(1314816->1318911) 00002000:00010000:1.0:1746066747.374206:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5c000 00000100:00100000:1.0:1746066747.374241:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3891 00000100:00100000:1.0:1746066747.374250:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982929664:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066747.376204:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982929664:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1948us (3480us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066747.376217:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3891 00002000:00100000:1.0:1746066747.376225:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1314816->1318911) req@ffff88012de5c000 x1830882982929664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.376234:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5c000 with x1830882982929664 ext(1314816->1318911) 00002000:00010000:1.0:1746066747.376238:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5c000 00000100:00100000:2.0:1746066747.378018:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.379098:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982929920 00000100:00100000:0.0:1746066747.379109:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982929920 00002000:00100000:0.0:1746066747.379150:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880093acb480 x1830882982929920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066747.379160:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acb480 with x1830882982929920 ext(4194304->5033983) 00002000:00010000:0.0:1746066747.379164:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acb480 00000100:00100000:0.0:1746066747.379192:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3892 00000100:00100000:0.0:1746066747.379200:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982929920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.386351:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982929408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18069us (18612us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066747.386365:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3890 00002000:00100000:3.0:1746066747.386378:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012de5fb80 x1830882982929408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.386389:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5fb80 with x1830882982929408 ext(1048576->2097151) 00002000:00010000:3.0:1746066747.386395:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5fb80 00000100:00100000:2.0:1746066747.390295:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982929920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11083us (12270us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066747.390308:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3892 00002000:00100000:2.0:1746066747.390321:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880093acb480 x1830882982929920/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.390336:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acb480 with x1830882982929920 ext(4194304->5033983) 00002000:00010000:2.0:1746066747.390342:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acb480 00000100:00100000:0.0:1746066747.396528:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.397162:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982930048 00000100:00100000:3.0:1746066747.397173:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982930048 00000100:00100000:3.0:1746066747.397237:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15177 00000100:00100000:3.0:1746066747.397245:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+12:32720:x1830882982930048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.397265:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.397283:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0680 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.397311:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.397313:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.397321:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.397336:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.397347:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4e00, rc 0) 00000100:00100000:3.0:1746066747.397397:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+13:32720:x1830882982930048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 153us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.397404:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15177 00000100:00100000:0.0:1746066747.399711:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.399922:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982930176 00000100:00100000:2.0:1746066747.399930:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982930176 00000100:00100000:2.0:1746066747.400042:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15178 00000100:00100000:2.0:1746066747.400050:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882982930176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.400068:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.400081:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0687 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.400103:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.400104:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.400111:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 23 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.400124:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 23 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.400133:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bac00, rc 0) 00000100:00100000:2.0:1746066747.400340:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882982930176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 290us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.400346:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15178 00000100:00100000:0.0:1746066747.408952:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.409095:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982930432 00000100:00100000:2.0:1746066747.409104:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982930432 00002000:00100000:2.0:1746066747.409142:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012de5d500 x1830882982930432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.409156:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d500 with x1830882982930432 ext(2097152->4194303) 00002000:00010000:2.0:1746066747.409161:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5d500 00000100:00100000:2.0:1746066747.409488:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3893 00000100:00100000:2.0:1746066747.409496:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982930432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.424684:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982930432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15180us (16967us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066747.424694:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3893 00002000:00100000:2.0:1746066747.424704:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012de5d500 x1830882982930432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.424712:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d500 with x1830882982930432 ext(2097152->4194303) 00002000:00010000:2.0:1746066747.424717:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5d500 00000100:00100000:0.0:1746066747.431070:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.432722:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982930560 00000100:00100000:2.0:1746066747.432730:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982930560 00000100:00100000:2.0:1746066747.432789:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15179 00000100:00100000:2.0:1746066747.432797:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:32723:x1830882982930560:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066747.432812:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.432825:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d068e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.432847:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.432855:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.432865:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.432867:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.432869:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2256896->2273279] (req 2256896->2273279) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.432922:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.432936:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 14 pid: 9591 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.432947:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093acb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984326656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.433044:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.433056:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 22 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.433063:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984326784:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.433080:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.439866:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.440257:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093acb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984326656:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.440264:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984326784:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.440290:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2256896->2273279] (req 2256896->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.440309:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36400, rc 0) 00000100:00100000:2.0:1746066747.440506:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:32723:x1830882982930560:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7709us (9442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.440513:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15179 00000100:00100000:2.0:1746066747.441095:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982930688 00000100:00100000:2.0:1746066747.441101:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982930688 00000100:00100000:0.0:1746066747.441102:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.441347:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.441388:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982930816 00000100:00100000:3.0:1746066747.441391:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982930816 00000100:00100000:3.0:1746066747.441425:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15180 00000100:00100000:2.0:1746066747.441430:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15181 00000100:00100000:3.0:1746066747.441432:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882982930816:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066747.441434:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982930688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.441444:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.441444:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.441456:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5800/0xf1867c21abfa55b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d069c expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.441456:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37800/0xf1867c21abfa55b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0695 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.441488:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984327040:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066747.441488:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984326912:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066747.441535:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066747.441759:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982930944 00000100:00100000:1.0:1746066747.441763:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982930944 00000100:00100000:1.0:1746066747.441782:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15182 00000100:00100000:1.0:1746066747.441787:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982930944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066747.441797:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066747.441805:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa55bf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06a3 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.441814:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.441822:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa55bf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06a3 expref: 17 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066747.441830:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cce00/0xf1867c21abfa55bf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06a3 expref: 17 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066747.441842:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cce00, rc 0) 00000100:00100000:3.0:1746066747.442187:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.443032:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.443101:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.443178:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982930944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1388us (1830us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066747.443184:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15182 00000100:00100000:3.0:1746066747.443350:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982931072 00000100:00100000:3.0:1746066747.443354:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982931072 00010000:00010000:3.0:1746066747.443374:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 16 pid: 9591 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.443402:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982931200 00000100:00100000:3.0:1746066747.443404:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982931200 00010000:00010000:3.0:1746066747.443413:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.443430:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6777 00000100:00100000:3.0:1746066747.443436:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882982931072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066747.443444:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066747.443460:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 16 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.443469:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 16 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:3.0:1746066747.443485:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa559c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0680 expref: 16 pid: 9591 timeout: 815 lvb_type: 0 00000100:00100000:1.0:1746066747.443714:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6778 00000100:00100000:1.0:1746066747.443722:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882982931200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066747.443729:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066747.443738:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.443747:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.443759:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962f7600/0xf1867c21abfa5579 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d065d expref: 23 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:1.0:1746066747.443768:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.443770:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.443775:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.443782:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.443831:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066747.443925:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.443935:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984327168:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066747.444203:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984327040:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.444204:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882982931072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 619us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.444210:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6777 00010000:00010000:2.0:1746066747.444224:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5800/0xf1867c21abfa55b1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d069c expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.444233:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5800/0xf1867c21abfa55b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d069c expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.444245:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5800, rc 0) 00000100:00100000:2.0:1746066747.444264:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882982930816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2833us (3163us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066747.444270:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15180 00000100:00100000:1.0:1746066747.444342:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.444726:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984326912:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066747.444742:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37800/0xf1867c21abfa55b8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0695 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.444750:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37800/0xf1867c21abfa55b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0695 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.444757:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37800, rc 0) 00000100:00100000:2.0:1746066747.444787:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982930688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3351us (4928us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066747.444795:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15181 00000100:00100000:1.0:1746066747.446724:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984327168:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066747.446740:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066747.446846:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.446958:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882982931200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3236us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.446967:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6778 00000100:00100000:3.0:1746066747.447040:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982931456 00000100:00100000:3.0:1746066747.447045:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982931456 00002000:00100000:3.0:1746066747.447075:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2256896->2260991) req@ffff8800a4d0b480 x1830882982931456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.447084:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0b480 with x1830882982931456 ext(2256896->2260991) 00002000:00010000:3.0:1746066747.447087:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0b480 00000100:00100000:3.0:1746066747.447102:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3894 00000100:00100000:3.0:1746066747.447108:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882982931456:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066747.447704:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882982931456:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 593us (856us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066747.447710:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3894 00002000:00100000:3.0:1746066747.447716:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2256896->2260991) req@ffff8800a4d0b480 x1830882982931456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.447723:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0b480 with x1830882982931456 ext(2256896->2260991) 00002000:00010000:3.0:1746066747.447960:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0b480 00000100:00100000:0.0:1746066747.450757:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.450807:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.451239:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982931840 00000100:00100000:3.0:1746066747.451246:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982931840 00002000:00100000:3.0:1746066747.451400:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a4d0ad80 x1830882982931840/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.451415:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0ad80 with x1830882982931840 ext(4194304->5033983) 00002000:00010000:3.0:1746066747.451420:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0ad80 00000100:00100000:3.0:1746066747.451435:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982931712 00000100:00100000:3.0:1746066747.451437:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982931712 00002000:00100000:3.0:1746066747.451448:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2269184->2273279) req@ffff8800a4d0a680 x1830882982931712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.451455:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0a680 with x1830882982931712 ext(2269184->2273279) 00002000:00010000:3.0:1746066747.451457:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0a680 00000100:00100000:3.0:1746066747.451480:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3895 00000100:00100000:3.0:1746066747.451486:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882982931840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.451943:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3896 00000100:00100000:1.0:1746066747.451951:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982931712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.452017:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982931712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 66us (1208us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066747.452023:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3896 00002000:00100000:1.0:1746066747.452029:0:13353:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9a:0x0] (2269184->2273279) req@ffff8800a4d0a680 x1830882982931712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.452036:0:13353:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0a680 with x1830882982931712 ext(2269184->2273279) 00002000:00010000:1.0:1746066747.452040:0:13353:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0a680 00000100:00100000:3.0:1746066747.461223:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982931840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9728us (10463us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066747.461233:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3895 00002000:00100000:3.0:1746066747.461242:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a4d0ad80 x1830882982931840/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.461249:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0ad80 with x1830882982931840 ext(4194304->5033983) 00002000:00010000:3.0:1746066747.461253:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0ad80 00000100:00100000:0.0:1746066747.476437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.479707:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.479844:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982932096 00000100:00100000:3.0:1746066747.479852:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982932096 00000100:00100000:3.0:1746066747.479898:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982932224 00000100:00100000:3.0:1746066747.479900:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982932224 00000100:00100000:3.0:1746066747.482067:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15183 00000100:00100000:3.0:1746066747.482079:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882982932096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.482096:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.482112:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06aa expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.482157:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984327296:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.482248:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066747.482548:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15184 00000100:00100000:1.0:1746066747.482556:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882982932224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066747.482564:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066747.482573:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cde00/0xf1867c21abfa55cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06b1 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.482597:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984327424:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066747.482622:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00010000:00010000:2.0:1746066747.492027:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066747.492428:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984327296:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.492458:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55c6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06aa expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.492470:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06aa expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.492484:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b600, rc 0) 00000100:00100000:3.0:1746066747.492525:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882982932096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 10448us (16094us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.492533:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15183 00000100:00100000:0.0:1746066747.492619:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984327424:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066747.492636:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cde00/0xf1867c21abfa55cd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06b1 expref: 32 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.492645:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cde00/0xf1867c21abfa55cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06b1 expref: 32 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.492680:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cde00, rc 0) 00000100:00100000:0.0:1746066747.492700:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882982932224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 10146us (13002us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066747.492705:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15184 00000100:00100000:0.0:1746066747.503461:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.503546:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982932352 00000100:00100000:2.0:1746066747.503554:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982932352 00000100:00100000:2.0:1746066747.503599:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15185 00000100:00100000:2.0:1746066747.503606:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982932352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.503622:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.503637:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa55d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06b8 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.503694:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984327552:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066747.504348:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066747.514329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.514571:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982932480 00000100:00100000:3.0:1746066747.514579:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982932480 00000100:00100000:3.0:1746066747.514616:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15186 00000100:00100000:3.0:1746066747.514623:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982932480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.514637:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.514661:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06bf expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.514707:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984327680:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.514776:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.515455:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984327552:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.515478:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa55d4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06b8 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.515487:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa55d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06b8 expref: 14 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.515499:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37400, rc 0) 00000100:00100000:3.0:1746066747.515522:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982932352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 11917us (12069us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.515528:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15185 00000100:00100000:3.0:1746066747.516166:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984327680:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.516182:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55db lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06bf expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.516190:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06bf expref: 32 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.516197:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:3.0:1746066747.516228:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982932480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1604us (1905us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.516233:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15186 00000100:00100000:0.0:1746066747.594819:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.596017:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982932736 00000100:00100000:3.0:1746066747.596026:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982932736 00002000:00100000:3.0:1746066747.596064:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3981312->3985407) req@ffff8801310f2a00 x1830882982932736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.596079:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2a00 with x1830882982932736 ext(3981312->3985407) 00002000:00010000:3.0:1746066747.596084:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f2a00 00000100:00100000:3.0:1746066747.596107:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3897 00000100:00100000:3.0:1746066747.596114:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982932736:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066747.598601:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982932736:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 2478us (3781us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066747.598612:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3897 00002000:00100000:3.0:1746066747.598620:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3981312->3985407) req@ffff8801310f2a00 x1830882982932736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.598628:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f2a00 with x1830882982932736 ext(3981312->3985407) 00002000:00010000:3.0:1746066747.598634:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f2a00 00000100:00100000:0.0:1746066747.607091:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.607173:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982932992 00000100:00100000:3.0:1746066747.607180:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982932992 00002000:00100000:3.0:1746066747.607213:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4190208->4194303) req@ffff8801310f0380 x1830882982932992/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.607221:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0380 with x1830882982932992 ext(4190208->4194303) 00002000:00010000:3.0:1746066747.607225:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f0380 00000100:00100000:3.0:1746066747.607240:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3898 00000100:00100000:3.0:1746066747.607245:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982932992:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066747.607363:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982932992:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 116us (276us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066747.607369:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3898 00002000:00100000:3.0:1746066747.607375:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4190208->4194303) req@ffff8801310f0380 x1830882982932992/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.607381:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0380 with x1830882982932992 ext(4190208->4194303) 00002000:00010000:3.0:1746066747.607384:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801310f0380 00000100:00100000:0.0:1746066747.632290:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.632755:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982933120 00000100:00100000:3.0:1746066747.632765:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982933120 00000100:00100000:3.0:1746066747.632817:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15187 00000100:00100000:3.0:1746066747.632826:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982933120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.632845:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.632862:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa55e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06c6 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.632950:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984327808:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.638682:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.638743:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984327808:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.638776:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa55e2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06c6 expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.638791:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa55e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06c6 expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.638809:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b200, rc 0) 00000100:00100000:3.0:1746066747.638861:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982933120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6034us (6579us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.638869:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15187 00000100:00100000:0.0:1746066747.652148:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.654195:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982933376 00000100:00100000:2.0:1746066747.654209:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982933376 00002000:00100000:2.0:1746066747.654259:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->872447) req@ffff880093ccca80 x1830882982933376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.654269:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccca80 with x1830882982933376 ext(0->872447) 00002000:00010000:2.0:1746066747.654274:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccca80 00000100:00100000:2.0:1746066747.654307:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3899 00000100:00100000:2.0:1746066747.654314:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882982933376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.655001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.655036:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.655068:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982933632 00000100:00100000:1.0:1746066747.655072:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982933632 00002000:00100000:1.0:1746066747.655090:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1318912->2097151) req@ffff88012e420000 x1830882982933632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.655098:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882982933632 ext(1318912->2097151) 00002000:00010000:1.0:1746066747.655101:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:1.0:1746066747.655109:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982933888 00000100:00100000:1.0:1746066747.655111:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982933888 00002000:00100000:1.0:1746066747.655118:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e420e00 x1830882982933888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.655124:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420e00 with x1830882982933888 ext(1048576->2097151) 00002000:00010000:1.0:1746066747.655126:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e420e00 00000100:00100000:1.0:1746066747.655140:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3900 00000100:00100000:1.0:1746066747.655145:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882982933632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.655606:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3901 00000100:00100000:1.0:1746066747.655611:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882982933888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.672796:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882982933632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17637us (17783us total) trans 0 rc 778240/778240 00000100:00100000:1.0:1746066747.672808:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3900 00002000:00100000:1.0:1746066747.672818:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1318912->2097151) req@ffff88012e420000 x1830882982933632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.672825:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882982933632 ext(1318912->2097151) 00002000:00010000:1.0:1746066747.672831:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:1.0:1746066747.676023:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882982933888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20401us (20976us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066747.676033:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3901 00002000:00100000:1.0:1746066747.676045:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e420e00 x1830882982933888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.676055:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420e00 with x1830882982933888 ext(1048576->2097151) 00002000:00010000:1.0:1746066747.676060:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e420e00 00000100:00100000:2.0:1746066747.677706:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.677861:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982934016 00000100:00100000:3.0:1746066747.677873:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982934016 00000100:00100000:3.0:1746066747.677963:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15188 00000100:00100000:3.0:1746066747.677971:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:32727:x1830882982934016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066747.677987:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.678002:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06cd expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.678031:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 12 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.678039:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.678040:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.678043:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2334720->3145727] (req 2334720->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.678068:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 12 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.678079:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 12 pid: 9590 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.678090:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984327936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.678170:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.678256:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882982933376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23942us (26115us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746066747.678264:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3899 00002000:00100000:3.0:1746066747.678271:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->872447) req@ffff880093ccca80 x1830882982933376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.678279:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccca80 with x1830882982933376 ext(0->872447) 00002000:00010000:3.0:1746066747.678283:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccca80 00000100:00100000:0.0:1746066747.682187:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.682269:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982934144 00000100:00100000:2.0:1746066747.682280:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982934144 00002000:00100000:2.0:1746066747.682328:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2256896->4194303) req@ffff880093ccf100 x1830882982934144/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 504/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.682338:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccf100 with x1830882982934144 ext(2256896->4194303) 00010000:00010000:2.0:1746066747.682348:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 13 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.682367:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 13 pid: 9590 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.682374:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ccf100 00000100:00100000:2.0:1746066747.682404:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 835 00000100:00100000:2.0:1746066747.682411:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982934144:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066747.683035:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984327936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.683062:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2334720->3145727] (req 2334720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 23 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.683078:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576be00, rc 0) 00000100:00100000:3.0:1746066747.683320:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+23:32727:x1830882982934016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5349us (5617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.683328:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15188 00000100:00100000:0.0:1746066747.696212:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.696289:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982934272 00000100:00100000:3.0:1746066747.696298:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982934272 00000100:00100000:2.0:1746066747.696456:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882982934144:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 14042us (14277us total) trans 21474841705 rc 0/0 00000100:00100000:2.0:1746066747.696467:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 835 00000100:00100000:3.0:1746066747.696494:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15189 00000100:00100000:3.0:1746066747.696501:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+23:32734:x1830882982934272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.696523:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.696541:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06d4 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.696569:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.696575:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2334720->3145727] (req 2334720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.696581:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066747.696584:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.696620:0:9591:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2334720->3145727] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.696633:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.696657:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b600, rc 0) 00000100:00100000:3.0:1746066747.696675:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:32734:x1830882982934272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 175us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.696680:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15189 00002000:00100000:2.0:1746066747.696808:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2256896->4194303) req@ffff880093ccf100 x1830882982934144/t21474841705(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 504/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.696817:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccf100 with x1830882982934144 ext(2256896->4194303) 00010000:00010000:2.0:1746066747.696824:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.696836:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.696842:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ccf100 00000100:00100000:0.0:1746066747.704003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.704048:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982934400 00000100:00100000:0.0:1746066747.704058:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982934400 00010000:00010000:0.0:1746066747.704096:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746066747.704135:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6779 00000100:00100000:0.0:1746066747.704143:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882982934400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066747.704158:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066747.704180:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066747.704191:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066747.704217:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36400/0xf1867c21abfa55aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2256896->2273279) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d068e expref: 15 pid: 9590 timeout: 815 lvb_type: 0 00010000:00010000:0.0:1746066747.704252:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.704254:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.704261:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 23 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.704270:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 23 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.704304:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 23 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066747.704315:0:11928:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 23 pid: 9591 timeout: 815 lvb_type: 0 00000100:00100000:0.0:1746066747.704327:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984328192:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066747.706387:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.712673:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984328192:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.712880:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.712972:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882982934400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8828us (8978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.712984:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6779 00000100:00100000:0.0:1746066747.724470:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.725172:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.725270:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982934656 00000100:00100000:2.0:1746066747.725281:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982934656 00002000:00100000:2.0:1746066747.725330:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2334720->3145727) req@ffff880093ccdf80 x1830882982934656/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.725340:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdf80 with x1830882982934656 ext(2334720->3145727) 00010000:00010000:2.0:1746066747.725350:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 24 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.725365:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 24 pid: 9591 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.725377:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ccdf80 00000100:00100000:2.0:1746066747.725416:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 836 00000100:00100000:2.0:1746066747.725424:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882982934656:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066747.725677:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982934784 00000100:00100000:3.0:1746066747.725681:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982934784 00000100:00100000:3.0:1746066747.725707:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15190 00000100:00100000:3.0:1746066747.725713:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:32727:x1830882982934784:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066747.725722:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.725737:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06db expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.725762:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.725770:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 48 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.725775:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.725778:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.725781:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->2244607] (req 2097152->2244607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 48 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.725811:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 48 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.725821:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 48 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1746066747.725834:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984328320:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.725946:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.727285:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 30 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.727306:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984328448:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.727381:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.733833:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.733862:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982934912 00000100:00100000:2.0:1746066747.733870:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982934912 00010000:00010000:2.0:1746066747.733935:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 49 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:2.0:1746066747.733963:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6780 00000100:00100000:2.0:1746066747.733972:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882982934912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.733985:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066747.734006:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 49 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1746066747.734017:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 49 pid: 3528 timeout: 815 lvb_type: 1 00010000:00010000:2.0:1746066747.734045:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.734105:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882982934912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.734113:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6780 00000100:00100000:2.0:1746066747.734204:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.734215:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982935040 00000100:00100000:2.0:1746066747.734218:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982935040 00010000:00010000:2.0:1746066747.734229:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 31 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.734242:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6781 00000100:00100000:2.0:1746066747.734246:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882982935040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.734254:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066747.734260:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 31 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.734268:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 31 pid: 3528 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.734279:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.734281:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.734289:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 48 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.734297:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 48 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.734332:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 48 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.734344:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984328576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066747.734400:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066747.735711:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa54a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d058b expref: 48 pid: 3528 timeout: 815 lvb_type: 1 00000100:00100000:3.0:1746066747.735748:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984328320:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.735760:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa5492 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0576 expref: 31 pid: 3528 timeout: 815 lvb_type: 0 00000100:00100000:3.0:1746066747.735768:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984328448:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.735798:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 47 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.735809:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:3.0:1746066747.735865:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:32727:x1830882982934784:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10146us (10688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.735872:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15190 00000100:00100000:2.0:1746066747.752274:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984328576:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.752296:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.752346:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882982935040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 18097us (18141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.752356:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6781 00000100:00100000:2.0:1746066747.752875:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982934656:12345-192.168.204.16@tcp:4:cat.0 Request processed in 27451us (28415us total) trans 21474841706 rc 0/0 00000100:00100000:2.0:1746066747.752898:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 836 00002000:00100000:2.0:1746066747.752908:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2334720->3145727) req@ffff880093ccdf80 x1830882982934656/t21474841706(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.752918:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdf80 with x1830882982934656 ext(2334720->3145727) 00010000:00010000:2.0:1746066747.752929:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 26 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.752943:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 26 pid: 9591 timeout: 815 lvb_type: 0 00002000:00010000:2.0:1746066747.752950:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ccdf80 00000100:00100000:0.0:1746066747.758865:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.759945:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.760068:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982935168 00000100:00100000:2.0:1746066747.760077:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982935168 00010000:00010000:2.0:1746066747.760125:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 26 pid: 9591 timeout: 815 lvb_type: 0 00000100:00100000:2.0:1746066747.760154:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6782 00000100:00100000:2.0:1746066747.760162:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982935168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.760177:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066747.760199:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 26 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.760212:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 26 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.760235:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa55e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06cd expref: 26 pid: 9591 timeout: 815 lvb_type: 0 00010000:00010000:2.0:1746066747.760263:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.760266:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.760273:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.760281:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.760315:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.760326:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984328704:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066747.760400:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.760630:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982935424 00000100:00100000:3.0:1746066747.760634:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982935424 00002000:00100000:3.0:1746066747.760678:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2240512->2244607) req@ffff880093ccd880 x1830882982935424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.760687:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd880 with x1830882982935424 ext(2240512->2244607) 00002000:00010000:3.0:1746066747.760691:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccd880 00000100:00100000:3.0:1746066747.760704:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3902 00000100:00100000:3.0:1746066747.760708:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982935424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.760853:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982935424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 143us (908us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066747.760860:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3902 00002000:00100000:3.0:1746066747.760865:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2240512->2244607) req@ffff880093ccd880 x1830882982935424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.760871:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd880 with x1830882982935424 ext(2240512->2244607) 00002000:00010000:3.0:1746066747.760874:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccd880 00000100:00100000:2.0:1746066747.762466:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984328704:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.762485:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.762517:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882982935168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2356us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.762526:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6782 00000100:00100000:0.0:1746066747.766848:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.768480:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.768522:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.768681:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982935680 00000100:00100000:1.0:1746066747.768691:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982935680 00002000:00100000:1.0:1746066747.768741:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880093ccce00 x1830882982935680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.768750:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccce00 with x1830882982935680 ext(2097152->3145727) 00002000:00010000:1.0:1746066747.768756:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccce00 00000100:00100000:1.0:1746066747.768785:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3903 00000100:00100000:1.0:1746066747.768793:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882982935680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.770357:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.770973:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.771186:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982935808 00000100:00100000:3.0:1746066747.771195:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982935808 00000100:00100000:3.0:1746066747.771234:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982935936 00000100:00100000:3.0:1746066747.771237:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982935936 00000100:00100000:3.0:1746066747.771252:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982936064 00000100:00100000:3.0:1746066747.771253:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982936064 00000100:00100000:3.0:1746066747.771267:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15191 00000100:00100000:3.0:1746066747.771273:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882982935808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.771291:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.771306:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa55fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06e2 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.771370:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984328832:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.771435:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.771497:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15192 00000100:00100000:3.0:1746066747.771502:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982935936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.771509:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.771519:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa5605 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06e9 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.771545:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984328960:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.771566:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.771597:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15193 00000100:00100000:3.0:1746066747.771601:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982936064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.771607:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.771613:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06f0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.771623:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.771626:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.771633:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.771657:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.771666:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b200, rc 0) 00000100:00100000:3.0:1746066747.771686:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882982936064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 84us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.771691:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15193 00000100:00100000:0.0:1746066747.773501:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982936192 00000100:00100000:0.0:1746066747.773513:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982936192 00000100:00100000:1.0:1746066747.774460:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15194 00000100:00100000:1.0:1746066747.774468:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982936192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066747.774486:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066747.774501:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa5613 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06f7 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.774547:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984329088:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066747.774618:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.782517:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984328960:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066747.782554:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa5605 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06e9 expref: 33 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.782568:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa5605 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06e9 expref: 33 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.782582:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ba00, rc 0) 00000100:00100000:2.0:1746066747.783918:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982935936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 12406us (15387us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066747.783929:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15192 00000100:00100000:3.0:1746066747.784118:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984328832:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066747.784145:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa55fe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06e2 expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.784156:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa55fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06e2 expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.784174:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a400, rc 0) 00000100:00100000:3.0:1746066747.784203:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882982935808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 12930us (15729us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066747.784209:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15191 00000100:00100000:2.0:1746066747.788639:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882982935680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19835us (21790us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.788664:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3903 00000100:00100000:1.0:1746066747.788664:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066747.788675:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880093ccce00 x1830882982935680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.788684:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccce00 with x1830882982935680 ext(2097152->3145727) 00002000:00010000:2.0:1746066747.788690:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccce00 00000100:00100000:3.0:1746066747.788786:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982936320 00000100:00100000:3.0:1746066747.788793:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982936320 00002000:00010000:0.0:1746066747.788793:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066747 -> 1746066748 00002000:00010000:0.0:1746066747.788797:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066747 -> 1746066748 00002000:00010000:0.0:1746066747.788800:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066747 -> 1746066748 00000100:00100000:0.0:1746066747.788816:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984329088:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066747.788834:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15195 00000100:00100000:3.0:1746066747.788840:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:32736:x1830882982936320:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066747.788847:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa5613 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f7 expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.788857:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066747.788858:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa5613 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f7 expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.788870:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faea00, rc 0) 00010000:00010000:3.0:1746066747.788871:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d06fe expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.788919:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 46 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.788928:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.788929:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.788933:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2965504->3145727] (req 2965504->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.788958:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882982936192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 14489us (17985us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066747.788961:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 46 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066747.788964:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15194 00010000:00010000:3.0:1746066747.788973:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 46 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.788985:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984329216:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.789342:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.792987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.793371:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982936576 00000100:00100000:2.0:1746066747.793384:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982936576 00002000:00100000:2.0:1746066747.793431:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2244608->3145727) req@ffff88011f764380 x1830882982936576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.793441:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764380 with x1830882982936576 ext(2244608->3145727) 00010000:00010000:2.0:1746066747.793450:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 47 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.793463:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 47 pid: 9591 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066747.793469:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f764380 00000100:00100000:2.0:1746066747.793487:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 837 00000100:00100000:2.0:1746066747.793493:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882982936576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.793523:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984329216:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.793550:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2965504->3145727] (req 2965504->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.793563:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576be00, rc 0) 00000100:00100000:3.0:1746066747.793611:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:32736:x1830882982936320:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4771us (4947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.793619:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15195 00000100:00100000:1.0:1746066747.793679:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.793713:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982936704 00000100:00100000:3.0:1746066747.793717:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982936704 00002000:00100000:3.0:1746066747.793731:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2244607) req@ffff88012e421180 x1830882982936704/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.793737:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882982936704 ext(2097152->2244607) 00010000:00010000:3.0:1746066747.793741:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 48 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.793750:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 48 pid: 9591 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066747.793755:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e421180 00000100:00100000:3.0:1746066747.793772:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 838 00000100:00100000:3.0:1746066747.793778:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882982936704:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066747.794074:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.794269:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982936832 00000100:00100000:3.0:1746066747.794273:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982936832 00000100:00100000:3.0:1746066747.794341:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15196 00000100:00100000:3.0:1746066747.794350:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:32739:x1830882982936832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.794360:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.794375:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0705 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.794395:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.794407:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.794409:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.794412:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.794437:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.794446:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 24 pid: 9590 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.794456:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984329344:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.794848:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066747.799029:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.799055:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982937088 00000100:00100000:1.0:1746066747.799063:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982937088 00002000:00100000:1.0:1746066747.799106:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880096fd5180 x1830882982937088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.799115:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5180 with x1830882982937088 ext(3145728->4194303) 00002000:00010000:1.0:1746066747.799121:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd5180 00000100:00100000:1.0:1746066747.799141:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3904 00000100:00100000:1.0:1746066747.799149:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882982937088:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.799937:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.800189:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984329344:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066747.800215:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.800230:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a600, rc 0) 00000100:00100000:2.0:1746066747.800259:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:32739:x1830882982936832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5910us (6186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.800262:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982937216 00000100:00100000:2.0:1746066747.800266:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15196 00000100:00100000:3.0:1746066747.800267:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982937216 00002000:00100000:3.0:1746066747.800289:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (872448->1048575) req@ffff880096fd7b80 x1830882982937216/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.800297:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7b80 with x1830882982937216 ext(872448->1048575) 00010000:00010000:3.0:1746066747.800303:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 27 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.800313:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 27 pid: 9590 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066747.800320:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd7b80 00000100:00100000:3.0:1746066747.800334:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 839 00000100:00100000:3.0:1746066747.800347:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982937216:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066747.801799:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.803196:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982937344 00000100:00100000:2.0:1746066747.803207:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982937344 00000100:00100000:2.0:1746066747.803252:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15197 00000100:00100000:2.0:1746066747.803260:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:32734:x1830882982937344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.803279:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.803296:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d070c expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.803323:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066747.803329:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2965504->3145727] (req 2965504->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.803335:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066747.803339:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 54 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.803374:0:9592:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2965504->3145727] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.803387:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 54 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.803395:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37800, rc 0) 00000100:00100000:2.0:1746066747.803449:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+54:32734:x1830882982937344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 189us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.803454:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15197 00000100:00100000:2.0:1746066747.803524:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882982936704:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9746us (9845us total) trans 17179874274 rc 0/0 00000100:00100000:2.0:1746066747.803532:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 838 00002000:00100000:2.0:1746066747.803540:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2244607) req@ffff88012e421180 x1830882982936704/t17179874274(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.804431:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882982936704 ext(2097152->2244607) 00010000:00010000:2.0:1746066747.804441:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 52 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.804452:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 52 pid: 9591 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066747.804459:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e421180 00000100:00100000:3.0:1746066747.811792:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882982937216:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11431us (11842us total) trans 21474841707 rc 0/0 00000100:00100000:3.0:1746066747.811806:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 839 00002000:00100000:3.0:1746066747.812045:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (872448->1048575) req@ffff880096fd7b80 x1830882982937216/t21474841707(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.812056:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7b80 with x1830882982937216 ext(872448->1048575) 00010000:00010000:3.0:1746066747.812067:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 29 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.812079:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 29 pid: 9590 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066747.812086:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd7b80 00000100:00100000:3.0:1746066747.812652:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882982936576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19148us (19666us total) trans 0 rc 901120/901120 00000100:00100000:3.0:1746066747.812662:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 837 00002000:00100000:3.0:1746066747.812667:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2244608->3145727) req@ffff88011f764380 x1830882982936576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 901120/901120 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.812733:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764380 with x1830882982936576 ext(2244608->3145727) 00010000:00010000:3.0:1746066747.812739:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 50 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.812748:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 50 pid: 9591 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066747.812754:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f764380 00000100:00100000:1.0:1746066747.812845:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982937088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13688us (13819us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066747.812855:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3904 00002000:00100000:1.0:1746066747.812864:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880096fd5180 x1830882982937088/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.812872:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5180 with x1830882982937088 ext(3145728->4194303) 00002000:00010000:1.0:1746066747.812876:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd5180 00000100:00100000:0.0:1746066747.816428:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.816523:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.816627:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982937472 00000100:00100000:2.0:1746066747.816637:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982937472 00010000:00010000:2.0:1746066747.816696:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 27 pid: 9590 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066747.816734:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982937600 00000100:00100000:2.0:1746066747.816737:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982937600 00010000:00010000:2.0:1746066747.816749:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 50 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066747.816818:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6783 00000100:00100000:2.0:1746066747.816828:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982937472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.816843:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066747.816861:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6784 00010000:00010000:2.0:1746066747.816865:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 27 pid: 9590 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066747.816869:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882982937600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.816876:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 27 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066747.816876:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066747.816911:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 50 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066747.816920:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 50 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066747.816941:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa55f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2244607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06db expref: 50 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066747.816964:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.816966:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.816973:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.816982:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.817020:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.817032:0:8395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 30 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066747.817045:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984329600:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066747.817112:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00010000:00010000:2.0:1746066747.817187:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa5580 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 872448->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0664 expref: 27 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.817202:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.817203:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.817207:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.817213:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.817232:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.817240:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984329728:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066747.817266:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066747.819284:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984329600:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066747.819305:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066747.819354:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882982937600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2485us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.819363:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6784 00000100:00100000:2.0:1746066747.819450:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984329728:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.819460:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.819475:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982937472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2650us (3059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.819481:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6783 00000100:00100000:0.0:1746066747.823107:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.823328:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982937856 00000100:00100000:1.0:1746066747.823339:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982937856 00002000:00100000:1.0:1746066747.823388:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2965504->2969599) req@ffff88011f766d80 x1830882982937856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.823399:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766d80 with x1830882982937856 ext(2965504->2969599) 00010000:00010000:1.0:1746066747.823408:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 31 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066747.823421:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 31 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:1.0:1746066747.823428:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f766d80 00000100:00100000:1.0:1746066747.823462:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 840 00000100:00100000:1.0:1746066747.823470:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982937856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.823624:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882982937856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 154us (527us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066747.823631:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 840 00002000:00100000:1.0:1746066747.823637:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2965504->2969599) req@ffff88011f766d80 x1830882982937856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.823654:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766d80 with x1830882982937856 ext(2965504->2969599) 00010000:00010000:1.0:1746066747.823660:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 31 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066747.823669:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 31 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:1.0:1746066747.823676:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f766d80 00000100:00100000:1.0:1746066747.824771:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.825163:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982938112 00000100:00100000:2.0:1746066747.825168:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982938112 00002000:00100000:2.0:1746066747.825196:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012bb75c00 x1830882982938112/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.825205:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75c00 with x1830882982938112 ext(0->1048575) 00002000:00010000:2.0:1746066747.825209:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb75c00 00000100:00100000:2.0:1746066747.825362:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3905 00000100:00100000:2.0:1746066747.825369:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982938112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.828272:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.828576:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982938496 00000100:00100000:2.0:1746066747.828586:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982938496 00000100:00100000:2.0:1746066747.828658:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15198 00000100:00100000:2.0:1746066747.828668:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:32736:x1830882982938496:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066747.828687:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066747.828706:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0713 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.828731:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066747.828985:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.829433:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.829443:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.829445:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.829449:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3506175] (req 3145728->3506175) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066747.829471:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982938368 00000100:00100000:0.0:1746066747.829476:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982938368 00010000:00010000:2.0:1746066747.829487:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.829498:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 19 pid: 9590 timeout: 816 lvb_type: 1 00002000:00100000:0.0:1746066747.829506:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2965504->3145727) req@ffff880094304a80 x1830882982938368/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066747.829511:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984329856:192.168.204.16@tcp:104: 00002000:00100000:0.0:1746066747.829515:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304a80 with x1830882982938368 ext(2965504->3145727) 00010000:00010000:0.0:1746066747.829523:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 31 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066747.829539:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 31 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:0.0:1746066747.829545:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304a80 00000100:00100000:0.0:1746066747.829575:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 841 00000100:00100000:0.0:1746066747.829581:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882982938368:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:2.0:1746066747.829696:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.829704:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 25 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066747.829713:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984329984:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.829734:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066747.832692:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984329856:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.836045:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882982938368:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6452us (7302us total) trans 17179874275 rc 0/0 00000100:00100000:2.0:1746066747.836060:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 841 00002000:00100000:2.0:1746066747.836074:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2965504->3145727) req@ffff880094304a80 x1830882982938368/t17179874275(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.836083:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304a80 with x1830882982938368 ext(2965504->3145727) 00010000:00010000:2.0:1746066747.836094:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 33 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.836106:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 33 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066747.836113:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304a80 00000100:00100000:1.0:1746066747.837270:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.837416:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982938624 00000100:00100000:2.0:1746066747.837424:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982938624 00010000:00010000:2.0:1746066747.837455:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 20 pid: 9590 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066747.837488:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6785 00000100:00100000:2.0:1746066747.837494:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982938624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.837509:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066747.837527:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 20 pid: 9590 timeout: 816 lvb_type: 1 00000100:00100000:1.0:1746066747.837576:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.837653:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982938752 00000100:00100000:0.0:1746066747.837657:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982938752 00010000:00010000:0.0:1746066747.837672:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 26 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066747.837695:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6786 00000100:00100000:0.0:1746066747.837701:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882982938752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066747.837707:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066747.837716:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 26 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066747.837725:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 26 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066747.837748:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576b600/0xf1867c21abfa55f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06d4 expref: 26 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066747.837781:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066747.837810:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982938752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066747.837816:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6786 00010000:00010000:2.0:1746066747.838180:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 20 pid: 9590 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066747.838194:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576b200/0xf1867c21abfa560c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06f0 expref: 20 pid: 9590 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066747.838220:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.838223:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.838231:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.838239:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.838274:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.838285:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984329984:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066747.838287:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984330112:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066747.838315:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.838329:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37e00, rc 0) 00000100:00100000:2.0:1746066747.838341:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.838354:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:32736:x1830882982938496:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9689us (10094us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.838360:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15198 00000100:00100000:2.0:1746066747.838416:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982938112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13047us (13647us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.838423:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3905 00002000:00100000:2.0:1746066747.838433:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012bb75c00 x1830882982938112/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.838441:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75c00 with x1830882982938112 ext(0->1048575) 00002000:00010000:2.0:1746066747.838445:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb75c00 00000100:00100000:2.0:1746066747.842998:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984330112:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066747.843021:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.843067:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982938624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5571us (5798us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.843078:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6785 00000100:00100000:1.0:1746066747.843228:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.843328:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982938880 00000100:00100000:2.0:1746066747.843334:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982938880 00010000:00010000:2.0:1746066747.843361:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 33 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066747.843399:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6787 00000100:00100000:2.0:1746066747.843406:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:2014:x1830882982938880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066747.843420:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066747.843438:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 33 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.843450:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 33 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.843474:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa561a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d06fe expref: 33 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.843497:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.843499:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.843506:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 48 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.843512:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 48 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.843567:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 48 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066747.843581:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984330240:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066747.843690:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.844226:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.844366:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982939008 00000100:00100000:3.0:1746066747.844371:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982939008 00000100:00100000:3.0:1746066747.844410:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15199 00000100:00100000:3.0:1746066747.844416:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:32739:x1830882982939008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.844431:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.844446:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d071a expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.844467:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.844473:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.844475:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.844478:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 34 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.844496:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.844513:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 48 pid: 9590 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.844521:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984330368:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.844569:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.847508:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.847535:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.847569:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982939264 00000100:00100000:2.0:1746066747.847580:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982939264 00000100:00100000:3.0:1746066747.847622:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984330240:192.168.204.16@tcp:105: 00002000:00100000:2.0:1746066747.847625:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3502080->3506175) req@ffff8800a03d4a80 x1830882982939264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.847634:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882982939264 ext(3502080->3506175) 00002000:00010000:2.0:1746066747.847648:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4a80 00010000:00010000:3.0:1746066747.847654:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066747.847672:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982939520 00000100:00100000:2.0:1746066747.847674:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982939520 00002000:00100000:2.0:1746066747.847685:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800a03d6d80 x1830882982939520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.847692:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882982939520 ext(2097152->3145727) 00002000:00010000:2.0:1746066747.847694:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6d80 00000100:00100000:2.0:1746066747.847705:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3906 00000100:00100000:2.0:1746066747.847711:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982939264:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.847950:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882982938880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4542us (4722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.847960:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6787 00000100:00100000:0.0:1746066747.848264:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3907 00000100:00100000:0.0:1746066747.848273:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882982939520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.848661:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982939264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 948us (1164us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066747.848668:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3906 00002000:00100000:2.0:1746066747.848675:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3502080->3506175) req@ffff8800a03d4a80 x1830882982939264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.848682:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882982939264 ext(3502080->3506175) 00002000:00010000:2.0:1746066747.848685:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4a80 00000100:00100000:3.0:1746066747.852564:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984330368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.852598:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 33 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.852617:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a400, rc 0) 00000100:00100000:3.0:1746066747.852674:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:32739:x1830882982939008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8257us (8447us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.852683:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15199 00000100:00100000:0.0:1746066747.853003:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.853149:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982939648 00000100:00100000:2.0:1746066747.853158:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982939648 00002000:00100000:2.0:1746066747.853200:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1318911) req@ffff8800a03d7480 x1830882982939648/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.853209:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882982939648 ext(1048576->1318911) 00010000:00010000:2.0:1746066747.853217:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.853228:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066747.853234:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d7480 00000100:00100000:2.0:1746066747.853808:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 842 00000100:00100000:2.0:1746066747.853816:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882982939648:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066747.855897:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882982939520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7601us (8337us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.855911:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3907 00002000:00100000:2.0:1746066747.855922:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800a03d6d80 x1830882982939520/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.855932:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882982939520 ext(2097152->3145727) 00002000:00010000:2.0:1746066747.855939:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6d80 00000100:00100000:2.0:1746066747.859014:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882982939648:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5187us (6001us total) trans 17179874276 rc 0/0 00000100:00100000:2.0:1746066747.859027:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 842 00002000:00100000:2.0:1746066747.859039:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1318911) req@ffff8800a03d7480 x1830882982939648/t17179874276(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.859050:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7480 with x1830882982939648 ext(1048576->1318911) 00010000:00010000:2.0:1746066747.859061:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.859077:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066747.859084:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d7480 00000100:00100000:0.0:1746066747.860823:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.860920:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982939776 00000100:00100000:3.0:1746066747.860930:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982939776 00000100:00100000:3.0:1746066747.860986:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15200 00000100:00100000:3.0:1746066747.860993:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:32734:x1830882982939776:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.861015:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.861033:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0721 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.861317:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.861324:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.861326:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066747.861330:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.861363:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.861375:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 15 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.861388:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984330496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.861528:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.864022:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.864165:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982939904 00000100:00100000:3.0:1746066747.864174:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982939904 00010000:00010000:3.0:1746066747.864208:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.864237:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6788 00000100:00100000:3.0:1746066747.864243:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+51:2013:x1830882982939904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066747.864257:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066747.864277:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.864288:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.864312:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa558e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0672 expref: 51 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.864332:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.864334:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.864340:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.864349:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.864381:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.864393:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984330624:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066747.864473:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066747.865276:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.865419:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982940032 00000100:00100000:2.0:1746066747.865424:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982940032 00002000:00100000:2.0:1746066747.865458:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3506175) req@ffff8800a03d4000 x1830882982940032/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.865468:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4000 with x1830882982940032 ext(3145728->3506175) 00010000:00010000:2.0:1746066747.865476:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 16 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.865489:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 16 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066747.865495:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d4000 00000100:00100000:2.0:1746066747.865510:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 843 00000100:00100000:2.0:1746066747.865517:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982940032:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066747.865708:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984330496:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.865731:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.865743:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37400, rc 0) 00000100:00100000:3.0:1746066747.866488:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:32734:x1830882982939776:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5493us (5669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.866496:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15200 00000100:00100000:3.0:1746066747.869731:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984330624:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066747.869754:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066747.870382:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882982939904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6137us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.870406:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6788 00000100:00100000:0.0:1746066747.871444:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.871472:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982940032:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5953us (6194us total) trans 21474841708 rc 0/0 00000100:00100000:2.0:1746066747.871482:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 843 00002000:00100000:2.0:1746066747.871494:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3506175) req@ffff8800a03d4000 x1830882982940032/t21474841708(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/448 e 0 to 0 dl 1746066758 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.871503:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4000 with x1830882982940032 ext(3145728->3506175) 00010000:00010000:2.0:1746066747.871513:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 18 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066747.871526:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 18 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066747.871534:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d4000 00000100:00100000:2.0:1746066747.871549:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982940288 00000100:00100000:2.0:1746066747.871555:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982940288 00002000:00100000:2.0:1746066747.871591:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a03d4380 x1830882982940288/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.871598:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4380 with x1830882982940288 ext(1048576->2097151) 00002000:00010000:2.0:1746066747.871602:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4380 00000100:00100000:2.0:1746066747.871627:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3908 00000100:00100000:2.0:1746066747.871634:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882982940288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066747.875010:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.875153:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982940416 00000100:00100000:3.0:1746066747.875163:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982940416 00010000:00010000:3.0:1746066747.875201:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 18 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.875238:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6789 00000100:00100000:3.0:1746066747.875246:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982940416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066747.875260:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066747.875282:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 18 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.875293:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 18 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.875318:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa562f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0713 expref: 18 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.875347:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.875349:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.875356:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.875365:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.875402:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.875415:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984330752:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066747.875509:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.877442:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984330752:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066747.877632:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066747.877690:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982940416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2443us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.877699:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882982940288:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6066us (6259us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066747.877700:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6789 00000100:00100000:2.0:1746066747.877707:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3908 00002000:00100000:2.0:1746066747.877717:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a03d4380 x1830882982940288/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.877725:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4380 with x1830882982940288 ext(1048576->2097151) 00002000:00010000:2.0:1746066747.877731:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4380 00000100:00100000:0.0:1746066747.880329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.880379:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.880403:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982940800 00000100:00100000:2.0:1746066747.880412:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982940800 00002000:00100000:2.0:1746066747.880452:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a03d4e00 x1830882982940800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.880459:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4e00 with x1830882982940800 ext(3145728->4194303) 00002000:00010000:2.0:1746066747.880464:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4e00 00000100:00100000:2.0:1746066747.880476:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982940928 00000100:00100000:2.0:1746066747.880478:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982940928 00002000:00100000:2.0:1746066747.880486:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a03d7800 x1830882982940928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.880490:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882982940928 ext(3145728->4194303) 00002000:00010000:2.0:1746066747.880492:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7800 00000100:00100000:2.0:1746066747.880509:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3909 00000100:00100000:2.0:1746066747.880519:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882982940800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.880538:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3910 00000100:00100000:3.0:1746066747.880545:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882982940928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.890793:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882982940928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10234us (10400us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066747.890805:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3910 00002000:00100000:3.0:1746066747.890817:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a03d7800 x1830882982940928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.890828:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882982940928 ext(3145728->4194303) 00002000:00010000:3.0:1746066747.890835:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7800 00000100:00100000:0.0:1746066747.890981:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.891034:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982941056 00000100:00100000:3.0:1746066747.891042:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982941056 00000100:00100000:0.0:1746066747.891066:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.891201:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982941184 00000100:00100000:3.0:1746066747.891204:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982941184 00000100:00100000:2.0:1746066747.891235:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15201 00000100:00100000:2.0:1746066747.891243:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882982941056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.891260:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066747.891266:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15202 00000100:00100000:1.0:1746066747.891275:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882982941184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066747.891276:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0728 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066747.891283:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066747.891293:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d072f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066747.891299:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.891301:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.891305:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066747.891306:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066747.891309:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066747.891311:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.891323:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066747.891323:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066747.891333:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e362600, rc 0) 00010000:00010000:1.0:1746066747.891333:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a400, rc 0) 00000100:00100000:2.0:1746066747.891495:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982941056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 251us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066747.891500:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15201 00000100:00100000:0.0:1746066747.892264:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882982941184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 989us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066747.892270:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15202 00000100:00100000:2.0:1746066747.895350:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882982940800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14820us (15020us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066747.895362:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3909 00002000:00100000:2.0:1746066747.895375:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a03d4e00 x1830882982940800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.895384:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4e00 with x1830882982940800 ext(3145728->4194303) 00002000:00010000:2.0:1746066747.895390:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4e00 00000100:00100000:1.0:1746066747.901682:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066747.901737:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.902397:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982941440 00000100:00100000:0.0:1746066747.902404:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982941440 00000100:00100000:0.0:1746066747.902445:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982941312 00000100:00100000:0.0:1746066747.902447:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982941312 00000100:00100000:0.0:1746066747.902462:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15203 00000100:00100000:0.0:1746066747.902468:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882982941440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066747.902485:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066747.902489:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15204 00010000:00010000:0.0:1746066747.902499:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d073d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.902501:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982941312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066747.902514:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066747.902520:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.902522:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066747.902529:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 51 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.902542:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 51 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066747.902551:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71c00, rc 0) 00000100:00100000:0.0:1746066747.902589:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882982941440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 119us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066747.902594:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15203 00010000:00010000:3.0:1746066747.902614:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0736 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.902631:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.902633:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.902652:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.902664:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.902672:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36000, rc 0) 00000100:00100000:0.0:1746066747.902679:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.902707:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982941312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 210us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.902712:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15204 00000100:00100000:0.0:1746066747.902733:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.902744:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982941696 00000100:00100000:2.0:1746066747.902748:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982941696 00000100:00100000:3.0:1746066747.902751:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982941952 00000100:00100000:3.0:1746066747.902759:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982941952 00002000:00100000:2.0:1746066747.902774:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880097a89c00 x1830882982941696/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066747.902781:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880097a88000 x1830882982941952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.902788:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89c00 with x1830882982941696 ext(2097152->4194303) 00002000:00100000:3.0:1746066747.902789:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88000 with x1830882982941952 ext(2097152->4194303) 00002000:00010000:2.0:1746066747.902792:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a89c00 00002000:00010000:3.0:1746066747.902793:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a88000 00000100:00100000:2.0:1746066747.902807:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3911 00000100:00100000:2.0:1746066747.902813:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982941696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.903326:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3912 00000100:00100000:1.0:1746066747.903333:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982941952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066747.908262:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.908340:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982942208 00000100:00100000:0.0:1746066747.908348:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982942208 00002000:00100000:0.0:1746066747.908418:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880094305c00 x1830882982942208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066747.908427:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830882982942208 ext(4194304->5033983) 00002000:00010000:0.0:1746066747.908431:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:0.0:1746066747.908460:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3913 00000100:00100000:0.0:1746066747.908467:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982942208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066747.916214:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982941952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12873us (13472us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066747.916224:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3912 00002000:00100000:1.0:1746066747.916235:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880097a88000 x1830882982941952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066747.916244:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88000 with x1830882982941952 ext(2097152->4194303) 00002000:00010000:1.0:1746066747.916250:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a88000 00000100:00100000:2.0:1746066747.920775:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982941696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17954us (18088us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066747.920787:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3911 00002000:00100000:2.0:1746066747.920796:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880097a89c00 x1830882982941696/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.920804:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89c00 with x1830882982941696 ext(2097152->4194303) 00002000:00010000:2.0:1746066747.920809:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a89c00 00000100:00100000:2.0:1746066747.922831:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982942208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14358us (14570us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066747.922840:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3913 00002000:00100000:2.0:1746066747.922849:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880094305c00 x1830882982942208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.922857:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830882982942208 ext(4194304->5033983) 00002000:00010000:2.0:1746066747.922862:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:0.0:1746066747.934597:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.934727:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982942464 00000100:00100000:2.0:1746066747.934735:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982942464 00002000:00100000:2.0:1746066747.934777:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a89180 x1830882982942464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.934786:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89180 with x1830882982942464 ext(4194304->5033983) 00002000:00010000:2.0:1746066747.934791:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a89180 00000100:00100000:2.0:1746066747.934847:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3914 00000100:00100000:2.0:1746066747.934855:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882982942464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066747.941673:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882982942464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6810us (7075us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066747.941684:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3914 00002000:00100000:2.0:1746066747.941693:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a89180 x1830882982942464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:153/0 lens 488/440 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.941702:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89180 with x1830882982942464 ext(4194304->5033983) 00002000:00010000:2.0:1746066747.941707:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a89180 00000100:00100000:0.0:1746066747.970796:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.970875:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982942592 00000100:00100000:3.0:1746066747.970904:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982942592 00000100:00100000:3.0:1746066747.970945:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15205 00000100:00100000:3.0:1746066747.970951:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:32744:x1830882982942592:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066747.970966:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.970979:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0744 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.971003:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.971012:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 52 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.971017:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.971018:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.971022:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1994752->2097151] (req 1994752->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 52 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.971046:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 52 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.971057:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 52 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066747.971067:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984330880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.971153:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.971161:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 33 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.971168:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984331008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.971184:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.972878:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984330880:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.972908:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984331008:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.972927:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1994752->2097151] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 52 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.972940:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b600, rc 0) 00000100:00100000:3.0:1746066747.972967:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:32744:x1830882982942592:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2015us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.972973:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15205 00000100:00100000:0.0:1746066747.974511:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.975525:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982942720 00000100:00100000:3.0:1746066747.975532:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982942720 00010000:00010000:3.0:1746066747.975564:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 52 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066747.975590:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6790 00000100:00100000:3.0:1746066747.975598:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+52:2015:x1830882982942720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066747.975610:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066747.975626:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 52 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066747.975636:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 52 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066747.975664:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f6e00/0xf1867c21abfa5541 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0625 expref: 52 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746066747.975928:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.975943:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982942848 00000100:00100000:0.0:1746066747.975946:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982942848 00010000:00010000:0.0:1746066747.975957:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 34 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066747.975971:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6791 00000100:00100000:0.0:1746066747.975975:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882982942848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066747.975981:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066747.975987:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 34 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066747.975995:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 34 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066747.976005:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9c00/0xf1867c21abfa5510 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d05f4 expref: 34 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.976098:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.976100:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.976106:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 51 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.976113:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 51 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.976135:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 51 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.976144:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984331136:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066747.976206:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066747.976410:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066747.976431:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882982942848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 455us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066747.976438:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6791 00000100:00100000:3.0:1746066747.978574:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984331136:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066747.978591:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066747.978618:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882982942720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3021us (4111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.978625:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6790 00000100:00100000:0.0:1746066747.982117:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066747.982186:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982943104 00000100:00100000:2.0:1746066747.982192:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982943104 00002000:00100000:2.0:1746066747.982234:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1994752->1998847) req@ffff88012c8bb480 x1830882982943104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/0 e 0 to 0 dl 1746066758 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.982244:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bb480 with x1830882982943104 ext(1994752->1998847) 00002000:00010000:2.0:1746066747.982249:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8bb480 00000100:00100000:2.0:1746066747.982265:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3915 00000100:00100000:2.0:1746066747.982271:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882982943104:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066747.982607:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882982943104:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 335us (495us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066747.982612:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3915 00002000:00100000:2.0:1746066747.982617:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1994752->1998847) req@ffff88012c8bb480 x1830882982943104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:153/0 lens 488/4536 e 0 to 0 dl 1746066758 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066747.982624:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8bb480 with x1830882982943104 ext(1994752->1998847) 00002000:00010000:2.0:1746066747.982626:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c8bb480 00000100:00100000:1.0:1746066747.986054:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.986719:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982943232 00000100:00100000:3.0:1746066747.986728:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982943232 00000100:00100000:3.0:1746066747.986780:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15206 00000100:00100000:3.0:1746066747.986787:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:32744:x1830882982943232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066747.986803:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066747.986818:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d074b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.986843:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.986851:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.986857:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.986859:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.986862:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1622015] (req 1048576->1622015) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.986913:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066747.987385:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 28 pid: 9590 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066747.987534:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984331264:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.987817:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 17 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.987831:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 17 pid: 9590 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066747.987838:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984331392:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.988646:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.993047:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984331264:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066747.993060:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984331392:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066747.993821:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1622015] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.993838:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a000, rc 0) 00000100:00100000:3.0:1746066747.993906:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:32744:x1830882982943232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7119us (7857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.993914:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15206 00000100:00100000:0.0:1746066747.994558:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066747.994766:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066747.994926:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982943360 00000100:00100000:3.0:1746066747.994932:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982943360 00010000:00010000:3.0:1746066747.994954:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 28 pid: 9590 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066747.995172:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982943488 00000100:00100000:3.0:1746066747.995175:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982943488 00010000:00010000:3.0:1746066747.995186:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 18 pid: 9590 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066747.995218:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6792 00000100:00100000:1.0:1746066747.995226:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882982943360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066747.995237:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066747.995252:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 28 pid: 9590 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066747.995261:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 28 pid: 9590 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066747.995278:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa55a3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0687 expref: 28 pid: 9590 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066747.995569:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066747.995786:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6793 00000100:00100000:3.0:1746066747.995793:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882982943488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066747.995800:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066747.995808:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 18 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.995816:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 18 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.995828:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa5587 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d066b expref: 18 pid: 9590 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066747.995839:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.995841:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066747.995846:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.995853:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066747.995874:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066747.995903:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984331520:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066747.995962:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982943360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 736us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066747.995968:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6792 00000100:00100000:3.0:1746066747.996391:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066747.998160:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984331520:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066747.998174:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066747.998200:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+17:2014:x1830882982943488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2407us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066747.998208:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6793 00000100:00100000:2.0:1746066748.005053:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.005114:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982943744 00000100:00100000:0.0:1746066748.005122:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982943744 00002000:00100000:0.0:1746066748.005157:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1617920->1622015) req@ffff880098926d80 x1830882982943744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066748.005166:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882982943744 ext(1617920->1622015) 00002000:00010000:0.0:1746066748.005170:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066748.005199:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3916 00000100:00100000:0.0:1746066748.005206:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982943744:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066748.005324:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982943744:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 117us (277us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066748.005330:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3916 00002000:00100000:0.0:1746066748.005336:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1617920->1622015) req@ffff880098926d80 x1830882982943744/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066748.005343:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882982943744 ext(1617920->1622015) 00002000:00010000:0.0:1746066748.005345:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066748.017184:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.017301:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982943872 00000100:00100000:3.0:1746066748.017312:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982943872 00000100:00100000:3.0:1746066748.017386:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16142 00000100:00100000:3.0:1746066748.017395:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:32748:x1830882982943872:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.017421:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.017440:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa566e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0752 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.017501:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017514:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017525:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017537:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017542:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017547:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017618:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017629:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d2 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.017648:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 45 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.017655:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.017684:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 45 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.017695:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 45 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.017707:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984331648:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.017804:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d2 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.017812:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d2 expref: 26 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.017819:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984331776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.017837:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746066748.018528:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066748.021477:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984331648:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.021489:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984331776:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.021514:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066748.022425:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.023196:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982944256 00000100:00100000:2.0:1746066748.023205:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982944256 00000100:00100000:2.0:1746066748.023269:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5860 00000100:00100000:2.0:1746066748.023278:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:30848:x1830882982944256:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066748.023521:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:30848:x1830882982944256:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 242us (1096us total) trans 8589936446 rc 0/0 00000100:00100000:2.0:1746066748.023527:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5860 00000100:00100000:2.0:1746066748.023576:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.023592:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982944384 00000100:00100000:2.0:1746066748.023595:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982944384 00000100:00080000:0.0:1746066748.023632:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066748.025095:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5861 00000100:00100000:2.0:1746066748.025108:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:30847:x1830882982944384:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066748.025268:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:30847:x1830882982944384:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 165us (1692us total) trans 8589936447 rc 0/0 00000100:00100000:2.0:1746066748.025274:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5861 00000100:00100000:0.0:1746066748.027043:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.027116:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982944512 00000100:00100000:3.0:1746066748.027125:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982944512 00010000:00010000:3.0:1746066748.027157:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 47 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.027181:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6794 00000100:00100000:3.0:1746066748.027186:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882982944512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.027199:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.027204:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 47 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.027213:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 47 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.027233:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa52fc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03e7 expref: 47 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.027688:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.027694:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.027702:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.027706:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.027951:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.028310:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882982944512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1121us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.028318:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6794 00000100:00100000:0.0:1746066748.028509:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.028583:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982944640 00000100:00100000:3.0:1746066748.028587:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982944640 00010000:00010000:3.0:1746066748.028603:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d2 expref: 28 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.028618:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6795 00000100:00100000:3.0:1746066748.028623:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882982944640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.028632:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.028646:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d2 expref: 28 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.028655:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d2 expref: 28 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.028669:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa52d9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d03d2 expref: 28 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.028678:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.028681:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028688:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028695:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028715:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066748.028727:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028733:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066748.028785:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066748.028789:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066748.028804:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028813:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028823:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028829:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028835:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028840:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028845:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.028848:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028855:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028862:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066748.028865:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.028868:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028872:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa5675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028896:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028901:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028905:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028909:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.028911:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028916:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028922:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800957eae00) 00010000:00010000:3.0:1746066748.028924:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.028926:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028931:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa567c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.028958:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0a00/0xf1867c21abfa566e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.028968:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 20 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.028974:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.028976:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066748.028978:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0600, rc 0) 00000100:00100000:3.0:1746066748.029013:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:32748:x1830882982943872:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 11619us (11839us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.029019:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16142 00000100:00100000:3.0:1746066748.029047:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882982944640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 424us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.029053:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6795 00000100:00100000:0.0:1746066748.032234:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.032271:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.032297:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.032315:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.032341:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.032366:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982944768 00000100:00100000:0.0:1746066748.032369:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.032375:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982944768 00000100:00080000:0.0:1746066748.032403:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066748.032416:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982944896 00000100:00100000:1.0:1746066748.032417:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982944896 00000100:00100000:0.0:1746066748.032424:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982945024 00000100:00100000:0.0:1746066748.032427:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982945024 00000100:00100000:1.0:1746066748.032432:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982945152 00000100:00100000:1.0:1746066748.032434:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982945152 00000100:00100000:1.0:1746066748.032447:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982945280 00000100:00100000:1.0:1746066748.032448:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982945280 00000100:00100000:0.0:1746066748.032448:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15207 00000100:00100000:0.0:1746066748.032454:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982944768:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066748.032457:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982945408 00000100:00100000:1.0:1746066748.032459:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982945408 00000100:00100000:1.0:1746066748.032468:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15208 00000100:00100000:1.0:1746066748.032473:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982944896:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.032473:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.032481:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.032490:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0759 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.032491:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0760 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.032510:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.032513:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.032522:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.032534:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.032544:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cf7800, rc 0) 00000100:00100000:0.0:1746066748.032584:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982944768:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.032589:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15207 00000100:00100000:0.0:1746066748.032603:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15209 00000100:00100000:0.0:1746066748.032607:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982945024:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.032613:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.032620:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfa5698 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0767 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.032667:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984331904:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066748.032693:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.032696:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.032703:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.032716:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066748.032720:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066748.032724:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9c600, rc 0) 00000100:00100000:0.0:1746066748.032737:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15210 00000100:00100000:0.0:1746066748.032742:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982945152:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066748.032745:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882982944896:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 271us (474us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066748.032747:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066748.032751:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15208 00010000:00010000:0.0:1746066748.032753:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa569f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d076e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.032762:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15211 00000100:00100000:1.0:1746066748.032767:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982945280:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066748.032772:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066748.032773:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984332032:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066748.032779:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0775 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.032790:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746066748.032792:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.032793:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.032797:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00000100:00080000:0.0:1746066748.032798:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746066748.032805:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.032812:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9ce00, rc 0) 00000100:00100000:1.0:1746066748.032825:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982945280:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 58us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.032829:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15211 00000100:00100000:1.0:1746066748.032838:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15212 00000100:00100000:1.0:1746066748.032842:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982945408:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066748.032847:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.032852:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d077c expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.032861:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.032862:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.032866:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.032874:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.032913:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9c000, rc 0) 00000100:00100000:1.0:1746066748.032929:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882982945408:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 86us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.032934:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15212 00002000:00010000:0.0:1746066748.038091:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066748 -> 1746066749 00002000:00010000:0.0:1746066748.038100:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066748 -> 1746066749 00000100:00100000:0.0:1746066748.038125:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984332032:192.168.204.16@tcp:106: 00002000:00010000:1.0:1746066748.038136:0:13363:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066747 -> 1746066749 00002000:00010000:1.0:1746066748.038140:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066747 -> 1746066748 00002000:00010000:1.0:1746066748.038141:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066747 -> 1746066749 00000100:00100000:1.0:1746066748.038152:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984331904:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066748.038158:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa569f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d076e expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.038171:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfa5698 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0767 expref: 17 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.038172:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa569f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d076e expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.038180:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356ac00/0xf1867c21abfa5698 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0767 expref: 17 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.038187:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71600, rc 0) 00010000:00010000:1.0:1746066748.038192:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ac00, rc 0) 00000100:00100000:0.0:1746066748.038239:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982945152:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5494us (5921us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066748.038250:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15210 00000100:00100000:1.0:1746066748.039260:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982945024:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6647us (6957us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066748.039267:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15209 00000100:00100000:0.0:1746066748.042270:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.042356:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982945664 00000100:00100000:3.0:1746066748.042365:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982945664 00000100:00100000:3.0:1746066748.042418:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16143 00000100:00100000:3.0:1746066748.042426:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:32748:x1830882982945664:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.042444:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.042460:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576be00/0xf1867c21abfa56b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0783 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.042560:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.042574:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.042582:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.042614:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.042627:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 21 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.042650:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984332160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.043092:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.044050:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746066748.044065:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984332288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746066748.044111:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.044492:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984332288 00000100:00100000:2.0:1746066748.044499:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984332288 00000100:00100000:2.0:1746066748.044541:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1746066748.044547:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984332288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746066748.044566:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1083787712 pending 3178496 free 3906453504 avail 3674931200 00000100:00080000:1.0:1746066748.045195:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066748.045758:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984332288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1209us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.045766:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1746066748.046221:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984332288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066748.047395:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.047578:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982945792 00000100:00100000:2.0:1746066748.047585:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982945792 00010000:00010000:2.0:1746066748.047617:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 22 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.047716:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984332160:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.047736:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066748.048102:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6796 00000100:00100000:2.0:1746066748.048110:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2015:x1830882982945792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.048123:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.048129:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 22 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.048140:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 22 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.048162:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0600/0xf1867c21abfa5683 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0752 expref: 22 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.048179:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.048184:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.048194:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.048200:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.048220:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066748.048404:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.048411:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066748.048431:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066748.048554:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576be00/0xf1867c21abfa56b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.049007:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2015:x1830882982945792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 896us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.049015:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6796 00010000:00010000:3.0:1746066748.049553:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.049561:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.049563:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066748.049567:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:3.0:1746066748.049865:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:32748:x1830882982945664:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7438us (7604us total) trans 8589936448 rc 0/0 00000100:00100000:3.0:1746066748.049873:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16143 00000100:00100000:0.0:1746066748.051937:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.052036:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982945920 00000100:00100000:3.0:1746066748.052045:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982945920 00000100:00100000:3.0:1746066748.052096:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16144 00000100:00100000:3.0:1746066748.052103:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:32748:x1830882982945920:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.052125:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.052142:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa56c9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d078a expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.052227:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.052241:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.052247:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066748.052278:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.052290:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 22 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.052301:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984332416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.052371:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.055065:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984332416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.055087:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066748.055578:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.055746:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982946048 00000100:00100000:2.0:1746066748.055754:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982946048 00010000:00010000:2.0:1746066748.055784:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 23 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.055808:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6797 00000100:00100000:2.0:1746066748.055815:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2016:x1830882982946048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.055828:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.055832:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 23 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.055841:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 23 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.055862:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa56bb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0783 expref: 23 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.055905:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.055909:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.055920:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.055930:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.055946:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.055995:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2016:x1830882982946048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 179us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.056002:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6797 00010000:00010000:2.0:1746066748.056027:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.056033:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066748.056082:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066748.056086:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066748.056101:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.056131:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa56c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d078a expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.056142:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d078a expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.056148:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.056150:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066748.056152:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0400, rc 0) 00000100:00100000:2.0:1746066748.056174:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:32748:x1830882982945920:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4072us (4247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.056180:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16144 00000100:00100000:2.0:1746066748.059803:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.060778:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.060808:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982946176 00000100:00100000:1.0:1746066748.060816:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982946176 00000100:00100000:1.0:1746066748.060865:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982946304 00000100:00100000:1.0:1746066748.060867:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982946304 00000100:00100000:0.0:1746066748.060872:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15213 00000100:00100000:0.0:1746066748.060893:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882982946176:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066748.060897:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15214 00000100:00100000:1.0:1746066748.060902:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882982946304:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066748.060909:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.060909:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.060923:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f9dc00/0xf1867c21abfa56d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0798 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.060923:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa56de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0791 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.060967:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984332672:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066748.060967:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984332544:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066748.061180:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.061273:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.065650:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984332672:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066748.065682:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f9dc00/0xf1867c21abfa56d7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0798 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.065696:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f9dc00/0xf1867c21abfa56d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0798 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.065709:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9dc00, rc 0) 00000100:00100000:1.0:1746066748.065760:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882982946304:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4856us (4981us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066748.065768:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15214 00000100:00100000:2.0:1746066748.065865:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984332544:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066748.066153:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa56de lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0791 expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.066166:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa56de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0791 expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.066178:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71800, rc 0) 00000100:00100000:2.0:1746066748.066203:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882982946176:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5323us (6407us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066748.066208:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15213 00000100:00100000:0.0:1746066748.068855:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.069073:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982946560 00000100:00100000:2.0:1746066748.069080:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982946560 00000100:00100000:2.0:1746066748.069119:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16145 00000100:00100000:2.0:1746066748.069125:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:32748:x1830882982946560:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066748.069141:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.069157:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa56e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d079f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.069248:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa56ec lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.069261:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa56ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066748.069270:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa56ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066748.069280:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066748.069359:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa56e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d079f expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.069373:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa56ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d079f expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.069380:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.069382:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066748.069385:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecec00, rc 0) 00000100:00100000:2.0:1746066748.069440:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:32748:x1830882982946560:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 314us (592us total) trans 8589936449 rc 0/0 00000100:00100000:2.0:1746066748.069446:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16145 00000100:00100000:0.0:1746066748.073842:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.074049:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982946688 00000100:00100000:2.0:1746066748.074058:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982946688 00000100:00100000:2.0:1746066748.074104:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15215 00000100:00100000:2.0:1746066748.074110:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982946688:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066748.074142:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.074158:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.074166:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.074172:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 26 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.074178:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.074180:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.074183:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.074209:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 26 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.074218:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 26 pid: 12237 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.074230:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984332800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.074307:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.074314:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 11 pid: 13363 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746066748.074693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.074729:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982946816 00000100:00100000:1.0:1746066748.074733:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982946816 00000100:00100000:1.0:1746066748.074756:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15216 00000100:00100000:1.0:1746066748.074761:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982946816:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066748.074784:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.074796:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.074803:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.074811:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 50 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066748.074812:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066748.074816:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.074818:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.074819:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.074829:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066748.074835:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 50 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066748.074842:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066748.074844:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 50 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:1.0:1746066748.074852:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984333056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.074861:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066748.074910:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066748.075017:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947072 00000100:00100000:3.0:1746066748.075022:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947072 00000100:00100000:3.0:1746066748.075046:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947328 00000100:00100000:3.0:1746066748.075048:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947328 00000100:00100000:3.0:1746066748.075059:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982946944 00000100:00100000:3.0:1746066748.075061:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982946944 00000100:00100000:3.0:1746066748.075076:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947200 00000100:00100000:3.0:1746066748.075078:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947200 00000100:00100000:3.0:1746066748.075091:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15217 00000100:00100000:3.0:1746066748.075097:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982947072:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066748.075113:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075124:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075129:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.075131:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.075132:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075147:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075155:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.075162:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984333312:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.075204:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 18 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:1.0:1746066748.075213:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984333184:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.075228:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15218 00000100:00100000:1.0:1746066748.075233:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982947328:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066748.075248:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.075257:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 50 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.075262:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.075267:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.075271:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.075273:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.075274:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.075289:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.075300:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 32 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:1.0:1746066748.075307:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984333440:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.075359:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984332928:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.075476:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15219 00000100:00100000:0.0:1746066748.075482:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982946944:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:3.0:1746066748.075533:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.075553:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15220 00000100:00100000:3.0:1746066748.075558:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982947200:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066748.075574:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075583:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075589:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.075594:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.075598:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.075600:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.075601:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075615:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.075621:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 16 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.075628:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984333568:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.075666:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.075678:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 13 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.075684:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984333696:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.075706:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.075713:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.075720:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984333824:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.075734:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00010000:00010000:0.0:1746066748.075788:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.075802:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 50 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.075807:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066748.075808:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066748.075810:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.075826:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 50 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.075834:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 50 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.075841:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984333952:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.075860:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800975583c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066748.076276:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.076284:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.076286:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.076294:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 18 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.076297:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984334080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.076303:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984334208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.076315:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00010000:00010000:1.0:1746066748.076328:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 50 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.076335:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 50 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.076341:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984334336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.076354:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066748.076377:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.076384:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 32 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.076395:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984334464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.076410:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.078590:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984333952:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066748.078607:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.078762:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984333440:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.078770:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984334208:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.078776:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984334336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.078791:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.078810:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984333056:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.078816:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984333184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.078877:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984333312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.078915:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.078935:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984333568:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.078942:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984333696:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.079020:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984332800:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.079027:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984332928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.079033:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984334080:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.079046:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.081955:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984333824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.081979:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.082277:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.082463:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984334464:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.082485:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.082663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.082696:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.082738:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947968 00000100:00100000:3.0:1746066748.082962:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947968 00002000:00100000:3.0:1746066748.082997:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1994752->2097151) req@ffff8800a4d0f100 x1830882982947968/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.083006:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0f100 with x1830882982947968 ext(1994752->2097151) 00010000:00010000:3.0:1746066748.083012:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 51 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.083022:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 51 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066748.083028:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d0f100 00000100:00100000:0.0:1746066748.083162:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.083462:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 844 00000100:00100000:3.0:1746066748.083471:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2014:x1830882982947968:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066748.084054:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947712 00000100:00100000:2.0:1746066748.084059:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947712 00000100:00100000:2.0:1746066748.084069:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947456 00000100:00100000:2.0:1746066748.084071:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947456 00010000:00010000:2.0:1746066748.084091:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 27 pid: 12237 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.084106:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947840 00000100:00100000:2.0:1746066748.084108:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947840 00010000:00010000:2.0:1746066748.084116:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 14 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.084127:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6798 00000100:00100000:2.0:1746066748.084132:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982947456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066748.084137:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 53 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.084140:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.084154:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 27 pid: 12237 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746066748.084160:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6799 00010000:00010000:2.0:1746066748.084164:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 27 pid: 12237 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746066748.084166:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982947840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066748.084172:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.084182:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa5659 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0736 expref: 27 pid: 12237 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746066748.084182:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 14 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746066748.084190:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 14 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.084198:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066748.084202:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f9ce00/0xf1867c21abfa56a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0775 expref: 14 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:0.0:1746066748.084214:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.084222:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882982947456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.084229:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6798 00000100:00100000:3.0:1746066748.084243:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6800 00000100:00100000:3.0:1746066748.084248:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:2014:x1830882982947712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066748.084254:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982947840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (1091us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066748.084255:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066748.084259:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6799 00010000:00010000:3.0:1746066748.084263:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 53 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.084270:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 53 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.084279:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71c00/0xf1867c21abfa5652 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d073d expref: 53 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.084300:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.084319:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:2014:x1830882982947712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.084328:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6800 00000100:00100000:3.0:1746066748.086818:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:2014:x1830882982947968:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3336us (4142us total) trans 17179874277 rc 0/0 00000100:00100000:3.0:1746066748.087117:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 844 00002000:00100000:3.0:1746066748.087134:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1994752->2097151) req@ffff8800a4d0f100 x1830882982947968/t17179874277(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.087144:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0f100 with x1830882982947968 ext(1994752->2097151) 00010000:00010000:3.0:1746066748.087157:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 52 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.087171:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 52 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066748.087178:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4d0f100 00000001:00080000:0.0:1746066748.087595:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874277 is committed 00000001:00080000:0.0:1746066748.087608:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874275 is committed 00000001:00080000:0.0:1746066748.087678:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874257 is committed 00000001:00080000:0.0:1746066748.087690:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874252 is committed 00000100:00100000:0.0:1746066748.089464:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.090229:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948736 00000100:00100000:3.0:1746066748.090238:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948736 00010000:00010000:3.0:1746066748.090273:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.090316:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6801 00000100:00100000:3.0:1746066748.090324:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882982948736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.090344:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.090367:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.090377:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.090400:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b600/0xf1867c21abfa5660 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1994752->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0744 expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.090415:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.090418:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.090422:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.090430:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.090464:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.090521:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882982948736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 196us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.090527:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6801 00010000:00010000:0.0:1746066748.090654:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.090663:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.090681:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.090688:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.090696:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.090703:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d70400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066748.090707:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.090716:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.091308:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.091316:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa571d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.091372:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982946944:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 15889us (16528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.091380:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15219 00000100:00100000:0.0:1746066748.091834:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.092916:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.093208:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948224 00000100:00100000:3.0:1746066748.093215:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948224 00010000:00010000:3.0:1746066748.093250:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 13 pid: 13363 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.093274:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6802 00000100:00100000:3.0:1746066748.093282:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982948224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.093294:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.093312:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 13 pid: 13363 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.093323:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 13 pid: 13363 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.093341:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cf7800/0xf1867c21abfa568a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0759 expref: 13 pid: 13363 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.093356:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.093549:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982947584 00000100:00100000:2.0:1746066748.093554:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982947584 00002000:00100000:2.0:1746066748.093588:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1622015) req@ffff8800a5d7d880 x1830882982947584/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.093598:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830882982947584 ext(1048576->1622015) 00010000:00010000:2.0:1746066748.093604:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.093614:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 26 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066748.093620:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7d880 00000100:00100000:1.0:1746066748.094060:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 845 00000100:00100000:1.0:1746066748.094070:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982947584:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066748.094071:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982948224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 787us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.094080:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6802 00000100:00100000:0.0:1746066748.094182:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.094263:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.094287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.094300:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.094312:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.094320:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948480 00000100:00100000:0.0:1746066748.094326:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948864 00000100:00100000:0.0:1746066748.094329:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948864 00000100:00100000:2.0:1746066748.094331:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948480 00010000:00010000:2.0:1746066748.094364:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 11 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.094394:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948096 00000100:00100000:2.0:1746066748.094396:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948096 00010000:00010000:2.0:1746066748.094406:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 7 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.094414:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948352 00000100:00100000:2.0:1746066748.094416:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948352 00010000:00010000:2.0:1746066748.094424:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 18 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.094432:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948608 00000100:00100000:2.0:1746066748.094433:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948608 00010000:00010000:2.0:1746066748.094440:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 12 pid: 3528 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.094449:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6803 00000100:00100000:2.0:1746066748.094455:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982948480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.094467:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.094483:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 12 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.094494:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 12 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.094512:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa56ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d077c expref: 12 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.094529:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.094538:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6804 00000100:00100000:3.0:1746066748.094546:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882982948096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.094556:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.094570:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 7 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.094580:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 7 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.094593:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa564b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d072f expref: 7 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.094608:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.094622:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6805 00000100:00100000:3.0:1746066748.094623:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+6:2016:x1830882982948096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.094628:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982948352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066748.094629:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6804 00010000:00010000:1.0:1746066748.094648:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066748.094656:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6806 00010000:00010000:1.0:1746066748.094659:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 18 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.094661:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982948608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.094667:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.094670:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 18 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.094675:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 11 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.094682:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 11 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066748.094683:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e362600/0xf1867c21abfa5644 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0728 expref: 18 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.094692:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f9c600/0xf1867c21abfa5691 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0760 expref: 11 pid: 3528 timeout: 816 lvb_type: 1 00010000:00010000:3.0:1746066748.094699:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066748.094702:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.094709:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982948608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.094714:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6806 00000100:00100000:1.0:1746066748.094719:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882982948352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.094725:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6805 00000100:00100000:3.0:1746066748.094740:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.094744:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982948480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 288us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.094752:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6803 00000100:00100000:2.0:1746066748.094793:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982948992 00000100:00100000:2.0:1746066748.094796:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982948992 00010000:00010000:2.0:1746066748.094805:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 6 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.094828:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6807 00000100:00100000:2.0:1746066748.094833:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+6:2013:x1830882982948992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.094839:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.094847:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 6 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.094855:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 6 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066748.094864:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.094866:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356a400/0xf1867c21abfa5636 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d071a expref: 6 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.094874:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.094876:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.094880:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.094897:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6808 00000100:00100000:3.0:1746066748.094938:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882982948864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.094946:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.094955:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.094963:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.094974:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356a600/0xf1867c21abfa5621 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0705 expref: 16 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.094987:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.094989:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.094992:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.095001:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.095022:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.095038:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882982948864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 136us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.095043:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6808 00010000:00010000:3.0:1746066748.095062:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.095069:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.095072:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.095084:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.095092:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.095093:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066748.095099:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.095105:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ecf200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066748.095109:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.095111:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+5:2013:x1830882982948992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 277us (370us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066748.095115:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.095117:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6807 00010000:00010000:3.0:1746066748.095124:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.095129:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecf200/0xf1867c21abfa56fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.095166:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982946688:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 21056us (21330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.095174:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15215 00010000:00010000:1.0:1746066748.095187:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095196:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095210:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095216:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095222:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095227:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f9da00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066748.095230:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095236:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095245:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.095250:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f9da00/0xf1867c21abfa5701 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.095285:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882982946816:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 20523us (20591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.095291:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15216 00000100:00100000:3.0:1746066748.095694:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.095766:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982949120 00000100:00100000:2.0:1746066748.095770:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982949120 00010000:00010000:2.0:1746066748.095784:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 28 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.096054:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6809 00000100:00100000:2.0:1746066748.096061:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882982949120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.096070:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.096080:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 28 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.096089:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 28 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.096101:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37400/0xf1867c21abfa563d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0721 expref: 28 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.096109:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.096111:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.096114:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.096121:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.096147:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.096178:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982949120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.096184:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6809 00010000:00010000:3.0:1746066748.096271:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096283:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096297:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096304:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096310:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096315:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576a600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066748.096318:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096324:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096332:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.096337:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa5716 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.096369:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982947200:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 20810us (21507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.096375:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15220 00000100:00100000:0.0:1746066748.097222:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.097599:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982949248 00000100:00100000:1.0:1746066748.097606:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982949248 00010000:00010000:1.0:1746066748.097631:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 25 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.097675:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6810 00000100:00100000:1.0:1746066748.097682:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882982949248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.097693:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.097707:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 25 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.097718:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 25 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.097736:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa5628 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d070c expref: 25 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.097750:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.097751:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.097755:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.097762:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.097778:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.097799:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882982949248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.097804:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6810 00010000:00010000:0.0:1746066748.098594:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098603:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098621:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098628:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098634:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098653:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cf6400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066748.098658:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098666:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098679:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.098684:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa570f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.098752:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2015:x1830882982947328:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 23518us (23921us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.098760:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15218 00000100:00100000:2.0:1746066748.106068:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982947584:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 11987us (14223us total) trans 21474841709 rc 0/0 00000100:00100000:2.0:1746066748.106082:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 845 00002000:00100000:2.0:1746066748.106096:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1622015) req@ffff8800a5d7d880 x1830882982947584/t21474841709(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.106107:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7d880 with x1830882982947584 ext(1048576->1622015) 00010000:00010000:2.0:1746066748.106117:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.106133:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066748.106140:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5d7d880 00000100:00100000:0.0:1746066748.113873:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.114832:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982949376 00000100:00100000:2.0:1746066748.114845:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982949376 00010000:00010000:2.0:1746066748.114903:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.115181:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6811 00000100:00100000:2.0:1746066748.115190:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882982949376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.115206:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.115224:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.115236:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.115258:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a000/0xf1867c21abfa5667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1622015) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d074b expref: 27 pid: 9592 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.115396:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.115399:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.115403:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.115412:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.115671:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066748.115855:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115863:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115896:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115906:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115917:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115924:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc1600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066748.115927:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115935:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115945:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.115950:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5708 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.116036:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882982949376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 845us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.116043:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6811 00000100:00100000:0.0:1746066748.116326:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982947072:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 41228us (41513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.116334:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15217 00000100:00100000:0.0:1746066748.118873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.119385:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982949632 00000100:00100000:2.0:1746066748.119396:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982949632 00000100:00100000:2.0:1746066748.119442:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16146 00000100:00100000:2.0:1746066748.119450:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:32748:x1830882982949632:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746066748.119501:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.119527:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0400/0xf1867c21abfa56d0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d078a expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119557:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.119561:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066748.119589:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.119601:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119608:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa5055 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d025f expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119614:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0059 expref: 45 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119619:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa4d06 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0060 expref: 26 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119624:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119629:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa51c1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d032a expref: 26 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119648:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.119677:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa51c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d032a expref: 26 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119686:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa51c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d032a expref: 26 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.119699:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.119776:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119783:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.119789:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334720:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.119804:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa4d06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0060 expref: 26 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119809:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa4d06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0060 expref: 26 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.119815:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334848:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.119829:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0059 expref: 45 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119838:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0059 expref: 45 pid: 13370 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.119844:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334976:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.119863:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa5055 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d025f expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119869:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa5055 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d025f expref: 26 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.119876:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984335104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.119926:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.119933:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 45 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.119939:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984335232:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.119954:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.123819:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.123849:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334592:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.123859:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334720:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.123940:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.123961:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982949888 00000100:00100000:1.0:1746066748.123969:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982949888 00000100:00100000:3.0:1746066748.124026:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982950144 00000100:00100000:3.0:1746066748.124030:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982950144 00000100:00100000:3.0:1746066748.124081:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5862 00000100:00100000:3.0:1746066748.124089:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:19150:x1830882982950144:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066748.124292:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:19150:x1830882982950144:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 203us (351us total) trans 8589936450 rc 0/0 00000100:00100000:3.0:1746066748.124299:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5862 00000100:00100000:3.0:1746066748.124315:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5863 00000100:00100000:3.0:1746066748.124320:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:8545:x1830882982949888:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066748.124493:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.124500:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984334976:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.124508:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984335104:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.124514:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984335232:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.124551:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066748.124626:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.124667:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.124680:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.124692:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982950272 00000100:00100000:1.0:1746066748.124696:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982950272 00000100:00100000:0.0:1746066748.124702:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.124703:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982950528 00000100:00100000:2.0:1746066748.124705:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982950528 00010000:00010000:1.0:1746066748.124714:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa4d06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0060 expref: 28 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.124715:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 47 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.124732:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982950400 00000100:00100000:1.0:1746066748.124733:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982950656 00000100:00100000:2.0:1746066748.124734:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982950400 00000100:00100000:1.0:1746066748.124734:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982950656 00010000:00010000:2.0:1746066748.124741:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0059 expref: 48 pid: 13370 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.124741:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa5055 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d025f expref: 29 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.124750:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6812 00000100:00100000:1.0:1746066748.124755:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882982950528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066748.124756:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6813 00000100:00100000:2.0:1746066748.124760:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882982950272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.124764:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.124765:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.124769:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa4d06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0060 expref: 30 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.124769:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 48 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.124778:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 48 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.124811:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6814 00000100:00100000:0.0:1746066748.124818:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882982950656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066748.124825:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066748.124830:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa5055 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d025f expref: 30 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.124853:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:8545:x1830882982949888:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 533us (1047us total) trans 8589936451 rc 0/0 00000100:00100000:3.0:1746066748.124859:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5863 00010000:00010000:2.0:1746066748.124865:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa4d06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0060 expref: 30 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.124896:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6815 00000100:00100000:3.0:1746066748.124902:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882982950400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.124902:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa4d06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0060 expref: 29 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.124909:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.124913:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0059 expref: 48 pid: 13370 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.124919:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.124924:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.124933:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.124952:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882982950272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 190us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.124957:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6813 00010000:00010000:1.0:1746066748.124988:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094540000/0xf1867c21abfa4e87 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d014e expref: 48 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066748.124994:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa5055 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d025f expref: 27 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.125006:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066748.125007:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa5055 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d025f expref: 27 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.125009:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.125014:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066748.125019:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066748.125022:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066748.125028:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.125030:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882982950528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 274us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.125036:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6812 00000100:00100000:0.0:1746066748.125048:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882982950656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 231us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.125053:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6814 00010000:00010000:3.0:1746066748.125087:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0059 expref: 46 pid: 13370 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.125098:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4359400/0xf1867c21abfa4cff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0059 expref: 46 pid: 13370 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.125110:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.125113:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.125117:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.125133:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882982950400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 232us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.125139:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6815 00000100:00100000:0.0:1746066748.125295:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.125338:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982950784 00000100:00100000:3.0:1746066748.125341:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982950784 00010000:00010000:3.0:1746066748.125352:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.125367:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6816 00000100:00100000:3.0:1746066748.125371:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882982950784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.125379:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.125388:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.125394:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.125408:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ecf200/0xf1867c21abfa5182 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d02f9 expref: 45 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.125416:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.125419:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.125424:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.125452:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882982950784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.125458:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6816 00000100:00100000:0.0:1746066748.129485:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.129588:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982950912 00000100:00100000:2.0:1746066748.129599:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982950912 00010000:00010000:2.0:1746066748.129648:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa51c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d032a expref: 26 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.129765:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6817 00000100:00100000:2.0:1746066748.129772:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882982950912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.129789:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.129794:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa51c1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d032a expref: 26 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.129804:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa51c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d032a expref: 26 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.129824:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbeb200/0xf1867c21abfa51c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d032a expref: 26 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.129837:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.129842:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.129850:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.129857:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.130022:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.130071:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882982950912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 299us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.130077:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6817 00010000:00010000:0.0:1746066748.130148:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066748.130155:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000040:00080000:0.0:1746066748.130409:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].535, 88 off54784 00000004:00080000:0.0:1746066748.130417:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341533084ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130457:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].480, 88 off50032 00000004:00080000:0.0:1746066748.130461:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341577514ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066748.130479:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].481, 88 off50120 00000004:00080000:0.0:1746066748.130482:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341598745ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066748.130489:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].536, 88 off54872 00000004:00080000:0.0:1746066748.130491:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341607954ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130497:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].537, 88 off54960 00000004:00080000:0.0:1746066748.130499:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341616016ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130505:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].482, 88 off50208 00000004:00080000:0.0:1746066748.130507:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341624177ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066748.130513:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].483, 88 off50296 00000004:00080000:0.0:1746066748.130515:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341631442ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066748.130520:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].484, 88 off50384 00000004:00080000:0.0:1746066748.130522:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341638545ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066748.130527:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].538, 88 off55048 00000004:00080000:0.0:1746066748.130529:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341645684ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130534:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].485, 88 off50472 00000004:00080000:0.0:1746066748.130536:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341652819ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066748.130541:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].539, 88 off55136 00000004:00080000:0.0:1746066748.130543:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341659827ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130548:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].486, 88 off50560 00000004:00080000:0.0:1746066748.130550:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341666987ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066748.130555:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].540, 88 off55224 00000004:00080000:0.0:1746066748.130557:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341674077ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130563:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].541, 88 off55312 00000004:00080000:0.0:1746066748.130565:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341681847ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130571:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].542, 88 off55400 00000004:00080000:0.0:1746066748.130573:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341689592ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130578:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].543, 88 off55488 00000004:00080000:0.0:1746066748.130580:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716341696349ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066748.130585:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].487, 88 off50648 00000004:00080000:0.0:1746066748.130586:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716341703352ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066748.132351:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936452 is committed 00000004:00080000:3.0:1746066748.132360:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 478 committed 00000004:00080000:3.0:1746066748.132374:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 533 committed 00000004:00080000:3.0:1746066748.132380:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 532 committed 00000004:00080000:3.0:1746066748.132382:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 531 committed 00000004:00080000:3.0:1746066748.132383:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 530 committed 00000004:00080000:3.0:1746066748.132385:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 477 committed 00000004:00080000:3.0:1746066748.132386:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 529 committed 00000004:00080000:3.0:1746066748.132388:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 476 committed 00000004:00080000:3.0:1746066748.132390:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 528 committed 00000004:00080000:3.0:1746066748.132391:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 475 committed 00000004:00080000:3.0:1746066748.132393:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 474 committed 00000004:00080000:3.0:1746066748.132394:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 473 committed 00000004:00080000:3.0:1746066748.132396:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 527 committed 00000004:00080000:3.0:1746066748.132397:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 526 committed 00000004:00080000:3.0:1746066748.132399:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 472 committed 00000004:00080000:3.0:1746066748.132400:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 471 committed 00000004:00080000:3.0:1746066748.132402:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 525 committed 00000001:00080000:3.0:1746066748.132406:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936451 is committed 00010000:00010000:2.0:1746066748.132408:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00000001:00080000:3.0:1746066748.132410:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936450 is committed 00010000:00010000:2.0:1746066748.132419:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.132426:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.132432:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f9c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066748.132436:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.132443:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.132459:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.132462:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066748.132466:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.132471:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa4da0 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746066748.132517:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984335360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.132520:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984335616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.132572:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066748.132582:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984335488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.132597:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984336128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066748.132607:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.132622:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984335616 00000100:00100000:0.0:1746066748.132625:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.132628:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984335616 00000100:00100000:0.0:1746066748.132652:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066748.132676:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.132678:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984335488 00000100:00100000:1.0:1746066748.132680:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984335488 00000100:00100000:2.0:1746066748.132690:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336000 00000100:00100000:0.0:1746066748.132692:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.132694:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336000 00000100:00100000:1.0:1746066748.132694:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15221 00000100:00100000:1.0:1746066748.132700:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3776:x1830882984335616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066748.132703:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984337024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.132712:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336512 00000100:00100000:2.0:1746066748.132714:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336512 00000100:00100000:0.0:1746066748.132715:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066748.132728:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746066748.132729:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984337024 00000100:00100000:2.0:1746066748.132731:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984337024 00000100:00100000:0.0:1746066748.132732:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.132741:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15222 00000100:00100000:0.0:1746066748.132745:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.132747:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3775:x1830882984335488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066748.132753:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066748.132765:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066748.132780:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336384 00000100:00100000:0.0:1746066748.132783:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336384 00000100:00100000:0.0:1746066748.132796:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336896 00000100:00100000:0.0:1746066748.132798:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336896 00000100:00100000:2.0:1746066748.132800:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15223 00000100:00100000:2.0:1746066748.132806:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984336000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066748.132807:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15224 00000100:00100000:0.0:1746066748.132811:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3775:x1830882984336512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.132836:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882984335616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (264us total) trans 17179874279 rc 0/0 00000100:00100000:1.0:1746066748.132843:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15221 00000100:00100000:1.0:1746066748.132855:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15225 00000100:00100000:1.0:1746066748.132859:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3775:x1830882984337024:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1746066748.132870:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066748.132872:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984336000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (218us total) trans 17179874280 rc 0/0 00000100:00080000:1.0:1746066748.132873:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066748.132878:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15223 00000100:00100000:1.0:1746066748.132907:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.132912:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336128 00000100:00100000:2.0:1746066748.132915:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336128 00000100:00100000:0.0:1746066748.132920:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984336512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (227us total) trans 21474841710 rc 0/0 00000100:00100000:1.0:1746066748.132923:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984336640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.132925:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15226 00000100:00100000:2.0:1746066748.132929:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984336384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.132939:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.132950:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984337152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.132962:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.132971:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984335744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.132987:0:3776:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874252 gen 2 00000004:00080000:1.0:1746066748.132991:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0dc00, transno 17179874216 00000004:00080000:1.0:1746066748.132996:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0df80, transno 17179874217 00000004:00080000:1.0:1746066748.132998:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0f800, transno 17179874218 00000004:00080000:1.0:1746066748.133000:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0fb80, transno 17179874219 00000004:00080000:1.0:1746066748.133002:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0ce00, transno 17179874220 00000004:00080000:1.0:1746066748.133005:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0d180, transno 17179874221 00000004:00080000:1.0:1746066748.133007:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0e300, transno 17179874222 00000004:00080000:1.0:1746066748.133009:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0d500, transno 17179874223 00000004:00080000:1.0:1746066748.133012:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d88a80, transno 17179874224 00000004:00080000:1.0:1746066748.133014:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d88000, transno 17179874225 00000004:00080000:1.0:1746066748.133016:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d8aa00, transno 17179874226 00000004:00080000:1.0:1746066748.133018:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7fdf80, transno 17179874227 00000004:00080000:1.0:1746066748.133020:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7ff100, transno 17179874228 00000004:00080000:1.0:1746066748.133022:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d89500, transno 17179874229 00000004:00080000:1.0:1746066748.133025:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7fca80, transno 17179874230 00000004:00080000:1.0:1746066748.133027:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7fc700, transno 17179874231 00000004:00080000:1.0:1746066748.133029:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb5f80, transno 17179874236 00000004:00080000:1.0:1746066748.133032:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7800, transno 17179874237 00000004:00080000:1.0:1746066748.133034:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb6300, transno 17179874238 00000004:00080000:1.0:1746066748.133036:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb4000, transno 17179874239 00000004:00080000:1.0:1746066748.133039:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7480, transno 17179874240 00000004:00080000:1.0:1746066748.133041:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009666dc00, transno 17179874241 00000004:00080000:1.0:1746066748.133043:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7100, transno 17179874242 00000004:00080000:1.0:1746066748.133045:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb5880, transno 17179874243 00000004:00080000:1.0:1746066748.133048:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80a80, transno 17179874245 00000004:00080000:1.0:1746066748.133050:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80e00, transno 17179874246 00000004:00080000:1.0:1746066748.133052:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbca80, transno 17179874247 00000004:00080000:1.0:1746066748.133054:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83100, transno 17179874248 00000004:00080000:1.0:1746066748.133056:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbed80, transno 17179874249 00000004:00080000:1.0:1746066748.133058:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbc380, transno 17179874250 00000004:00080000:1.0:1746066748.133060:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbd180, transno 17179874251 00000004:00080000:1.0:1746066748.133062:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbdf80, transno 17179874252 00000100:00100000:1.0:1746066748.133068:0:3776:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880098fb5180 x1830882984335616/t17179874279(17179874279) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066764 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746066748.133077:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb5180/2, rc 0, transno 17179874279 00000100:00100000:1.0:1746066748.133081:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984335616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066748.133351:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15224 00000100:00100000:0.0:1746066748.133362:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336640 00000100:00100000:0.0:1746066748.133365:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336640 00000100:00100000:0.0:1746066748.133375:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984337152 00000100:00100000:0.0:1746066748.133377:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984337152 00000100:00100000:0.0:1746066748.133384:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15227 00000100:00100000:0.0:1746066748.133388:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882984336896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066748.133445:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066748.133448:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066748.133450:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066748.133452:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066748.133454:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:3.0:1746066748.133497:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.133510:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984336256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.133526:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.133533:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984336768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.133545:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.133550:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984337280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.133560:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.133578:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.133584:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984335872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.133596:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.133613:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984335744 00000100:00100000:3.0:1746066748.133616:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984335744 00000100:00100000:3.0:1746066748.133627:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336256 00000100:00100000:3.0:1746066748.133629:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336256 00000100:00100000:3.0:1746066748.133645:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984336768 00000100:00100000:3.0:1746066748.133647:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984336768 00000100:00100000:3.0:1746066748.133654:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984337280 00000100:00100000:3.0:1746066748.133655:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984337280 00000100:00100000:3.0:1746066748.133660:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984335360 00000100:00100000:3.0:1746066748.133662:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984335360 00000100:00100000:3.0:1746066748.133668:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984335872 00000100:00100000:3.0:1746066748.133669:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984335872 00000100:00100000:3.0:1746066748.133677:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15228 00000100:00100000:3.0:1746066748.133685:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882984336128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.133750:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3776:x1830882984336128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (842us total) trans 21474841713 rc 0/0 00000100:00100000:3.0:1746066748.133755:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15228 00000100:00100000:3.0:1746066748.133764:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15229 00000100:00100000:3.0:1746066748.133768:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882984336640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.133819:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3776:x1830882984336640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (878us total) trans 21474841714 rc 0/0 00000100:00100000:3.0:1746066748.133824:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15229 00000100:00100000:3.0:1746066748.133833:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15230 00000100:00100000:3.0:1746066748.133836:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882984337152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066748.133875:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066748.133878:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066748.133879:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066748.133897:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066748.133898:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:3.0:1746066748.133916:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3776:x1830882984337152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (952us total) trans 21474841715 rc 0/0 00000100:00100000:3.0:1746066748.133921:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15230 00000100:00100000:3.0:1746066748.133929:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15231 00000100:00100000:3.0:1746066748.133933:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984335744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066748.133973:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066748.133975:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.133977:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:3.0:1746066748.133979:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.133980:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:3.0:1746066748.134241:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882984335744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 307us (744us total) trans 17179874282 rc 0/0 00000100:00100000:3.0:1746066748.134247:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15231 00000100:00100000:3.0:1746066748.134260:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15232 00000100:00100000:3.0:1746066748.134264:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984336256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.134324:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882984336256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (796us total) trans 17179874283 rc 0/0 00000100:00100000:3.0:1746066748.134330:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15232 00000100:00100000:3.0:1746066748.134339:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15233 00000100:00100000:3.0:1746066748.134343:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984336768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066748.134381:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:3.0:1746066748.134383:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.134385:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066748.134386:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.134388:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:3.0:1746066748.134404:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882984336768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (858us total) trans 21474841716 rc 0/0 00000100:00100000:3.0:1746066748.134409:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15233 00000100:00100000:3.0:1746066748.134417:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15234 00000100:00100000:3.0:1746066748.134421:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984337280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066748.134459:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:3.0:1746066748.134461:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.134462:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066748.134464:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.134465:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066748.134482:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3777:x1830882984337280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (921us total) trans 21474841717 rc 0/0 00000100:00100000:3.0:1746066748.134487:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15234 00000100:00100000:3.0:1746066748.134495:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15235 00000100:00100000:3.0:1746066748.134498:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882984335360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.134549:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3774:x1830882984335360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (970us total) trans 17179874284 rc 0/0 00000100:00100000:3.0:1746066748.134554:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15235 00000100:00100000:3.0:1746066748.134563:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15236 00000100:00100000:3.0:1746066748.134566:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882984335872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066748.134603:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:3.0:1746066748.134605:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.134606:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066748.134608:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066748.134609:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:3.0:1746066748.134627:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3774:x1830882984335872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1029us total) trans 17179874285 rc 0/0 00000100:00100000:3.0:1746066748.134631:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15236 00000100:00100000:1.0:1746066748.134663:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984337024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1802us (1945us total) trans 21474841711 rc 0/0 00000100:00100000:1.0:1746066748.134670:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15225 00000004:00080000:3.0:1746066748.134680:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c8b8700/2, rc 0, transno 21474841714 00000100:00100000:3.0:1746066748.134689:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984336640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.134697:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095800a80/2, rc 0, transno 21474841715 00000100:00100000:3.0:1746066748.134700:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984337152:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.134706:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d0e680/2, rc 0, transno 21474841713 00000100:00100000:3.0:1746066748.134713:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984336128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.134752:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984337408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.134773:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066748.134793:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb7b80/2, rc 0, transno 17179874284 00000100:00100000:3.0:1746066748.134796:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984335360:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.134802:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098483480/2, rc 0, transno 17179874285 00000100:00100000:3.0:1746066748.134804:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984335872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.134822:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb6680/2, rc 0, transno 17179874282 00000004:00080000:1.0:1746066748.134852:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 32 done 00000100:00100000:1.0:1746066748.134862:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984337408 00000100:00100000:1.0:1746066748.134866:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984337408 00000100:00100000:2.0:1746066748.134895:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984336384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1952us (2136us total) trans 17179874281 rc 0/0 00000100:00100000:1.0:1746066748.134900:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15237 00000100:00100000:2.0:1746066748.134904:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15226 00000100:00100000:1.0:1746066748.134905:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882984337408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.134960:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984335488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2213us (2352us total) trans 17179874278 rc 0/0 00000100:00100000:2.0:1746066748.134966:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15222 00000100:00100000:1.0:1746066748.134968:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3774:x1830882984337408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (194us total) trans 21474841718 rc 0/0 00000100:00100000:1.0:1746066748.134974:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15237 00000004:00080000:1.0:1746066748.134993:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094307100/2, rc 0, transno 21474841718 00000100:00100000:1.0:1746066748.134997:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984337408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066748.135028:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984336896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1638us (2261us total) trans 21474841712 rc 0/0 00000100:00100000:0.0:1746066748.135034:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15227 00000004:00080000:0.0:1746066748.135163:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130d89180/2, rc 0, transno 17179874281 00000100:00100000:0.0:1746066748.135166:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336384:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066748.135173:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c8b9c00/2, rc 0, transno 21474841712 00000100:00100000:0.0:1746066748.135176:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066748.135183:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb6d80/2, rc 0, transno 17179874278 00000100:00100000:0.0:1746066748.135185:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984335488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066748.135192:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098480000/2, rc 0, transno 17179874280 00000100:00100000:0.0:1746066748.135195:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066748.135202:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a6300/2, rc 0, transno 21474841710 00000100:00100000:0.0:1746066748.135204:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984336512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066748.135211:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c8ba680/2, rc 0, transno 21474841711 00000100:00100000:0.0:1746066748.135214:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984337024:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1746066748.135250:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b54d500 reply state ffff880095f60800 transno 8589936452 ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066748.135268:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066748.135276:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066748.135279:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746066748.135282:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746066748.135367:0:17253:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746066748.135380:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32748:x1830882982949632:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 15929us (16512us total) trans 8589936452 rc 0/0 00010000:00010000:1.0:1746066748.135401:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.135410:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.135416:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.135422:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093507200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066748.135426:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.135432:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.135441:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.135444:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066748.135447:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066748.135448:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984335744:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746066748.135452:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093507200/0xf1867c21abfa5724 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000004:00080000:3.0:1746066748.135464:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098481500/2, rc 0, transno 17179874283 00000100:00100000:3.0:1746066748.135467:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984336256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.135473:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c8b9500/2, rc 0, transno 21474841716 00000100:00100000:3.0:1746066748.135476:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c8b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984336768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.135481:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095802300/2, rc 0, transno 21474841717 00000100:00100000:3.0:1746066748.135483:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984337280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066748.136171:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16146 00000100:00100000:0.0:1746066748.140401:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.140654:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951040 00000100:00100000:2.0:1746066748.140664:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951040 00000100:00100000:2.0:1746066748.140720:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16147 00000100:00100000:2.0:1746066748.140729:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32748:x1830882982951040:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066748.140756:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.140778:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07a6 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.140840:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.140853:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.140870:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.140873:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066748.140876:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e362600, rc 0) 00000100:00100000:2.0:1746066748.141867:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32748:x1830882982951040:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1136us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.141875:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16147 00000100:00100000:0.0:1746066748.143822:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.143926:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951168 00000100:00100000:2.0:1746066748.143935:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951168 00000100:00100000:2.0:1746066748.143982:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16148 00000100:00100000:2.0:1746066748.143989:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32748:x1830882982951168:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066748.144010:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.144027:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfa5732 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07ad expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.144112:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.144123:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5739 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.144134:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5739 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066748.144160:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066748.144164:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066748.144178:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5739 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.144200:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362000/0xf1867c21abfa5732 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ad expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.144213:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5739 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ad expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.144220:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.144223:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066748.144225:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf000, rc 0) 00000100:00100000:2.0:1746066748.144264:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:32748:x1830882982951168:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 276us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.144270:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16148 00000100:00100000:0.0:1746066748.147791:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.147830:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.147880:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951296 00000100:00100000:2.0:1746066748.147902:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951296 00000100:00100000:0.0:1746066748.147924:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.147940:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951552 00000100:00100000:0.0:1746066748.147943:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951552 00000100:00100000:0.0:1746066748.147984:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951424 00000100:00100000:0.0:1746066748.147986:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951424 00000100:00100000:0.0:1746066748.147997:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15238 00000100:00100000:0.0:1746066748.148004:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882982951552:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066748.148009:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15239 00000100:00100000:1.0:1746066748.148018:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882982951424:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.148021:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.148026:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.148039:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07bb expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.148040:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07c2 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066748.148062:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd3c, atime: 0x6812dd3c, ctime: 0x6812dd3c, blocks: 0x808 00002000:00010000:0.0:1746066748.148062:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd3d, atime: 0x6812dd3b, ctime: 0x6812dd3d, blocks: 0x800 00010000:00010000:1.0:1746066748.148079:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.148079:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.148081:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.148081:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.148089:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.148089:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.148103:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.148103:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.148113:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9d200, rc 0) 00010000:00010000:0.0:1746066748.148113:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70600, rc 0) 00000100:00100000:0.0:1746066748.148152:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982951552:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 149us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.148156:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982951424:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.148158:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15238 00000100:00100000:1.0:1746066748.148162:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15239 00000100:00100000:2.0:1746066748.149014:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15240 00000100:00100000:2.0:1746066748.149022:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982951296:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066748.149031:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.149042:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07b4 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066748.149057:0:12233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd3c, atime: 0x6812dd3c, ctime: 0x6812dd3c, blocks: 0x7b0 00010000:00010000:2.0:1746066748.149065:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.149067:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.149071:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 10 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.149081:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 10 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.149088:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece600, rc 0) 00000100:00100000:2.0:1746066748.149117:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982951296:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 97us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.149122:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15240 00000100:00100000:0.0:1746066748.152307:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.152346:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.152379:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.152401:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951680 00000100:00100000:0.0:1746066748.152409:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951680 00000100:00100000:0.0:1746066748.152450:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951936 00000100:00100000:0.0:1746066748.152452:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951936 00000100:00100000:0.0:1746066748.152463:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982951808 00000100:00100000:0.0:1746066748.152465:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982951808 00000100:00100000:0.0:1746066748.152476:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15241 00000100:00100000:0.0:1746066748.152482:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982951680:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.152500:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.152516:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07c9 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066748.152538:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd3d, atime: 0x6812dd3c, ctime: 0x6812dd3d, blocks: 0x800 00010000:00010000:0.0:1746066748.152554:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.152556:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066748.152561:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15242 00010000:00010000:0.0:1746066748.152562:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066748.152570:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982951936:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.152576:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.152579:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.152586:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71800, rc 0) 00010000:00010000:3.0:1746066748.152591:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07d7 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066748.152607:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd3c, atime: 0x6812dd3c, ctime: 0x6812dd3c, blocks: 0x1000 00010000:00010000:3.0:1746066748.152617:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.152618:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.152623:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066748.152623:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982951680:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 141us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.152629:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15241 00010000:00010000:3.0:1746066748.152646:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066748.152651:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15243 00010000:00010000:3.0:1746066748.152655:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:0.0:1746066748.152656:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982951808:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.152661:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.152667:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07d0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.152676:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982951936:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 108us (329us total) trans 0 rc 0/0 00002000:00010000:0.0:1746066748.152676:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd3c, atime: 0x6812dd3c, ctime: 0x6812dd3c, blocks: 0x1668 00010000:00010000:0.0:1746066748.152681:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066748.152682:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15242 00010000:00010000:0.0:1746066748.152683:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.152686:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.152693:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.152699:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70e00, rc 0) 00000100:00100000:0.0:1746066748.152712:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982951808:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 56us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.153450:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15243 00000100:00100000:0.0:1746066748.161738:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.161782:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.161811:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.162349:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.162498:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.162513:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952064 00000100:00100000:2.0:1746066748.162523:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952064 00000100:00100000:2.0:1746066748.162565:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952320 00000100:00100000:2.0:1746066748.162567:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952320 00000100:00100000:2.0:1746066748.162581:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952576 00000100:00100000:2.0:1746066748.162583:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952576 00000100:00100000:2.0:1746066748.162591:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952192 00000100:00100000:2.0:1746066748.162593:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952192 00000100:00100000:2.0:1746066748.162607:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15244 00000100:00100000:2.0:1746066748.162615:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982952064:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.162740:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982952064:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 125us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.162747:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15244 00000100:00100000:2.0:1746066748.162764:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15245 00000100:00100000:2.0:1746066748.162769:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982952320:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.162805:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982952320:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 35us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.162813:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15245 00000100:00100000:2.0:1746066748.162823:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15246 00000100:00100000:2.0:1746066748.162827:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982952576:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.162856:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982952576:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 29us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.162861:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15246 00000100:00100000:2.0:1746066748.162870:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15247 00000100:00100000:2.0:1746066748.162875:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982952192:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.162919:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982952192:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 44us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.162924:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15247 00000100:00100000:0.0:1746066748.163749:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.166489:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952448 00000100:00100000:3.0:1746066748.166504:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952448 00000100:00100000:3.0:1746066748.166565:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952704 00000100:00100000:3.0:1746066748.166568:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952704 00000100:00100000:3.0:1746066748.166589:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15248 00000100:00100000:3.0:1746066748.166596:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982952448:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066748.166710:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15249 00000100:00100000:3.0:1746066748.166714:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982952704:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066748.166781:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982952704:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 67us (3033us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.166787:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15249 00000100:00100000:3.0:1746066748.166808:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982952448:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 213us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.166812:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15248 00000100:00100000:0.0:1746066748.170552:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.170876:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.171191:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.171367:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.171500:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.171593:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952832 00000100:00100000:2.0:1746066748.171603:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952832 00000100:00100000:2.0:1746066748.171662:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982953088 00000100:00100000:2.0:1746066748.171665:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982953088 00000100:00100000:2.0:1746066748.171679:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982953344 00000100:00100000:2.0:1746066748.171680:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982953344 00000100:00100000:2.0:1746066748.171689:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982952960 00000100:00100000:2.0:1746066748.171690:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982952960 00000100:00100000:2.0:1746066748.171702:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15250 00000100:00100000:2.0:1746066748.171709:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982952832:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.171826:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982952832:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 116us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.171832:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15250 00000100:00100000:2.0:1746066748.171847:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15251 00000100:00100000:2.0:1746066748.171852:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982953088:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.171901:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982953088:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 48us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.171906:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15251 00000100:00100000:2.0:1746066748.171914:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15252 00000100:00100000:2.0:1746066748.171917:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982953344:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.171944:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982953344:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 26us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.171948:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15252 00000100:00100000:2.0:1746066748.171956:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15253 00000100:00100000:2.0:1746066748.171959:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982952960:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066748.171983:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982952960:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 23us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.171987:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15253 00000100:00100000:0.0:1746066748.172126:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.172521:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982953216 00000100:00100000:3.0:1746066748.172525:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982953216 00000100:00100000:3.0:1746066748.172534:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982953472 00000100:00100000:3.0:1746066748.172535:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982953472 00000100:00100000:3.0:1746066748.172552:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15254 00000100:00100000:3.0:1746066748.172556:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982953472:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066748.172610:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982953472:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 53us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.172614:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15254 00000100:00100000:3.0:1746066748.172649:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15255 00000100:00100000:3.0:1746066748.172653:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982953216:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066748.172690:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982953216:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 36us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.172694:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15255 00000100:00100000:0.0:1746066748.174810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.174924:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982953600 00000100:00100000:2.0:1746066748.174933:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982953600 00000100:00100000:2.0:1746066748.174980:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15256 00000100:00100000:2.0:1746066748.174998:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982953600:12345-192.168.204.16@tcp:22:lfs.0 00002000:00010000:2.0:1746066748.175204:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066748.175207:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.175209:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066748.175211:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.175213:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:2.0:1746066748.175263:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982953600:12345-192.168.204.16@tcp:22:lfs.0 Request processed in 276us (460us total) trans 17179874286 rc 0/0 00000100:00100000:2.0:1746066748.175271:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15256 00000100:00100000:0.0:1746066748.176809:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.176983:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982953728 00000100:00100000:2.0:1746066748.176990:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982953728 00000100:00100000:2.0:1746066748.177031:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15257 00000100:00100000:2.0:1746066748.177037:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882982953728:12345-192.168.204.16@tcp:22:lfs.0 00002000:00010000:2.0:1746066748.177185:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066748.177188:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066748.177190:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.177192:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066748.177193:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:2.0:1746066748.177225:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882982953728:12345-192.168.204.16@tcp:22:lfs.0 Request processed in 188us (420us total) trans 21474841719 rc 0/0 00000100:00100000:2.0:1746066748.177229:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15257 00000100:00100000:0.0:1746066748.181741:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.181911:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982953984 00000100:00100000:2.0:1746066748.181921:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982953984 00000100:00100000:2.0:1746066748.181985:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3917 00000100:00100000:2.0:1746066748.181994:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982953984:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066748.182032:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.182046:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.182048:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.182053:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.182066:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.190235:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.190267:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.190284:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.190307:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.190338:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.190366:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982954240 00000100:00100000:2.0:1746066748.190376:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982954496 00000100:00100000:3.0:1746066748.190377:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982954240 00000100:00100000:2.0:1746066748.190388:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982954496 00000100:00100000:3.0:1746066748.190443:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982954752 00000100:00100000:3.0:1746066748.190446:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982954752 00000100:00100000:3.0:1746066748.190465:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982955008 00000100:00100000:3.0:1746066748.190467:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982955008 00000100:00100000:2.0:1746066748.190467:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982955264 00000100:00100000:2.0:1746066748.190471:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982955264 00000100:00100000:3.0:1746066748.190485:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3918 00000100:00100000:3.0:1746066748.190494:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982954240:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066748.190530:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.190546:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.190548:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.190553:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.190567:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.190577:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3919 00000100:00100000:2.0:1746066748.190585:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982954496:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:1.0:1746066748.190604:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3920 00000100:00100000:1.0:1746066748.190613:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982954752:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066748.190616:0:9596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.190629:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.190631:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.190648:0:9596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.190651:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.190660:0:9596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.190660:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.190662:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.190665:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.190679:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.191300:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3921 00000100:00100000:2.0:1746066748.191307:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982955008:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066748.191324:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.191332:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.191333:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.191336:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.191348:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.191402:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3922 00000100:00100000:1.0:1746066748.191409:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982955264:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066748.191426:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.191434:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.191435:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.191439:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.191447:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.194828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.194877:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.194916:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982955520 00000100:00100000:2.0:1746066748.194925:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982955520 00000100:00100000:3.0:1746066748.194967:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982955776 00000100:00100000:3.0:1746066748.194971:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982955776 00000100:00100000:2.0:1746066748.194989:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3923 00000100:00100000:2.0:1746066748.194996:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882982955520:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:0.0:1746066748.195006:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3924 00000100:00100000:0.0:1746066748.195013:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982955776:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066748.195029:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.195032:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.195041:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.195041:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.195043:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.195043:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.195047:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.195047:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.195058:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.195058:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202724:0:9596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202743:0:9596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202752:0:9596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202761:0:9596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093506000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066748.202767:0:9596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202772:0:9596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202787:0:9596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202790:0:9596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093506000/0xf1867c21abfa5778 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.202867:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982954496:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 12278us (12594us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066748.202876:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3919 00010000:00010000:2.0:1746066748.202993:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.202999:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.203003:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.203005:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cf6400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066748.203007:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.203011:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.203018:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.203021:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cf6400/0xf1867c21abfa576a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.203045:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882982953984:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 21054us (21318us total) trans 0 rc 1003520/1003520 00000100:00100000:2.0:1746066748.203049:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3917 00010000:00010000:1.0:1746066748.207251:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.207268:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.207277:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.207284:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066748.207288:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.207297:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.207317:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.207323:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa577f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.207456:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982954752:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 16836us (17162us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066748.207467:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3920 00010000:00010000:3.0:1746066748.208359:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.208367:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.208374:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.208380:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576a600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066748.208383:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.208389:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.208401:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.208407:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa5771 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.208450:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982954240:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 17956us (18226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066748.208457:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3918 00010000:00010000:0.0:1746066748.212742:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.212760:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.212768:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.212775:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093506400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066748.212780:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.212788:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.212812:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.212818:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa5786 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.212932:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982955008:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 21618us (22616us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066748.212942:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3921 00010000:00010000:1.0:1746066748.217773:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.217792:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.217800:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.217808:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa36400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066748.217812:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.217820:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.217844:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.217850:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa578d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.218003:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982955264:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 26589us (27658us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066748.218014:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3922 00010000:00010000:1.0:1746066748.218820:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.218829:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.218836:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.218841:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d70c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066748.218844:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.218850:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.218861:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.218872:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70c00/0xf1867c21abfa579b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.218933:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982955776:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 23916us (24051us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066748.218939:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3924 00010000:00010000:2.0:1746066748.220869:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.220917:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.220925:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.220931:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093507e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066748.220935:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.220942:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.220963:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.220969:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093507e00/0xf1867c21abfa5794 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.221176:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982955520:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 26175us (26353us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066748.221185:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3923 00000100:00100000:0.0:1746066748.234532:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.234660:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956032 00000100:00100000:1.0:1746066748.234669:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956032 00000100:00100000:1.0:1746066748.234729:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16149 00000100:00100000:1.0:1746066748.234737:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:32748:x1830882982956032:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066748.234787:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.234813:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa5739 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ad expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.235088:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.235093:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066748.235143:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.235154:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.235163:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00010000:1.0:1746066748.235253:0:7245:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a4d00000 reply state ffff8800a7d32000 transno 8589936453 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.235265:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.235271:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.235273:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746066748.235275:0:7245:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066748.235348:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32748:x1830882982956032:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 611us (1356us total) trans 8589936453 rc 0/0 00000100:00100000:1.0:1746066748.235354:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16149 00000100:00100000:0.0:1746066748.236745:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.237454:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956160 00000100:00100000:3.0:1746066748.237462:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956160 00000100:00100000:3.0:1746066748.237516:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15258 00000100:00100000:3.0:1746066748.237524:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32748:x1830882982956160:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.237542:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.237559:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07de expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.237591:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.237598:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.237600:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.237603:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.237644:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.237656:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 14 pid: 12233 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.237668:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984337536:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.237745:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.240538:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.240646:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956288 00000100:00100000:2.0:1746066748.240654:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956288 00010000:00010000:2.0:1746066748.240688:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 15 pid: 12233 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.240714:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6818 00000100:00100000:2.0:1746066748.240720:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982956288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.240733:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.240752:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 15 pid: 12233 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.240762:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 15 pid: 12233 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.240785:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.240787:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.240793:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa574e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07b4 expref: 15 pid: 12233 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.240793:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.240801:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.240820:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984337536:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.240848:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.240853:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.240861:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984337664:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066748.240862:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575ba00, rc 0) 00000100:00100000:3.0:1746066748.241148:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:32748:x1830882982956160:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3624us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.241155:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15258 00000100:00100000:2.0:1746066748.241400:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.243593:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.244229:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984337664:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066748.244252:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.244308:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982956288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3586us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.244319:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6818 00000100:00100000:3.0:1746066748.244843:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956416 00000100:00100000:3.0:1746066748.244850:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956416 00000100:00100000:3.0:1746066748.245250:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15259 00000100:00100000:3.0:1746066748.245258:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32748:x1830882982956416:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.245277:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.245293:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07e5 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.245319:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.245326:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.245328:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.245331:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.245357:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.245369:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 12 pid: 20361 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.245389:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984337792:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.245467:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.248454:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984337792:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.248477:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.248491:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00000100:00100000:3.0:1746066748.248523:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32748:x1830882982956416:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3266us (4936us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.248531:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15259 00000100:00100000:0.0:1746066748.248723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.249316:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956544 00000100:00100000:2.0:1746066748.249322:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956544 00010000:00010000:2.0:1746066748.249345:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 12 pid: 20361 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.249365:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6819 00000100:00100000:2.0:1746066748.249370:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982956544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.249382:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.249401:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 12 pid: 20361 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.249416:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 12 pid: 20361 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.249434:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f9d200/0xf1867c21abfa5747 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07bb expref: 12 pid: 20361 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.249448:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.249449:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.249454:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.249460:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.249491:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.249500:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984337920:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066748.249556:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.253309:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984337920:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066748.253327:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.253363:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982956544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3991us (4639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.253373:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6819 00000100:00100000:0.0:1746066748.254030:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.254071:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956672 00000100:00100000:3.0:1746066748.254076:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956672 00000100:00100000:3.0:1746066748.254108:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15260 00000100:00100000:3.0:1746066748.254112:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32748:x1830882982956672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.254125:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.254139:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07ec expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.254161:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.254166:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.254167:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.254169:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.254188:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.254194:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 12 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.254202:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984338048:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.254244:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.255795:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984338048:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.255813:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.255824:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575ac00, rc 0) 00000100:00100000:3.0:1746066748.255857:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32748:x1830882982956672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1744us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.255863:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15260 00000100:00100000:0.0:1746066748.256476:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.256521:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956800 00000100:00100000:2.0:1746066748.256526:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956800 00010000:00010000:2.0:1746066748.256548:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 12 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.256574:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6820 00000100:00100000:2.0:1746066748.256579:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982956800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.256587:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.256843:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 12 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.256854:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 12 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.256870:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa5740 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c2 expref: 12 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.256914:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.256916:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.256921:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.256929:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.256951:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.256959:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984338176:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066748.257010:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.260390:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984338176:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066748.260407:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.260510:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982956800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3929us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.260521:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6820 00000100:00100000:0.0:1746066748.260565:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.260938:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982956928 00000100:00100000:3.0:1746066748.260946:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982956928 00000100:00100000:3.0:1746066748.261001:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15261 00000100:00100000:3.0:1746066748.261008:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32748:x1830882982956928:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.261029:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.261047:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07f3 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.261077:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.261084:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.261086:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.261089:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.261121:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.261131:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 14 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.261143:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984338304:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.261212:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.263831:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984338304:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.263860:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.263876:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575be00, rc 0) 00000100:00100000:3.0:1746066748.263958:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:32748:x1830882982956928:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2949us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.263967:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15261 00000100:00100000:0.0:1746066748.264043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.264208:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957056 00000100:00100000:2.0:1746066748.264214:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957056 00010000:00010000:2.0:1746066748.264240:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 14 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.264260:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6821 00000100:00100000:2.0:1746066748.264265:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982957056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.264277:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.264298:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 14 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.264308:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 14 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.264329:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71800/0xf1867c21abfa5755 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07c9 expref: 14 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.264345:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.264346:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.264353:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.264365:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.264389:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.264398:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984338432:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066748.264445:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.266681:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.266775:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984338432:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066748.266794:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.266843:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982957056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2577us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.266853:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6821 00000100:00100000:3.0:1746066748.267094:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957184 00000100:00100000:3.0:1746066748.267100:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957184 00000100:00100000:3.0:1746066748.267138:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15262 00000100:00100000:3.0:1746066748.267146:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:32748:x1830882982957184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.267164:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.267181:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d07fa expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.267214:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.267222:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.267224:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.267228:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.267252:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.267264:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 14 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.267275:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984338560:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.267323:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.269266:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.269349:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984338560:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.269373:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.269388:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a400, rc 0) 00000100:00100000:2.0:1746066748.269480:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957312 00000100:00100000:2.0:1746066748.269486:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957312 00010000:00010000:2.0:1746066748.269509:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 15 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.269532:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6822 00000100:00100000:2.0:1746066748.269538:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982957312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.269549:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.269567:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 15 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.269580:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 15 pid: 9591 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.269599:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70e00/0xf1867c21abfa5763 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d0 expref: 15 pid: 9591 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.269746:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:32748:x1830882982957184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2600us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.269753:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15262 00010000:00010000:2.0:1746066748.270084:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.270086:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.270093:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.270101:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.270128:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.270139:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984338688:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066748.270197:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.272206:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984338688:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066748.272222:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.272581:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982957312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3040us (3318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.272592:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6822 00000100:00100000:0.0:1746066748.272768:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.273257:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957440 00000100:00100000:3.0:1746066748.273265:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957440 00000100:00100000:3.0:1746066748.273306:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15263 00000100:00100000:3.0:1746066748.273313:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32748:x1830882982957440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.273329:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.273345:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0801 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.273372:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.273379:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.273381:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.273385:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.273409:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.273420:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 12 pid: 9592 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.273430:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984338816:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.273496:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.276490:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984338816:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.276522:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.276544:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b600, rc 0) 00000100:00100000:2.0:1746066748.276958:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:32748:x1830882982957440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3643us (4189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.276969:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15263 00000100:00100000:0.0:1746066748.278163:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.278538:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957568 00000100:00100000:2.0:1746066748.278547:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957568 00010000:00010000:2.0:1746066748.278578:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 12 pid: 9592 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.278611:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6823 00000100:00100000:2.0:1746066748.278618:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982957568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.278875:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.278960:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 12 pid: 9592 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.278972:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 12 pid: 9592 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.278997:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad200/0xf1867c21abfa575c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07d7 expref: 12 pid: 9592 timeout: 816 lvb_type: 1 00010000:00010000:2.0:1746066748.279011:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.279013:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.279021:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.279029:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.279065:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.279079:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984338944:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066748.279839:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.283382:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.283419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.283438:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.283580:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984338944:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066748.283601:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.283657:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982957568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5038us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.283670:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6823 00000100:00100000:0.0:1746066748.283877:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.284493:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.284584:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957696 00000100:00100000:1.0:1746066748.284592:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957696 00000100:00100000:1.0:1746066748.284607:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957824 00000100:00100000:1.0:1746066748.284609:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957824 00000100:00100000:1.0:1746066748.284654:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982957952 00000100:00100000:1.0:1746066748.284657:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982957952 00000100:00100000:1.0:1746066748.284669:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982958080 00000100:00100000:1.0:1746066748.284671:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982958080 00000100:00100000:1.0:1746066748.284686:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15264 00000100:00100000:1.0:1746066748.284694:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982957824:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066748.284842:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066748.284845:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066748 -> 1746066749 00002000:00010000:1.0:1746066748.284847:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:1.0:1746066748.284850:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066748 -> 1746066749 00002000:00010000:1.0:1746066748.284852:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066748.284898:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982957824:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 205us (1478us total) trans 17179874287 rc 0/0 00000100:00100000:1.0:1746066748.284904:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15264 00000100:00100000:1.0:1746066748.284917:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15265 00000100:00100000:1.0:1746066748.284921:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982957952:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066748.284956:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066748.284958:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.284959:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066747 -> 1746066748 00002000:00010000:1.0:1746066748.284961:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.284963:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066748.284976:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982957952:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 54us (1537us total) trans 17179874288 rc 0/0 00000100:00100000:1.0:1746066748.284980:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15265 00000100:00100000:1.0:1746066748.284987:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15266 00000100:00100000:1.0:1746066748.284990:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982958080:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066748.285042:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066748.285044:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.285045:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:1.0:1746066748.285047:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.285049:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066748.285061:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982958080:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 70us (1185us total) trans 21474841720 rc 0/0 00000100:00100000:1.0:1746066748.285065:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15266 00000100:00100000:1.0:1746066748.285082:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15267 00000100:00100000:1.0:1746066748.285085:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982957696:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066748.285116:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066748.285118:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066748 -> 1746066749 00002000:00010000:1.0:1746066748.285120:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:1.0:1746066748.285121:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066748 -> 1746066749 00002000:00010000:1.0:1746066748.285123:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:1.0:1746066748.285136:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982957696:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 49us (1765us total) trans 21474841721 rc 0/0 00000100:00100000:1.0:1746066748.285140:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15267 00000100:00100000:0.0:1746066748.286976:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.287442:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982958208 00000100:00100000:2.0:1746066748.287451:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982958208 00000100:00100000:3.0:1746066748.287495:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982958336 00000100:00100000:3.0:1746066748.287499:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982958336 00000100:00100000:3.0:1746066748.287544:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15268 00000100:00100000:3.0:1746066748.287552:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982958336:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066748.287691:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066748.287694:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066748 -> 1746066749 00002000:00010000:3.0:1746066748.287696:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.287698:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066748 -> 1746066749 00002000:00010000:3.0:1746066748.287700:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066748.287739:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982958336:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 187us (771us total) trans 17179874289 rc 0/0 00000100:00100000:3.0:1746066748.287745:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15268 00000100:00100000:3.0:1746066748.287776:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15269 00000100:00100000:3.0:1746066748.287781:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982958208:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066748.287842:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:3.0:1746066748.287845:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066748 -> 1746066749 00002000:00010000:3.0:1746066748.287846:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.287848:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066748 -> 1746066749 00002000:00010000:3.0:1746066748.287850:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:3.0:1746066748.287865:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982958208:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 83us (3373us total) trans 21474841722 rc 0/0 00000100:00100000:3.0:1746066748.287870:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15269 00000100:00100000:0.0:1746066748.290455:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.290641:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982958592 00000100:00100000:3.0:1746066748.290651:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982958592 00000100:00100000:3.0:1746066748.290711:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5864 00000100:00100000:3.0:1746066748.290719:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:32748:x1830882982958592:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:3.0:1746066748.290779:0:7246:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa56ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d079f expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.290830:0:7246:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.290842:0:7246:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.290849:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.290915:0:7246:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.290927:0:7246:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.290939:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830882984339072:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.291021:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.292672:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830882984339072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.292696:0:7246:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000100:00100000:0.0:1746066748.293215:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.293536:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982958720 00000100:00100000:2.0:1746066748.293543:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982958720 00010000:00010000:2.0:1746066748.293576:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.293656:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6824 00000100:00100000:2.0:1746066748.293665:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982958720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.293676:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.293682:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.293691:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.293712:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e362600/0xf1867c21abfa572b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07a6 expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.293865:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.293872:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746066748.293881:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746066748.293925:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746066748.293949:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.293994:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982958720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 330us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.294000:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6824 00010000:00010000:3.0:1746066748.294287:0:7246:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.294294:0:7246:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000040:00080000:3.0:1746066748.294812:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].544, 88 off55576 00000004:00080000:3.0:1746066748.294819:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716505935081ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.294985:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].488, 88 off50736 00000004:00080000:3.0:1746066748.294989:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506105462ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066748.295128:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].489, 88 off50824 00000004:00080000:3.0:1746066748.295132:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506249087ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066748.295142:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].545, 88 off55664 00000004:00080000:3.0:1746066748.295145:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506261564ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295238:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].546, 88 off55752 00000004:00080000:3.0:1746066748.295242:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506358379ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295251:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].490, 88 off50912 00000004:00080000:3.0:1746066748.295254:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506370431ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066748.295276:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].491, 88 off51000 00000004:00080000:3.0:1746066748.295279:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506396069ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066748.295287:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].492, 88 off51088 00000004:00080000:3.0:1746066748.295289:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506406184ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066748.295297:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].547, 88 off55840 00000004:00080000:3.0:1746066748.295300:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506416655ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295306:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].493, 88 off51176 00000004:00080000:3.0:1746066748.295308:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506424651ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066748.295314:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].548, 88 off55928 00000004:00080000:3.0:1746066748.295316:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506433286ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295322:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].494, 88 off51264 00000004:00080000:3.0:1746066748.295334:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506450977ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066748.295342:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].549, 88 off56016 00000004:00080000:3.0:1746066748.295344:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506460796ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295350:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].550, 88 off56104 00000004:00080000:3.0:1746066748.295352:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506468819ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295358:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].551, 88 off56192 00000004:00080000:3.0:1746066748.295360:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506476872ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295365:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].552, 88 off56280 00000004:00080000:3.0:1746066748.295367:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716506483927ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066748.295373:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].495, 88 off51352 00000004:00080000:3.0:1746066748.295374:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716506491247ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066748.299281:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936454 is committed 00000004:00080000:3.0:1746066748.299295:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 486 committed 00000004:00080000:3.0:1746066748.299304:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 542 committed 00000004:00080000:3.0:1746066748.299319:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 541 committed 00000004:00080000:3.0:1746066748.299321:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 540 committed 00000004:00080000:3.0:1746066748.299322:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 539 committed 00000004:00080000:3.0:1746066748.299324:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 485 committed 00000004:00080000:3.0:1746066748.299325:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 538 committed 00000004:00080000:3.0:1746066748.299327:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 484 committed 00000004:00080000:3.0:1746066748.299329:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 537 committed 00000004:00080000:3.0:1746066748.299330:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 483 committed 00000004:00080000:3.0:1746066748.299332:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 482 committed 00000004:00080000:3.0:1746066748.299333:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 481 committed 00000004:00080000:3.0:1746066748.299334:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 536 committed 00000004:00080000:3.0:1746066748.299336:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 535 committed 00000004:00080000:3.0:1746066748.299337:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 480 committed 00000004:00080000:3.0:1746066748.299338:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 479 committed 00000004:00080000:3.0:1746066748.299339:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 534 committed 00000004:00010000:3.0:1746066748.299395:0:7246:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008a4ef050 reply state ffff880096d47c00 transno 8589936454 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299423:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299432:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.299436:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066748.299440:0:7246:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746066748.299449:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.299450:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066748.299458:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa56ec lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d079f expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746066748.299569:0:7246:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066748.299582:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32748:x1830882982958592:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 8862us (9135us total) trans 8589936454 rc 0/0 00000100:00100000:3.0:1746066748.299592:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5864 00010000:00010000:3.0:1746066748.299810:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299818:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299825:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299830:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575b800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.299834:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299842:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299854:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.299856:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066748.299859:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00010000:00010000:3.0:1746066748.299863:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa57d3 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066748.299936:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.299943:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.299947:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.299951:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa36a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066748.299954:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.299958:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.299966:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.299968:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066748.299970:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.299974:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57a2 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066748.300499:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984339200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.300548:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300573:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984339712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.300590:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300602:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.300622:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300667:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.300683:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300700:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746066748.300705:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984339584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.300718:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300728:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.300740:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300750:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.300761:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300769:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984341120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.300782:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.300812:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984339200 00000100:00100000:1.0:1746066748.300819:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984339200 00000100:00100000:1.0:1746066748.300848:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984339712 00000100:00100000:1.0:1746066748.300850:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984339712 00000100:00100000:1.0:1746066748.300860:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340224 00000100:00100000:1.0:1746066748.300861:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340224 00000100:00100000:1.0:1746066748.300878:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340736 00000100:00100000:1.0:1746066748.300879:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340736 00000100:00100000:1.0:1746066748.300908:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984339584 00000100:00100000:1.0:1746066748.300910:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984339584 00000100:00100000:1.0:1746066748.300916:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340096 00000100:00100000:1.0:1746066748.300917:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340096 00000100:00100000:1.0:1746066748.300923:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340608 00000100:00100000:1.0:1746066748.300925:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340608 00000100:00100000:1.0:1746066748.300931:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984341120 00000100:00100000:1.0:1746066748.300932:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984341120 00000100:00100000:1.0:1746066748.300939:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15270 00000100:00100000:1.0:1746066748.300944:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984339200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066748.301079:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066748.301083:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.301085:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:1.0:1746066748.301087:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.301089:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:1.0:1746066748.301115:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984339200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (567us total) trans 21474841723 rc 0/0 00000100:00100000:1.0:1746066748.301120:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15270 00000100:00100000:1.0:1746066748.301132:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15271 00000100:00100000:1.0:1746066748.301137:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984339712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066748.301176:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:1.0:1746066748.301178:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301180:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066748.301182:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301183:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:1.0:1746066748.301201:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984339712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (610us total) trans 21474841724 rc 0/0 00000100:00100000:1.0:1746066748.301207:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15271 00000100:00100000:1.0:1746066748.301216:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15272 00000100:00100000:1.0:1746066748.301220:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984340224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066748.301281:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066748.301283:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.301285:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:1.0:1746066748.301287:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.301289:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066748.301305:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984340224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (682us total) trans 17179874290 rc 0/0 00000100:00100000:1.0:1746066748.301310:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15272 00000100:00100000:1.0:1746066748.301416:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15273 00000100:00100000:1.0:1746066748.301421:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984340736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066748.301462:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:1.0:1746066748.301464:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301466:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066748.301468:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301470:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:1.0:1746066748.301488:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984340736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (804us total) trans 17179874291 rc 0/0 00000100:00100000:1.0:1746066748.301493:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15273 00000100:00100000:1.0:1746066748.301501:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15274 00000100:00100000:1.0:1746066748.301505:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984339584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066748.301543:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:1.0:1746066748.301545:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301547:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066748.301549:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301550:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:1.0:1746066748.301568:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984339584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (849us total) trans 21474841725 rc 0/0 00000100:00100000:1.0:1746066748.301573:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15274 00000100:00100000:1.0:1746066748.301583:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15275 00000100:00100000:1.0:1746066748.301587:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984340096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066748.301626:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:1.0:1746066748.301628:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301630:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066748.301645:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301646:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:1.0:1746066748.301664:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984340096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (923us total) trans 21474841726 rc 0/0 00000100:00100000:1.0:1746066748.301669:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15275 00000100:00100000:1.0:1746066748.301678:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15276 00000100:00100000:1.0:1746066748.301682:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984340608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066748.301720:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066748.301722:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301724:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:1.0:1746066748.301726:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.301728:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:1.0:1746066748.301744:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984340608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (983us total) trans 17179874292 rc 0/0 00000100:00100000:1.0:1746066748.301749:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15276 00000100:00100000:1.0:1746066748.301758:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15277 00000100:00100000:1.0:1746066748.301762:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3775:x1830882984341120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.301813:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984341120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (1029us total) trans 17179874293 rc 0/0 00000100:00100000:1.0:1746066748.301818:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15277 00000004:00080000:1.0:1746066748.301852:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d01500/2, rc 0, transno 21474841725 00000100:00100000:1.0:1746066748.301862:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984339584:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066748.301870:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098924a80/2, rc 0, transno 21474841726 00000100:00100000:1.0:1746066748.301873:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066748.301879:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096424e00/2, rc 0, transno 17179874292 00000100:00100000:1.0:1746066748.301907:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340608:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066748.301916:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096425c00/2, rc 0, transno 17179874293 00000100:00100000:1.0:1746066748.301919:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984341120:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066748.301925:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095803800/2, rc 0, transno 21474841723 00000100:00100000:1.0:1746066748.301928:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984339200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066748.301933:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d01c00/2, rc 0, transno 21474841724 00000100:00100000:1.0:1746066748.301936:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984339712:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066748.301942:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096424380/2, rc 0, transno 17179874290 00000100:00100000:1.0:1746066748.301943:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340224:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066748.301948:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096425180/2, rc 0, transno 17179874291 00000100:00100000:1.0:1746066748.301950:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984340736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.302294:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.302319:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302335:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.302346:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302354:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.302365:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302373:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.302383:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302394:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746066748.302399:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.302410:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302415:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.302426:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302432:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.302442:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302449:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.302460:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.302483:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984339328 00000100:00100000:3.0:1746066748.302487:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984339328 00000100:00100000:3.0:1746066748.302504:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984339840 00000100:00100000:3.0:1746066748.302506:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984339840 00000100:00100000:3.0:1746066748.302512:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340352 00000100:00100000:3.0:1746066748.302513:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340352 00000100:00100000:3.0:1746066748.302520:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340864 00000100:00100000:3.0:1746066748.302522:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340864 00000100:00100000:3.0:1746066748.302529:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984339456 00000100:00100000:3.0:1746066748.302531:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984339456 00000100:00100000:3.0:1746066748.302538:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984339968 00000100:00100000:3.0:1746066748.302539:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984339968 00000100:00100000:3.0:1746066748.302545:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340480 00000100:00100000:3.0:1746066748.302546:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340480 00000100:00100000:3.0:1746066748.302551:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984340992 00000100:00100000:3.0:1746066748.302553:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984340992 00000100:00100000:3.0:1746066748.302560:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15278 00000100:00100000:3.0:1746066748.302564:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984339328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066748.302624:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066748.302626:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.302628:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.302630:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.302643:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066748.302667:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984339328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (347us total) trans 21474841727 rc 0/0 00000100:00100000:3.0:1746066748.302673:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15278 00000100:00100000:3.0:1746066748.302685:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15279 00000100:00100000:3.0:1746066748.302689:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984339840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.302737:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984339840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (389us total) trans 21474841728 rc 0/0 00000100:00100000:3.0:1746066748.302744:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15279 00000100:00100000:3.0:1746066748.302753:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15280 00000100:00100000:3.0:1746066748.302757:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882984340352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066748.302801:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066748.302803:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.302805:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.302807:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.302809:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066748.302825:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984340352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (458us total) trans 17179874294 rc 0/0 00000100:00100000:3.0:1746066748.302829:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15280 00000100:00100000:3.0:1746066748.302838:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15281 00000100:00100000:3.0:1746066748.302842:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882984340864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.302912:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984340864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (527us total) trans 17179874295 rc 0/0 00000100:00100000:3.0:1746066748.302917:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15281 00000100:00100000:3.0:1746066748.302926:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15282 00000100:00100000:3.0:1746066748.302930:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984339456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066748.302970:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:3.0:1746066748.302972:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.302974:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.302975:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.302977:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:3.0:1746066748.302994:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984339456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (583us total) trans 21474841729 rc 0/0 00000100:00100000:3.0:1746066748.303000:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15282 00000100:00100000:3.0:1746066748.303008:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15283 00000100:00100000:3.0:1746066748.303012:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984339968:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066748.303048:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066748.303050:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066748.303052:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066748.303053:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066748.303055:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:3.0:1746066748.303070:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984339968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (643us total) trans 21474841730 rc 0/0 00000100:00100000:3.0:1746066748.303075:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15283 00000100:00100000:3.0:1746066748.305922:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15284 00000100:00100000:3.0:1746066748.305950:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882984340480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.306169:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15285 00000100:00100000:2.0:1746066748.306179:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882984340992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.306337:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984340992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (3874us total) trans 17179874296 rc 0/0 00000100:00100000:2.0:1746066748.306343:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15285 00000100:00100000:2.0:1746066748.306448:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746066748.306465:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984341248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.306500:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.306531:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984341248 00000100:00100000:2.0:1746066748.306538:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984341248 00000100:00100000:2.0:1746066748.306563:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15286 00000100:00100000:2.0:1746066748.306567:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882984341248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.306669:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984341248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (169us total) trans 21474841731 rc 0/0 00000100:00100000:2.0:1746066748.306675:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15286 00000004:00080000:2.0:1746066748.306712:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098925180/2, rc 0, transno 21474841731 00000100:00100000:2.0:1746066748.306716:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984341248:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066748.306806:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066748.306809:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.306811:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.306812:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.306814:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066748.306835:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984340480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 900us (4392us total) trans 17179874297 rc 0/0 00000100:00100000:3.0:1746066748.306840:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15284 00000004:00080000:3.0:1746066748.306865:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d00e00/2, rc 0, transno 21474841729 00000100:00100000:3.0:1746066748.306867:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.306874:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d02a00/2, rc 0, transno 21474841730 00000100:00100000:3.0:1746066748.306877:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.306910:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096424a80/2, rc 0, transno 17179874297 00000100:00100000:3.0:1746066748.306913:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.306921:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096425880/2, rc 0, transno 17179874296 00000100:00100000:3.0:1746066748.306923:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340992:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.306929:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d00700/2, rc 0, transno 21474841727 00000100:00100000:3.0:1746066748.306931:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339328:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.306937:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d02300/2, rc 0, transno 21474841728 00000100:00100000:3.0:1746066748.306939:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984339840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.306945:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096424700/2, rc 0, transno 17179874294 00000100:00100000:3.0:1746066748.306947:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340352:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.306953:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096425500/2, rc 0, transno 17179874295 00000100:00100000:3.0:1746066748.306955:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984340864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066748.308604:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.308690:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982958848 00000100:00100000:1.0:1746066748.308696:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982958848 00000100:00100000:1.0:1746066748.308767:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16150 00000100:00100000:1.0:1746066748.308774:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:32748:x1830882982958848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066748.308793:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.308810:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0808 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.308862:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.308874:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.309048:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.309051:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066748.309055:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36400, rc 0) 00000100:00100000:1.0:1746066748.309412:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32748:x1830882982958848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 636us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.309417:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16150 00000100:00100000:0.0:1746066748.311740:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.312068:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982959104 00000100:00100000:3.0:1746066748.312077:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982959104 00000100:00100000:3.0:1746066748.312131:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5865 00000100:00100000:3.0:1746066748.312139:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:32748:x1830882982959104:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066748.312928:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:32748:x1830882982959104:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 787us (1194us total) trans 8589936455 rc 0/0 00000100:00100000:3.0:1746066748.312934:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5865 00000100:00100000:0.0:1746066748.332864:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.333001:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982959360 00000100:00100000:1.0:1746066748.333011:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982959360 00000100:00100000:1.0:1746066748.333351:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16151 00000100:00100000:1.0:1746066748.333360:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134cd4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:32759:x1830882982959360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066748.333386:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.333406:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa57e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d080f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.333484:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333497:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333508:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333524:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333529:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333533:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333644:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333652:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333657:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066748.333665:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066748.333739:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333746:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333752:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333758:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333763:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066748.333767:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333774:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333783:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066748.333786:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066748.333790:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.333795:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa57e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335554:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335566:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335573:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335578:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa36a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066748.335582:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335588:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335602:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5744600) 00010000:00010000:1.0:1746066748.335604:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066748.335609:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335614:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa57ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.335696:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa57e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.335711:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.335717:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.335719:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066748.335721:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a600, rc 0) 00000100:00100000:1.0:1746066748.337530:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134cd4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:32759:x1830882982959360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4160us (4665us total) trans 8589936456 rc 0/0 00000100:00100000:1.0:1746066748.337541:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16151 00000100:00100000:0.0:1746066748.338713:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.340865:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982959616 00000100:00100000:1.0:1746066748.340878:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982959616 00000100:00100000:1.0:1746066748.340966:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16152 00000100:00100000:1.0:1746066748.340975:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+7:32757:x1830882982959616:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066748.341002:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.341021:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa5804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0816 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.341100:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341113:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341123:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341139:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341144:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341148:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341250:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341258:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341263:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066748.341270:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066748.341357:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341363:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341368:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341374:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341379:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066748.341383:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341390:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341400:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066748.341403:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066748.341406:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.341410:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa580b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.343219:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.343229:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.343235:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.343239:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066748.343243:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.343248:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.343260:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5744900) 00010000:00010000:1.0:1746066748.343262:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066748.343265:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.343269:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa5812 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066748.343399:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa5804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.343432:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.343438:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066748.343440:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066748.343442:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750200, rc 0) 00000100:00100000:0.0:1746066748.344017:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:32757:x1830882982959616:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3039us (5303us total) trans 8589936457 rc 0/0 00000100:00100000:0.0:1746066748.344027:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16152 00000100:00100000:0.0:1746066748.348491:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.348548:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.348574:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.348716:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982960000 00000100:00100000:2.0:1746066748.348727:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982960000 00000100:00100000:2.0:1746066748.348769:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15287 00000100:00100000:2.0:1746066748.348776:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:32759:x1830882982960000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066748.348797:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.348816:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0824 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.348847:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.348855:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.348857:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.348860:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.348919:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.348933:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 15 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.348948:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984341376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.349055:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.349336:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982959872 00000100:00100000:1.0:1746066748.349341:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982959872 00000100:00100000:1.0:1746066748.349371:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982960256 00000100:00100000:1.0:1746066748.349375:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982960256 00000100:00100000:1.0:1746066748.349406:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16153 00000100:00100000:1.0:1746066748.349414:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:32756:x1830882982959872:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066748.349431:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.349446:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfa582e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d081d expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.349562:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.349577:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.349583:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.349589:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.349613:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.349622:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 9 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.349647:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984341504:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.349705:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.349713:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 29 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.349722:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984341632:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.349747:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.349769:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16154 00000100:00100000:1.0:1746066748.349777:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:32760:x1830882982960256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066748.349789:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.349797:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa583c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d082b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.349849:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.349860:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066748.349872:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066748.349913:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066748.350039:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa583c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.350060:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.350072:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.350076:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746066748.350078:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.350084:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.350090:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a4b600, rc 0) 00000100:00100000:1.0:1746066748.350130:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:32760:x1830882982960256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 353us (1553us total) trans 8589936458 rc 0/0 00000100:00100000:1.0:1746066748.350137:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16154 00000100:00100000:2.0:1746066748.352745:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984341376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.353093:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.353115:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecec00, rc 0) 00000100:00100000:2.0:1746066748.353168:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:32759:x1830882982960000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4391us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.353176:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15287 00000100:00100000:0.0:1746066748.354946:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.355083:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.355253:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982960384 00000100:00100000:2.0:1746066748.355262:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982960384 00000100:00100000:1.0:1746066748.356922:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984341504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.356934:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984341632:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.356958:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746066748.357112:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982960768 00000100:00100000:3.0:1746066748.357117:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982960768 00000100:00100000:3.0:1746066748.357157:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16155 00000100:00100000:3.0:1746066748.357165:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:32760:x1830882982960768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.357188:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.357206:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5851 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0832 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.357294:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.357305:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.357316:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.357332:0:17253:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.357341:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.357512:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 13 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.357554:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6825 00000100:00100000:2.0:1746066748.357564:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882982960384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.357576:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.357583:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 13 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.357592:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 13 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.357611:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750200/0xf1867c21abfa5819 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0816 expref: 13 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.357645:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.357651:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.357658:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.357662:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.357667:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.357671:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.357728:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982960384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 164us (2784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.357735:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6825 00000100:00100000:0.0:1746066748.357944:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.358105:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.358432:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982960640 00000100:00100000:2.0:1746066748.358437:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982960640 00010000:00010000:2.0:1746066748.358453:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 30 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.358478:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982960512 00000100:00100000:2.0:1746066748.358480:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982960512 00010000:00010000:2.0:1746066748.358493:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 16 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.358507:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6826 00000100:00100000:2.0:1746066748.358512:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882982960640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.358518:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.358521:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 30 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.358528:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 30 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.358539:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009356a600/0xf1867c21abfa57f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d080f expref: 30 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.358548:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.358550:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.358556:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.358561:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.358568:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.358572:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.358575:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.358587:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.358606:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882982960640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.358611:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6826 00000100:00100000:2.0:1746066748.358620:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6827 00000100:00100000:2.0:1746066748.358625:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982960512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.358645:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.358664:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 16 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.358671:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 16 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.358685:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa57a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07de expref: 16 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.358696:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.358698:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.358704:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.358711:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.358738:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.358750:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984341760:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066748.358803:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970829c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066748.358860:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.358867:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066748.358898:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066748.359029:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750400/0xf1867c21abfa582e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d081d expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.359050:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d081d expref: 29 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.359058:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d081d expref: 29 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.359064:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750600, rc 0) 00000100:00100000:1.0:1746066748.359099:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:32756:x1830882982959872:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9685us (10617us total) trans 8589936459 rc 0/0 00000100:00100000:1.0:1746066748.359106:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16153 00000100:00100000:2.0:1746066748.362655:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984341760:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066748.362680:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.362754:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982960512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4126us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.362765:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6827 00000100:00100000:0.0:1746066748.365618:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.365788:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982960896 00000100:00100000:1.0:1746066748.365798:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982960896 00000100:00100000:1.0:1746066748.367466:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16156 00000100:00100000:1.0:1746066748.367484:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:32759:x1830882982960896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066748.367512:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.367537:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa5866 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0839 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.369675:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa5866 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0839 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.369701:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa5866 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0839 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.369737:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.369741:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066748.369745:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a3800, rc 0) 00000100:00100000:1.0:1746066748.369832:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:32759:x1830882982960896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2352us (4218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.369845:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16156 00000100:00100000:0.0:1746066748.370661:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.370760:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982961024 00000100:00100000:3.0:1746066748.370768:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982961024 00010000:00010000:3.0:1746066748.370792:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d081d expref: 30 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.370812:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6828 00000100:00100000:3.0:1746066748.370818:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982961024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.370829:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.370834:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d081d expref: 30 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.370844:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d081d expref: 30 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.370862:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750600/0xf1867c21abfa5835 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d081d expref: 30 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.370877:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.370898:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.370906:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.370912:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.370930:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.370951:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882982961024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 133us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.370957:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6828 00010000:00010000:3.0:1746066748.370977:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.370983:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066748.371032:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066748.371036:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066748.371052:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.371076:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5851 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.371091:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.371097:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.371099:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066748.371101:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b800, rc 0) 00000100:00100000:3.0:1746066748.371133:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:32760:x1830882982960768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 13969us (16050us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.371138:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16155 00000100:00100000:0.0:1746066748.379540:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.379607:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982961152 00000100:00100000:2.0:1746066748.379617:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982961152 00000100:00100000:2.0:1746066748.379668:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15288 00000100:00100000:2.0:1746066748.379676:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+15:32760:x1830882982961152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066748.379695:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.379713:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0840 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.379738:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.379739:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.379746:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.379759:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 16 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.379767:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece600, rc 0) 00000100:00100000:2.0:1746066748.379819:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:32760:x1830882982961152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 144us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.379824:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15288 00000100:00100000:2.0:1746066748.392968:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.393010:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.393041:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982961408 00000100:00100000:2.0:1746066748.393052:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982961408 00002000:00100000:2.0:1746066748.393111:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098926a00 x1830882982961408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.393127:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926a00 with x1830882982961408 ext(0->1048575) 00002000:00010000:2.0:1746066748.393133:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926a00 00000100:00100000:2.0:1746066748.393182:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3925 00000100:00100000:2.0:1746066748.393192:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882982961408:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066748.394237:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982961536 00000100:00100000:0.0:1746066748.394244:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982961536 00000100:00100000:0.0:1746066748.394284:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16157 00000100:00100000:0.0:1746066748.394291:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:32756:x1830882982961536:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066748.394311:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.394332:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa5874 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0847 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.394395:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa5874 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0847 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.394411:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa5874 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0847 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.394432:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066748.394435:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066748.394439:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32600, rc 0) 00000100:00100000:0.0:1746066748.394500:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:32756:x1830882982961536:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 207us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.394507:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16157 00000100:00100000:0.0:1746066748.394575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.394720:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982961792 00000100:00100000:0.0:1746066748.394723:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982961792 00002000:00100000:0.0:1746066748.394744:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800966e0a80 x1830882982961792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066748.394751:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882982961792 ext(0->1048575) 00002000:00010000:0.0:1746066748.394754:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e0a80 00000100:00100000:0.0:1746066748.394767:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3926 00000100:00100000:0.0:1746066748.394771:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982961792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066748.400307:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.401463:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962048 00000100:00100000:0.0:1746066748.401477:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962048 00000100:00100000:0.0:1746066748.401547:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16158 00000100:00100000:0.0:1746066748.401556:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:32756:x1830882982962048:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066748.401581:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.401584:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1746066748.401616:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32600/0xf1867c21abfa5874 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0847 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401666:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa5866 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0839 expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401681:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066748.401686:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066748.401700:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa587b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d084e expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401751:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066748.401765:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401772:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401783:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401789:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066748.401822:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401834:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 10 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.401847:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984341888:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066748.401979:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.401987:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 8 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.401995:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984342016:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066748.402022:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.402029:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 10 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.402036:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984342144:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.402055:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.412628:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982961792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17843us (18041us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066748.412651:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3926 00002000:00100000:2.0:1746066748.412663:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800966e0a80 x1830882982961792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.412672:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882982961792 ext(0->1048575) 00002000:00010000:2.0:1746066748.412679:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e0a80 00000100:00100000:1.0:1746066748.416276:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.416295:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.416339:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.416368:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962176 00000100:00100000:1.0:1746066748.416376:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962176 00010000:00010000:1.0:1746066748.416417:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 11 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.416446:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962304 00000100:00100000:1.0:1746066748.416448:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962304 00010000:00010000:1.0:1746066748.416457:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 9 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.416476:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962432 00000100:00100000:1.0:1746066748.416478:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962432 00010000:00010000:1.0:1746066748.416485:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.416500:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6829 00000100:00100000:1.0:1746066748.416507:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982962176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.416522:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.416528:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 12 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.416539:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 12 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.416569:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.416573:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.416582:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.416588:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.416628:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982962176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.416646:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6829 00000100:00100000:1.0:1746066748.416663:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6830 00000100:00100000:1.0:1746066748.416668:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982962304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.416675:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.416678:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 9 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.416686:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 9 pid: 7245 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.416697:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.416700:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.416705:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.416709:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.416723:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982962304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.416728:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6830 00000100:00100000:1.0:1746066748.416738:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6831 00000100:00100000:1.0:1746066748.416742:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982962432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.416748:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.416751:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.416759:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.416768:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.416770:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.416777:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.416784:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066748.416799:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.416811:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982962432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.416816:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6831 00000100:00100000:1.0:1746066748.417108:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882982961408:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 23917us (24097us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066748.417117:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3925 00002000:00100000:1.0:1746066748.417126:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098926a00 x1830882982961408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066748.417134:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926a00 with x1830882982961408 ext(0->1048575) 00002000:00010000:1.0:1746066748.417138:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926a00 00010000:00010000:2.0:1746066748.417358:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5843 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d082b expref: 10 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.417383:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984341888:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.417398:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa57da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0808 expref: 8 pid: 7245 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.417407:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984342016:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.417415:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa5858 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0832 expref: 9 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.417425:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984342144:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.417447:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.417454:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066748.417458:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:02000000:2.0:1746066748.417517:0:7243:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:2.0:1746066748.417750:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].553, 88 off56368 00000004:00080000:2.0:1746066748.417757:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716628872766ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.417799:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].496, 88 off51440 00000004:00080000:2.0:1746066748.417802:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716628919045ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.417827:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].497, 88 off51528 00000004:00080000:2.0:1746066748.417830:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716628947104ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.417839:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].554, 88 off56456 00000004:00080000:2.0:1746066748.417842:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716628958407ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.417849:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].555, 88 off56544 00000004:00080000:2.0:1746066748.417852:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716628969132ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.417862:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].498, 88 off51616 00000004:00080000:2.0:1746066748.417865:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716628981486ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.417903:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].499, 88 off51704 00000004:00080000:2.0:1746066748.417906:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716629022916ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.417922:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].500, 88 off51792 00000004:00080000:2.0:1746066748.417925:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716629041397ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.417933:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].556, 88 off56632 00000004:00080000:2.0:1746066748.417936:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716629052301ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.417943:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].501, 88 off51880 00000004:00080000:2.0:1746066748.417946:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716629062899ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.417954:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].557, 88 off56720 00000004:00080000:2.0:1746066748.417957:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716629073266ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.417964:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].502, 88 off51968 00000004:00080000:2.0:1746066748.417967:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716629083546ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.417974:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].558, 88 off56808 00000004:00080000:2.0:1746066748.417976:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716629093275ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.417984:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].559, 88 off56896 00000004:00080000:2.0:1746066748.417987:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716629103494ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.417993:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].560, 88 off56984 00000004:00080000:2.0:1746066748.417996:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716629112786ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.418003:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].561, 88 off57072 00000004:00080000:2.0:1746066748.418005:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 716629122009ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.418013:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].503, 88 off52056 00000004:00080000:2.0:1746066748.418020:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 716629136252ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066748.422450:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936460 is committed 00000004:00080000:3.0:1746066748.422465:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 494 committed 00000004:00080000:3.0:1746066748.422475:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 551 committed 00000004:00080000:3.0:1746066748.422494:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 550 committed 00000004:00080000:3.0:1746066748.422497:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 549 committed 00000004:00080000:3.0:1746066748.422499:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 548 committed 00000004:00080000:3.0:1746066748.422500:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 493 committed 00000004:00080000:3.0:1746066748.422502:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 547 committed 00000004:00080000:3.0:1746066748.422503:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 492 committed 00000004:00080000:3.0:1746066748.422505:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 546 committed 00000004:00080000:3.0:1746066748.422506:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 491 committed 00000004:00080000:3.0:1746066748.422508:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 490 committed 00000004:00080000:3.0:1746066748.422509:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 489 committed 00000004:00080000:3.0:1746066748.422511:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 545 committed 00000004:00080000:3.0:1746066748.422512:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 544 committed 00000004:00080000:3.0:1746066748.422514:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 488 committed 00000004:00080000:3.0:1746066748.422515:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 487 committed 00000004:00080000:3.0:1746066748.422517:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 543 committed 00000001:00080000:3.0:1746066748.422526:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936458 is committed 00000001:00080000:3.0:1746066748.422537:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936455 is committed 00010000:00010000:3.0:1746066748.422640:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.422654:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.422657:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066748.422678:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa587b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 28 pid: 7243 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746066748.422725:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.422764:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.422766:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066748.422769:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c4800, rc 0) 00000100:00100000:3.0:1746066748.422845:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:32756:x1830882982962048:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 21286us (22545us total) trans 8589936460 rc 0/0 00000100:00100000:3.0:1746066748.422854:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16158 00000100:00100000:2.0:1746066748.423671:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984342528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.423725:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.423761:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.423775:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.423791:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746066748.423795:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984342656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.423808:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.423818:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.423831:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.423918:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.423937:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.423948:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984344064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.423960:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.423971:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746066748.423974:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343680:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.423987:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.423995:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984344192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.424007:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.424027:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984342528 00000100:00100000:2.0:1746066748.424034:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984342528 00000100:00100000:2.0:1746066748.424061:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343040 00000100:00100000:2.0:1746066748.424063:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343040 00000100:00100000:2.0:1746066748.424070:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984342656 00000100:00100000:2.0:1746066748.424072:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984342656 00000100:00100000:2.0:1746066748.424078:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343168 00000100:00100000:2.0:1746066748.424080:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343168 00000100:00100000:2.0:1746066748.424086:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343552 00000100:00100000:2.0:1746066748.424087:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343552 00000100:00100000:2.0:1746066748.424093:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984344064 00000100:00100000:2.0:1746066748.424094:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984344064 00000100:00100000:2.0:1746066748.424099:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343680 00000100:00100000:2.0:1746066748.424100:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343680 00000100:00100000:2.0:1746066748.424105:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984344192 00000100:00100000:2.0:1746066748.424107:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984344192 00000100:00100000:2.0:1746066748.424113:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15289 00000100:00100000:2.0:1746066748.424119:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882984342528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066748.424257:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066748.424260:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066748.424262:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:2.0:1746066748.424264:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066748.424266:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066748.424292:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882984342528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (567us total) trans 17179874298 rc 0/0 00000100:00100000:2.0:1746066748.424298:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15289 00000100:00100000:2.0:1746066748.424310:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15290 00000100:00100000:2.0:1746066748.424314:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882984343040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.424370:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882984343040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (592us total) trans 17179874299 rc 0/0 00000100:00100000:2.0:1746066748.424374:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15290 00000100:00100000:2.0:1746066748.424383:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15291 00000100:00100000:2.0:1746066748.424388:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882984342656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066748.424431:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066748.424434:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.424436:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066748.424437:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.424439:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:2.0:1746066748.424456:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882984342656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (646us total) trans 17179874300 rc 0/0 00000100:00100000:2.0:1746066748.424461:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15291 00000100:00100000:2.0:1746066748.424470:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15292 00000100:00100000:2.0:1746066748.424474:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882984343168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.424521:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882984343168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (688us total) trans 17179874301 rc 0/0 00000100:00100000:2.0:1746066748.424526:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15292 00000100:00100000:2.0:1746066748.424534:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15293 00000100:00100000:2.0:1746066748.424537:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3774:x1830882984343552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066748.424599:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:2.0:1746066748.424602:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066748.424603:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:2.0:1746066748.424605:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066748.424607:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:2.0:1746066748.424621:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882984343552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (684us total) trans 21474841732 rc 0/0 00000100:00100000:2.0:1746066748.424625:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15293 00000100:00100000:2.0:1746066748.424649:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15294 00000100:00100000:2.0:1746066748.424654:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3774:x1830882984344064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066748.424696:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066748.424698:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066748.424699:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.424701:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066748.424703:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:2.0:1746066748.424721:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882984344064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (759us total) trans 21474841733 rc 0/0 00000100:00100000:2.0:1746066748.424724:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15294 00000100:00100000:2.0:1746066748.424734:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15295 00000100:00100000:2.0:1746066748.424737:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3774:x1830882984343680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066748.424773:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:2.0:1746066748.424775:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.424777:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.424779:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.424780:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:2.0:1746066748.424797:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882984343680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (809us total) trans 21474841734 rc 0/0 00000100:00100000:2.0:1746066748.424801:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15295 00000100:00100000:2.0:1746066748.424810:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15296 00000100:00100000:2.0:1746066748.424814:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3774:x1830882984344192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066748.424852:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:2.0:1746066748.424855:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.424856:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.424858:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.424859:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:2.0:1746066748.424875:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882984344192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (867us total) trans 21474841735 rc 0/0 00000100:00100000:2.0:1746066748.424880:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15296 00000004:00080000:2.0:1746066748.424945:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d81f80/2, rc 0, transno 21474841734 00000100:00100000:2.0:1746066748.424953:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066748.424960:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83b80/2, rc 0, transno 21474841735 00000100:00100000:2.0:1746066748.424962:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984344192:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066748.424970:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80000/2, rc 0, transno 21474841732 00000100:00100000:2.0:1746066748.424973:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343552:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066748.424979:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83100/2, rc 0, transno 21474841733 00000100:00100000:2.0:1746066748.424981:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984344064:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066748.424990:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd4000/2, rc 0, transno 17179874300 00000100:00100000:2.0:1746066748.424993:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984342656:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066748.424999:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b5c00/2, rc 0, transno 17179874301 00000100:00100000:2.0:1746066748.425002:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343168:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066748.425009:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd5c00/2, rc 0, transno 17179874298 00000100:00100000:2.0:1746066748.425011:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984342528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066748.425016:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd6a00/2, rc 0, transno 17179874299 00000100:00100000:2.0:1746066748.425019:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984343040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.425174:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.425203:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.425230:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.425241:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984342272 00000100:00100000:3.0:1746066748.425245:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.425246:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984342272 00000100:00100000:3.0:1746066748.425254:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.425266:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.425267:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984342784 00000100:00100000:1.0:1746066748.425269:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984342784 00000100:00100000:1.0:1746066748.425278:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343296 00000100:00100000:1.0:1746066748.425280:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343296 00000100:00100000:3.0:1746066748.425288:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.425288:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15297 00000100:00100000:1.0:1746066748.425292:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3776:x1830882984342272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.425302:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.425308:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984344320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.425322:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.425332:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746066748.425336:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342400:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066748.425339:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066748.425341:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.425343:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:1.0:1746066748.425345:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.425347:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746066748.425349:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.425357:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.425366:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882984342272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (167us total) trans 17179874302 rc 0/0 00000100:00100000:3.0:1746066748.425370:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.425371:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15297 00000100:00100000:3.0:1746066748.425376:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.425381:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343808 00000100:00100000:1.0:1746066748.425383:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343808 00000100:00100000:3.0:1746066748.425388:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.425390:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984344320 00000100:00100000:1.0:1746066748.425391:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984344320 00000100:00100000:3.0:1746066748.425393:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.425396:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984342400 00000100:00100000:1.0:1746066748.425398:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984342400 00000100:00100000:1.0:1746066748.425403:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984342912 00000100:00100000:3.0:1746066748.425404:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.425405:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984342912 00000100:00100000:1.0:1746066748.425410:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343424 00000100:00100000:1.0:1746066748.425412:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343424 00000004:00080000:3.0:1746066748.425415:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd4380/2, rc 0, transno 17179874302 00000100:00100000:1.0:1746066748.425417:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984343936 00000100:00100000:3.0:1746066748.425418:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.425419:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984343936 00000100:00100000:1.0:1746066748.425425:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15298 00000100:00100000:1.0:1746066748.425429:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882984342784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.425438:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15299 00000100:00100000:3.0:1746066748.425443:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882984343296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066748.425466:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:1.0:1746066748.425468:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.425469:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066748.425471:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.425473:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00002000:00010000:3.0:1746066748.425486:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066748.425488:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.425490:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.425491:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.425493:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:1.0:1746066748.425494:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3776:x1830882984342784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (248us total) trans 17179874303 rc 0/0 00000100:00100000:1.0:1746066748.425498:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15298 00000100:00100000:3.0:1746066748.425507:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984343296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (240us total) trans 21474841736 rc 0/0 00000100:00100000:1.0:1746066748.425507:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15300 00000100:00100000:1.0:1746066748.425510:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984343808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.425513:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15299 00000100:00100000:3.0:1746066748.425520:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15301 00000100:00100000:3.0:1746066748.425523:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882984344320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066748.425549:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:1.0:1746066748.425552:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.425553:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066748.425555:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.425557:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:3.0:1746066748.425569:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3776:x1830882984344320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (246us total) trans 21474841738 rc 0/0 00000100:00100000:1.0:1746066748.425570:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3776:x1830882984343808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (267us total) trans 21474841737 rc 0/0 00000100:00100000:3.0:1746066748.425574:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15301 00000100:00100000:1.0:1746066748.425576:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15300 00000100:00100000:3.0:1746066748.425582:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15302 00000100:00100000:1.0:1746066748.425584:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15303 00000100:00100000:3.0:1746066748.425585:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882984342400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.425587:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882984342912:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.425624:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd6d80/2, rc 0, transno 17179874303 00000100:00100000:3.0:1746066748.425627:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342784:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.425647:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882984342912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (274us total) trans 17179874304 rc 0/0 00000004:00080000:3.0:1746066748.425648:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80380/2, rc 0, transno 21474841736 00000100:00100000:3.0:1746066748.425651:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.425652:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15303 00000004:00080000:3.0:1746066748.425656:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80a80/2, rc 0, transno 21474841737 00000100:00100000:3.0:1746066748.425658:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.425661:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15304 00000004:00080000:3.0:1746066748.425663:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de5c700/2, rc 0, transno 21474841738 00000100:00100000:1.0:1746066748.425665:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882984343424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.425666:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984344320:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.425672:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd7480/2, rc 0, transno 17179874304 00000100:00100000:3.0:1746066748.425675:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342912:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066748.425694:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066748.425696:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066748.425698:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:3.0:1746066748.425700:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.425700:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066748.425702:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746066748.425702:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.425704:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066748 -> 1746066748 00002000:00010000:1.0:1746066748.425706:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066748.425707:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066748.425720:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3776:x1830882984342400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (369us total) trans 17179874305 rc 0/0 00000100:00100000:1.0:1746066748.425720:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984343424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (332us total) trans 21474841739 rc 0/0 00000100:00100000:1.0:1746066748.425726:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15304 00000100:00100000:3.0:1746066748.425728:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15302 00000100:00100000:1.0:1746066748.425733:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15305 00000100:00100000:1.0:1746066748.425737:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882984343936:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.425744:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095dd5f80/2, rc 0, transno 17179874305 00000100:00100000:3.0:1746066748.425747:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984342400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.425753:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d83480/2, rc 0, transno 21474841739 00000100:00100000:3.0:1746066748.425755:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.425789:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984343936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (383us total) trans 21474841740 rc 0/0 00000004:00080000:3.0:1746066748.425790:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80e00/2, rc 0, transno 21474841740 00000100:00100000:3.0:1746066748.425793:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984343936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066748.425794:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15305 00000100:00100000:0.0:1746066748.430399:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.431366:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962688 00000100:00100000:2.0:1746066748.431377:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962688 00000100:00100000:2.0:1746066748.431441:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15306 00000100:00100000:2.0:1746066748.431450:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:32759:x1830882982962688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066748.431472:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.431495:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d085c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.431528:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.431536:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.431537:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.431541:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.431572:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.431590:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 13 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.431609:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984344448:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.431615:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.432079:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962560 00000100:00100000:3.0:1746066748.432084:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962560 00000100:00100000:2.0:1746066748.432086:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.432110:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15307 00000100:00100000:3.0:1746066748.432117:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+5:32760:x1830882982962560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.432124:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.432131:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0855 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.432145:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.432199:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 6 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.432209:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 6 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.432219:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b800, rc 0) 00000100:00100000:3.0:1746066748.432246:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+6:32760:x1830882982962560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 129us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.432252:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15307 00000100:00100000:0.0:1746066748.438786:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.438947:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984344448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.438980:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.438998:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326dc00, rc 0) 00000100:00100000:2.0:1746066748.439047:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:32759:x1830882982962688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7597us (8662us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.439055:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15306 00000100:00100000:1.0:1746066748.439135:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962816 00000100:00100000:1.0:1746066748.439142:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962816 00010000:00010000:1.0:1746066748.439170:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.439206:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6832 00000100:00100000:1.0:1746066748.439214:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982962816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.439229:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.439251:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.439262:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.439286:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa57b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07e5 expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.439483:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.439485:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.439492:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.439500:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.439508:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.439509:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.439512:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 5 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.439517:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 5 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.439544:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 5 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.439555:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984344576:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.439621:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.439638:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984344704:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.439657:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.442626:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984344576:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.442653:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984344704:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.442677:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.442722:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982962816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3507us (3947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.442732:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6832 00000100:00100000:0.0:1746066748.443930:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.444917:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982962944 00000100:00100000:3.0:1746066748.444926:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982962944 00000100:00100000:3.0:1746066748.444969:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16159 00000100:00100000:3.0:1746066748.444977:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+7:32760:x1830882982962944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.444999:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.445017:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0863 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.445074:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.445086:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.445102:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.445105:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066748.445108:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00000100:00100000:3.0:1746066748.445152:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:32760:x1830882982962944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 175us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.445157:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16159 00000100:00100000:0.0:1746066748.452826:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.453826:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982963072 00000100:00100000:2.0:1746066748.453837:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982963072 00000100:00100000:2.0:1746066748.454052:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15308 00000100:00100000:2.0:1746066748.454061:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+6:32757:x1830882982963072:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066748.454087:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.454105:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d086a expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.454139:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.454144:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066748.454146:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.454148:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.454152:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1634304->2097151] (req 1634304->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.454187:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 12 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.454198:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 12 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.454210:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984344832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.454220:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.454244:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982963328 00000100:00100000:2.0:1746066748.454247:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982963328 00000100:00100000:1.0:1746066748.454283:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982963584 00000100:00100000:1.0:1746066748.454286:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982963584 00002000:00100000:1.0:1746066748.454314:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800958a7b80 x1830882982963584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066748.454322:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7b80 with x1830882982963584 ext(1048576->2097151) 00002000:00010000:1.0:1746066748.454326:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7b80 00000100:00100000:1.0:1746066748.454338:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3927 00000100:00100000:3.0:1746066748.454341:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.454343:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882982963584:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066748.454423:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800958a7100 x1830882982963328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.454429:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7100 with x1830882982963328 ext(1048576->2097151) 00002000:00010000:2.0:1746066748.454432:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7100 00000100:00100000:2.0:1746066748.454710:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3928 00000100:00100000:2.0:1746066748.454716:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882982963328:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066748.459313:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.459503:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982963712 00000100:00100000:1.0:1746066748.459511:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982963712 00010000:00010000:1.0:1746066748.459553:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 13 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.459590:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6833 00000100:00100000:1.0:1746066748.459600:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982963712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.459618:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.459652:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 13 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.459665:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 13 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.459694:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.459696:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.459703:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.459712:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.459748:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.459762:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984344960:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066748.459862:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575ac00/0xf1867c21abfa57b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07ec expref: 13 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.461013:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.461150:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984344832:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.461178:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.461191:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d200, rc 0) 00000100:00100000:3.0:1746066748.461245:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:32757:x1830882982963072:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7184us (8429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.461253:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15308 00000100:00100000:1.0:1746066748.463434:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984344960:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.463452:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.463506:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982963712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3906us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.463518:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6833 00000100:00100000:0.0:1746066748.463591:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.463763:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982963968 00000100:00100000:3.0:1746066748.463770:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982963968 00002000:00100000:3.0:1746066748.463809:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1634304->1638399) req@ffff8800958a7800 x1830882982963968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.463819:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7800 with x1830882982963968 ext(1634304->1638399) 00002000:00010000:3.0:1746066748.463824:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7800 00000100:00100000:3.0:1746066748.463841:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3929 00000100:00100000:3.0:1746066748.463847:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982963968:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066748.464008:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982963968:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 161us (418us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066748.464014:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3929 00002000:00100000:3.0:1746066748.464018:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1634304->1638399) req@ffff8800958a7800 x1830882982963968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.464026:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7800 with x1830882982963968 ext(1634304->1638399) 00002000:00010000:3.0:1746066748.464028:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7800 00000100:00100000:1.0:1746066748.465593:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882982963584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11246us (11369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066748.465601:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3927 00002000:00100000:1.0:1746066748.465608:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800958a7b80 x1830882982963584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066748.465615:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7b80 with x1830882982963584 ext(1048576->2097151) 00002000:00010000:1.0:1746066748.465619:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7b80 00000100:00100000:2.0:1746066748.466563:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+7:2015:x1830882982963328:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11845us (12417us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066748.466571:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3928 00002000:00100000:2.0:1746066748.466576:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800958a7100 x1830882982963328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.466583:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7100 with x1830882982963328 ext(1048576->2097151) 00002000:00010000:2.0:1746066748.466586:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7100 00000100:00100000:0.0:1746066748.470856:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.470939:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.471019:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982964352 00000100:00100000:2.0:1746066748.471029:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982964352 00000100:00100000:2.0:1746066748.471070:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982964480 00000100:00100000:2.0:1746066748.471071:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982964480 00000100:00100000:2.0:1746066748.471086:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15309 00000100:00100000:2.0:1746066748.471093:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:32759:x1830882982964352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066748.471112:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.471130:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0871 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471157:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 6 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471163:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.471165:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.471168:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471199:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 6 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471211:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 6 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.471227:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984345088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.471304:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.471321:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15310 00000100:00100000:2.0:1746066748.471326:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:32756:x1830882982964480:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066748.471333:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.471341:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0878 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471354:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471360:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471364:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.471365:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.471367:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [823296->905215] (req 823296->905215) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471382:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471388:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 15 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.471395:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984345216:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.471415:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.471422:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 28 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.471432:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984345344:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.471443:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.474104:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.474154:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.474230:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982964224 00000100:00100000:2.0:1746066748.474238:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982964224 00002000:00100000:2.0:1746066748.474276:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1634303) req@ffff8800958a7480 x1830882982964224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.474286:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7480 with x1830882982964224 ext(1048576->1634303) 00010000:00010000:2.0:1746066748.474295:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 7 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.474305:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 7 pid: 20361 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066748.474311:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a7480 00000100:00100000:2.0:1746066748.474329:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 846 00000100:00100000:2.0:1746066748.474335:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882982964224:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066748.474576:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982964608 00000100:00100000:1.0:1746066748.474580:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982964608 00000100:00100000:1.0:1746066748.474659:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15311 00000100:00100000:1.0:1746066748.474665:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:32757:x1830882982964608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066748.474674:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.474690:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d087f expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.474712:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.474719:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066748.474720:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066748.474723:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1245183] (req 1048576->1245183) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.474748:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.474758:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.474770:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984345472:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.476534:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.477982:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.478137:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982964736 00000100:00100000:3.0:1746066748.478146:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982964736 00002000:00100000:3.0:1746066748.478192:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1634304->2097151) req@ffff88011f78ca80 x1830882982964736/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.478202:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f78ca80 with x1830882982964736 ext(1634304->2097151) 00010000:00010000:3.0:1746066748.478211:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 9 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.478228:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 9 pid: 20361 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066748.478235:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f78ca80 00000100:00100000:3.0:1746066748.478255:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 847 00000100:00100000:3.0:1746066748.478262:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982964736:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066748.478723:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984345088:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.478752:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.478766:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0a800, rc 0) 00000100:00100000:2.0:1746066748.478798:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:32759:x1830882982964352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7705us (7953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.478808:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15309 00000100:00100000:0.0:1746066748.483278:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.483529:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984345216:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.483540:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984345344:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.483573:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [823296->905215] (req 823296->905215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.483590:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0bc00, rc 0) 00000100:00100000:3.0:1746066748.484091:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:32756:x1830882982964480:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12762us (13148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.484099:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982964864 00000100:00100000:3.0:1746066748.484100:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15310 00000100:00100000:1.0:1746066748.484107:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982964864 00010000:00010000:1.0:1746066748.484137:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 18 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.484157:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6834 00000100:00100000:1.0:1746066748.484163:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982964864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.484175:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.484194:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 18 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.484203:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 18 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.484225:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa586d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0840 expref: 18 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.484357:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.484374:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982964992 00000100:00100000:3.0:1746066748.484377:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982964992 00010000:00010000:3.0:1746066748.484390:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 28 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.484412:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6835 00000100:00100000:3.0:1746066748.484417:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982964992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.484426:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.484433:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 28 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.484442:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 28 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.484455:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecec00/0xf1867c21abfa5827 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0824 expref: 28 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.484472:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.484475:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.484481:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.484490:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.484519:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.484531:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984345600:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.484541:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.484658:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.485027:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.485063:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.485083:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982965248 00000100:00100000:3.0:1746066748.485086:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982965248 00000100:00100000:3.0:1746066748.485103:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15312 00000100:00100000:3.0:1746066748.485107:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+11:32760:x1830882982965248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.485122:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.485134:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0886 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.485150:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.485153:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 12 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.485161:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 12 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.485169:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d800, rc 0) 00000100:00100000:3.0:1746066748.485187:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:32760:x1830882982965248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.485190:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15312 00000100:00100000:2.0:1746066748.485217:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982964224:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10881us (11121us total) trans 0 rc 585728/585728 00000100:00100000:2.0:1746066748.485224:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 846 00002000:00100000:2.0:1746066748.485233:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1634303) req@ffff8800958a7480 x1830882982964224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 585728/585728 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.485241:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7480 with x1830882982964224 ext(1048576->1634303) 00010000:00010000:2.0:1746066748.485247:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.485254:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066748.485259:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a7480 00000100:00100000:1.0:1746066748.485497:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882982964864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1332us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.485503:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6834 00000100:00100000:1.0:1746066748.485534:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984345472:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.485551:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1245183] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 16 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.485559:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46e000, rc 0) 00000100:00100000:1.0:1746066748.485572:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:32757:x1830882982964608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10908us (11418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.485577:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15311 00000100:00100000:1.0:1746066748.485591:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982965120 00000100:00100000:1.0:1746066748.485593:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982965120 00010000:00010000:1.0:1746066748.485602:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 15 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.485615:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6836 00000100:00100000:1.0:1746066748.485618:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982965120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.485624:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.485644:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 15 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.485652:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 15 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.485664:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575be00/0xf1867c21abfa57be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07f3 expref: 15 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.485673:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.485674:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.485677:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.485685:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.485702:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.485710:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984345728:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.485744:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.487693:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982964736:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9197us (9484us total) trans 17179874306 rc 0/0 00000100:00100000:3.0:1746066748.487704:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 847 00002000:00100000:3.0:1746066748.487717:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1634304->2097151) req@ffff88011f78ca80 x1830882982964736/t17179874306(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746066748.487768:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984345600:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066748.487784:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066748.487808:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982964992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3390us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.487815:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6835 00002000:00100000:3.0:1746066748.487922:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f78ca80 with x1830882982964736 ext(1634304->2097151) 00010000:00010000:3.0:1746066748.487934:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.487938:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984345728:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066748.487946:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.487949:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746066748.487957:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011f78ca80 00000100:00100000:1.0:1746066748.487967:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882982965120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2348us (2940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.487973:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6836 00000100:00100000:0.0:1746066748.488979:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.489071:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982965504 00000100:00100000:3.0:1746066748.489079:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982965504 00002000:00100000:3.0:1746066748.489116:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (823296->827391) req@ffff88012e422680 x1830882982965504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.489124:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422680 with x1830882982965504 ext(823296->827391) 00002000:00010000:3.0:1746066748.489129:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e422680 00000100:00100000:3.0:1746066748.489823:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3930 00000100:00100000:3.0:1746066748.489832:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982965504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066748.490005:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982965504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 174us (1028us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066748.490010:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3930 00002000:00100000:3.0:1746066748.490016:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (823296->827391) req@ffff88012e422680 x1830882982965504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.490023:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422680 with x1830882982965504 ext(823296->827391) 00002000:00010000:3.0:1746066748.490026:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e422680 00000100:00100000:0.0:1746066748.491264:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.491329:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982965632 00000100:00100000:1.0:1746066748.491337:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982965632 00000100:00100000:0.0:1746066748.491340:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066748.491367:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.491400:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6837 00000100:00100000:1.0:1746066748.491406:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982965632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.491417:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.491434:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.491449:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.491472:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d200/0xf1867c21abfa589e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1634304->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d086a expref: 10 pid: 20361 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.491486:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.491488:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.491495:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.491503:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.491510:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.491511:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.491513:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.491519:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.491543:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.491554:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984345856:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.491642:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.491650:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984345984:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.491669:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.491800:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982965888 00000100:00100000:2.0:1746066748.491805:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982965888 00002000:00100000:2.0:1746066748.491832:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1241088->1245183) req@ffff88012e421500 x1830882982965888/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.491841:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421500 with x1830882982965888 ext(1241088->1245183) 00002000:00010000:2.0:1746066748.491846:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421500 00000100:00100000:2.0:1746066748.492151:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3931 00000100:00100000:2.0:1746066748.492158:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982965888:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066748.492256:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882982965888:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 99us (915us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066748.492265:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3931 00002000:00100000:2.0:1746066748.492269:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1241088->1245183) req@ffff88012e421500 x1830882982965888/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.492275:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421500 with x1830882982965888 ext(1241088->1245183) 00002000:00010000:2.0:1746066748.492278:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421500 00010000:00010000:3.0:1746066748.492509:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066748.496278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.496326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.496351:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.496376:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982966144 00000100:00100000:2.0:1746066748.496387:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982966144 00000100:00100000:0.0:1746066748.496433:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:2.0:1746066748.496434:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (901120->905215) req@ffff88012e421f80 x1830882982966144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.496444:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421f80 with x1830882982966144 ext(901120->905215) 00002000:00010000:2.0:1746066748.496450:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421f80 00000100:00100000:2.0:1746066748.496465:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982966528 00000100:00100000:2.0:1746066748.496467:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982966528 00002000:00100000:2.0:1746066748.496481:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012e423100 x1830882982966528/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.496487:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423100 with x1830882982966528 ext(1048576->2097151) 00002000:00010000:2.0:1746066748.496490:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e423100 00000100:00100000:2.0:1746066748.496499:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982966656 00000100:00100000:2.0:1746066748.496501:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982966656 00002000:00100000:2.0:1746066748.496510:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012e420700 x1830882982966656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.496516:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420700 with x1830882982966656 ext(1048576->2097151) 00002000:00010000:2.0:1746066748.496518:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420700 00000100:00100000:2.0:1746066748.496542:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3932 00000100:00100000:2.0:1746066748.496551:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982966144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066748.496714:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982966144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 164us (448us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066748.496720:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3932 00002000:00100000:2.0:1746066748.496725:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (901120->905215) req@ffff88012e421f80 x1830882982966144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.496730:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421f80 with x1830882982966144 ext(901120->905215) 00002000:00010000:2.0:1746066748.496733:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421f80 00000100:00100000:2.0:1746066748.496747:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3933 00000100:00100000:2.0:1746066748.496751:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982966528:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066748.496804:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982966912 00000100:00100000:3.0:1746066748.496808:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982966912 00000100:00100000:3.0:1746066748.496837:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5866 00000100:00100000:3.0:1746066748.496842:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:32757:x1830882982966912:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066748.497041:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:32757:x1830882982966912:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 198us (607us total) trans 8589936461 rc 0/0 00000100:00100000:3.0:1746066748.497050:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5866 00000100:00100000:3.0:1746066748.497071:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3934 00000100:00100000:3.0:1746066748.497075:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882982966656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066748.497346:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984345856:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.497372:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984345984:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.497390:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.497410:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982965632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6004us (6152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.497418:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6837 00000100:00100000:2.0:1746066748.507072:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.507138:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982967168 00000100:00100000:1.0:1746066748.507149:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982967168 00000100:00100000:1.0:1746066748.507211:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5867 00000100:00100000:1.0:1746066748.507218:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:32756:x1830882982967168:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066748.507301:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882982966656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10223us (10946us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066748.507311:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3934 00002000:00100000:3.0:1746066748.507321:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012e420700 x1830882982966656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.507330:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420700 with x1830882982966656 ext(1048576->2097151) 00002000:00010000:3.0:1746066748.507336:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e420700 00000100:00100000:1.0:1746066748.508089:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:32756:x1830882982967168:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 869us (1028us total) trans 8589936462 rc 0/0 00000100:00100000:1.0:1746066748.508096:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5867 00000100:00100000:2.0:1746066748.511806:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882982966528:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15039us (15464us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066748.511821:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3933 00002000:00100000:2.0:1746066748.511835:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012e423100 x1830882982966528/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.511845:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423100 with x1830882982966528 ext(1048576->2097151) 00002000:00010000:2.0:1746066748.511852:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e423100 00000100:00100000:0.0:1746066748.513582:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.514031:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982967296 00000100:00100000:1.0:1746066748.514042:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982967296 00000100:00100000:3.0:1746066748.515532:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15313 00000100:00100000:3.0:1746066748.515547:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:32759:x1830882982967296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.515568:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.515586:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d088d expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.515618:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.515625:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.515634:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.515638:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.515670:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.515682:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 15 pid: 1893 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.515694:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984346112:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.517036:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.519439:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.519580:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984346112:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.519613:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.519646:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326da00, rc 0) 00000100:00100000:2.0:1746066748.519784:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982967424 00000100:00100000:2.0:1746066748.519794:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982967424 00002000:00100000:2.0:1746066748.519844:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1245183) req@ffff8800a03d5c00 x1830882982967424/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.519852:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882982967424 ext(1048576->1245183) 00010000:00010000:2.0:1746066748.519859:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 16 pid: 1893 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.519872:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 16 pid: 1893 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066748.519878:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d5c00 00000100:00100000:2.0:1746066748.519920:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 848 00000100:00100000:2.0:1746066748.519927:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882982967424:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066748.519970:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:32759:x1830882982967296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4426us (6392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.519977:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15313 00000100:00100000:0.0:1746066748.520879:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.521281:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982967552 00000100:00100000:3.0:1746066748.521287:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982967552 00000100:00100000:3.0:1746066748.521372:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15314 00000100:00100000:3.0:1746066748.521379:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:32760:x1830882982967552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.521393:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.521409:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0894 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.521430:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.521435:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.521449:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.521458:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d200, rc 0) 00000100:00100000:3.0:1746066748.521645:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:32760:x1830882982967552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 264us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.521651:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15314 00000100:00100000:2.0:1746066748.522367:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982967424:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2439us (2937us total) trans 21474841741 rc 0/0 00000100:00100000:2.0:1746066748.522375:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 848 00002000:00100000:2.0:1746066748.522384:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1245183) req@ffff8800a03d5c00 x1830882982967424/t21474841741(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.522391:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882982967424 ext(1048576->1245183) 00010000:00010000:2.0:1746066748.522398:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 19 pid: 1893 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.522408:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 19 pid: 1893 timeout: 816 lvb_type: 0 00002000:00010000:2.0:1746066748.522414:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d5c00 00000100:00100000:0.0:1746066748.523802:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.524020:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982967680 00000100:00100000:1.0:1746066748.524029:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982967680 00010000:00010000:1.0:1746066748.524059:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 19 pid: 1893 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.524088:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6838 00000100:00100000:1.0:1746066748.524095:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982967680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.524108:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.524127:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 19 pid: 1893 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.524137:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 19 pid: 1893 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.524159:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b46e000/0xf1867c21abfa58b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1245183) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d087f expref: 19 pid: 1893 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.524190:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.524192:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.524200:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.524208:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.524215:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.524217:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.524219:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.524226:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.524256:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.524269:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984346240:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.524365:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.524373:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984346368:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.524392:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc10240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.526072:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984346240:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.526390:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984346368:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.526409:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.526455:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882982967680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2358us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.526468:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6838 00000100:00100000:0.0:1746066748.528117:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.528204:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982967936 00000100:00100000:2.0:1746066748.528213:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982967936 00002000:00100000:2.0:1746066748.528256:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a03d6680 x1830882982967936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.528265:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6680 with x1830882982967936 ext(1048576->2097151) 00002000:00010000:2.0:1746066748.528271:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d6680 00000100:00100000:2.0:1746066748.528300:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3935 00000100:00100000:2.0:1746066748.528307:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882982967936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066748.529625:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.529917:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982968192 00000100:00100000:3.0:1746066748.529924:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982968192 00002000:00100000:3.0:1746066748.529959:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a03d5180 x1830882982968192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.529967:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5180 with x1830882982968192 ext(1048576->2097151) 00002000:00010000:3.0:1746066748.529972:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5180 00000100:00100000:3.0:1746066748.530006:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3936 00000100:00100000:3.0:1746066748.530013:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982968192:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066748.540561:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882982968192:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10535us (10927us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066748.540574:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3936 00002000:00100000:3.0:1746066748.540588:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a03d5180 x1830882982968192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.540598:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5180 with x1830882982968192 ext(1048576->2097151) 00002000:00010000:3.0:1746066748.540604:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5180 00000100:00100000:2.0:1746066748.540671:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882982967936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12364us (12557us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066748.540678:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3935 00002000:00100000:2.0:1746066748.540684:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a03d6680 x1830882982967936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.540690:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6680 with x1830882982967936 ext(1048576->2097151) 00002000:00010000:2.0:1746066748.540693:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d6680 00000100:00100000:0.0:1746066748.546064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.546103:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.546215:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.546444:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982968320 00000100:00100000:3.0:1746066748.546455:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982968320 00000100:00100000:3.0:1746066748.546500:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982968576 00000100:00100000:3.0:1746066748.546502:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982968576 00000100:00100000:3.0:1746066748.546516:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982968448 00000100:00100000:3.0:1746066748.546517:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982968448 00000100:00100000:3.0:1746066748.546533:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15315 00000100:00100000:3.0:1746066748.546540:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982968320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.546561:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.546580:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575ac00/0xf1867c21abfa58cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d089b expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.546647:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984346496:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.546721:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.546742:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15316 00000100:00100000:3.0:1746066748.546747:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982968576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.546755:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.546765:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a4b000/0xf1867c21abfa58d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08a9 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.546787:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984346624:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.546808:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.546847:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15317 00000100:00100000:1.0:1746066748.546855:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982968448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066748.546862:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.546869:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0152200/0xf1867c21abfa58dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08a2 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.546916:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984346752:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066748.546944:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801310dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.547282:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.547915:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.548014:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982968704 00000100:00100000:1.0:1746066748.548019:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982968704 00000100:00100000:1.0:1746066748.548041:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982968832 00000100:00100000:1.0:1746066748.548043:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982968832 00000100:00100000:1.0:1746066748.548058:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15318 00000100:00100000:1.0:1746066748.548063:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882982968704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066748.548072:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.548080:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0152e00/0xf1867c21abfa58e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08b0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.548106:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984346880:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066748.548156:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.548174:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15319 00000100:00100000:1.0:1746066748.548179:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882982968832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066748.548186:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.548194:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa58eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08b7 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.548216:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984347008:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066748.548234:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00002000:00010000:3.0:1746066748.548862:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066748 -> 1746066749 00000100:00100000:3.0:1746066748.548901:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984346496:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066748.548927:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ac00/0xf1867c21abfa58cf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d089b expref: 21 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.548939:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ac00/0xf1867c21abfa58cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d089b expref: 21 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.548982:0:1893:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.548983:0:20361:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.548997:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984346752:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066748.548998:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984346624:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066748.549011:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a4b000/0xf1867c21abfa58d6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08a9 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.549011:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0152200/0xf1867c21abfa58dd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08a2 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.549019:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a4b000/0xf1867c21abfa58d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08a9 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.549019:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0152200/0xf1867c21abfa58dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08a2 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.549034:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152200, rc 0) 00010000:00010000:3.0:1746066748.549225:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575ac00, rc 0) 00010000:00010000:2.0:1746066748.549336:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a4b000, rc 0) 00000100:00100000:0.0:1746066748.549527:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982968448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2672us (3311us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066748.549533:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15317 00000100:00100000:3.0:1746066748.549593:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982968320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3053us (3540us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.549599:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15315 00000100:00100000:2.0:1746066748.549654:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882982968576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2905us (3549us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066748.549658:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15316 00010000:00010000:1.0:1746066748.550152:0:9590:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.550167:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984347008:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066748.550185:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa58eb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08b7 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.550193:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa58eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08b7 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.550217:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898400, rc 0) 00000100:00100000:1.0:1746066748.550237:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882982968832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2059us (2355us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066748.550243:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15319 00010000:00010000:2.0:1746066748.550309:0:9591:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.550322:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984346880:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066748.550336:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0152e00/0xf1867c21abfa58e4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08b0 expref: 29 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.550348:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0152e00/0xf1867c21abfa58e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08b0 expref: 29 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.550355:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152e00, rc 0) 00000100:00100000:2.0:1746066748.550954:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882982968704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2890us (3672us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066748.550960:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15318 00000100:00100000:0.0:1746066748.552468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.552586:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.552657:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982969088 00000100:00100000:2.0:1746066748.552666:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982969088 00000100:00100000:2.0:1746066748.552711:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982968960 00000100:00100000:2.0:1746066748.552714:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982968960 00000100:00100000:2.0:1746066748.552729:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15320 00000100:00100000:3.0:1746066748.552736:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15321 00000100:00100000:2.0:1746066748.552736:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:32759:x1830882982969088:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066748.552742:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:32760:x1830882982968960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.552751:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.552751:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.552765:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08be expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.552765:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08c5 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.552863:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.552875:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.552877:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.552896:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.552903:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.552907:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.552918:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.552926:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33a00, rc 0) 00010000:00010000:2.0:1746066748.552929:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.552940:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 13 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.552950:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984347136:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.552969:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:32760:x1830882982968960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 226us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.552975:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15321 00000100:00100000:2.0:1746066748.553288:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.555232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.555327:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984347136:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066748.555468:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.555483:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04a00, rc 0) 00000100:00100000:0.0:1746066748.555519:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:32759:x1830882982969088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2784us (3055us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.555526:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15320 00000100:00100000:1.0:1746066748.555706:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982969216 00000100:00100000:1.0:1746066748.555712:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982969216 00010000:00010000:1.0:1746066748.555739:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.555760:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6839 00000100:00100000:1.0:1746066748.555765:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982969216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.555777:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.555798:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.555808:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.555830:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575a400/0xf1867c21abfa57c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d07fa expref: 14 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.555841:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.555843:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.555848:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.555861:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.555868:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.555869:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.555872:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.555878:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.555926:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.555938:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984347264:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.556652:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.556662:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984347392:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.556752:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.562134:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984347264:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.562147:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984347392:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.562170:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.562217:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982969216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6450us (6990us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.562230:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6839 00000100:00100000:0.0:1746066748.562707:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.563051:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982969472 00000100:00100000:2.0:1746066748.563059:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982969472 00002000:00100000:2.0:1746066748.563097:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012c8b8e00 x1830882982969472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.563107:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8e00 with x1830882982969472 ext(2097152->3145727) 00002000:00010000:2.0:1746066748.563112:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8b8e00 00000100:00100000:2.0:1746066748.563137:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3937 00000100:00100000:2.0:1746066748.563143:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982969472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066748.564725:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.565045:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982969728 00000100:00100000:3.0:1746066748.565052:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982969728 00002000:00100000:3.0:1746066748.565085:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800a4d00000 x1830882982969728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.565101:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d00000 with x1830882982969728 ext(2097152->3145727) 00002000:00010000:3.0:1746066748.565107:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d00000 00000100:00100000:3.0:1746066748.565132:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3938 00000100:00100000:3.0:1746066748.565140:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882982969728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066748.571849:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982969472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8691us (9128us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066748.571866:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3937 00002000:00100000:2.0:1746066748.571880:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012c8b8e00 x1830882982969472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.571920:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c8b8e00 with x1830882982969472 ext(2097152->3145727) 00002000:00010000:2.0:1746066748.571927:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c8b8e00 00000100:00100000:3.0:1746066748.572697:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882982969728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7555us (7972us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066748.572703:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3938 00002000:00100000:3.0:1746066748.572709:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800a4d00000 x1830882982969728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.572715:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d00000 with x1830882982969728 ext(2097152->3145727) 00002000:00010000:3.0:1746066748.572719:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d00000 00000100:00100000:0.0:1746066748.576021:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.576074:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.576163:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982969856 00000100:00100000:2.0:1746066748.576173:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982969856 00000100:00100000:2.0:1746066748.576255:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982969984 00000100:00100000:2.0:1746066748.576259:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982969984 00000100:00100000:3.0:1746066748.576261:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15322 00000100:00100000:3.0:1746066748.576271:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:32760:x1830882982969856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.576293:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.576312:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08cc expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.576343:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.576350:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.576352:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.576356:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.576394:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.576403:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15323 00010000:00010000:3.0:1746066748.576406:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 11 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.576409:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:32759:x1830882982969984:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066748.576416:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066748.576418:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984347520:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.576421:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08d3 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.576431:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.576434:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.576442:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.576450:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04000, rc 0) 00000100:00100000:2.0:1746066748.576479:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:32759:x1830882982969984:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.576483:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15323 00000100:00100000:3.0:1746066748.576487:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.578268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.578378:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984347520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.578405:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 10 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.578420:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32600, rc 0) 00000100:00100000:3.0:1746066748.578469:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:32760:x1830882982969856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2199us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.578476:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15322 00000100:00100000:1.0:1746066748.578549:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982970112 00000100:00100000:1.0:1746066748.578555:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982970112 00010000:00010000:1.0:1746066748.578579:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 12 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.578611:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6840 00000100:00100000:1.0:1746066748.578617:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982970112:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.578638:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.578657:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 12 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.578667:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 12 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.578688:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa57cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0801 expref: 12 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.578713:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.578715:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.578721:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.578728:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.578736:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.578738:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.578741:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.578748:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.578771:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.578780:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984347648:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.578836:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.578844:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984347776:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.578860:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.580616:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984347648:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.580634:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984347776:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.580653:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.580694:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982970112:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2075us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.580703:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6840 00000100:00100000:0.0:1746066748.588282:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.588398:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.588809:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982970496 00000100:00100000:3.0:1746066748.588820:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982970496 00002000:00100000:3.0:1746066748.588868:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d01880 x1830882982970496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.588877:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01880 with x1830882982970496 ext(2097152->4194303) 00002000:00010000:3.0:1746066748.588917:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01880 00000100:00100000:3.0:1746066748.589507:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982970624 00000100:00100000:3.0:1746066748.589511:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982970624 00002000:00100000:3.0:1746066748.589528:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a4d01f80 x1830882982970624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.589535:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01f80 with x1830882982970624 ext(3145728->4194303) 00002000:00010000:3.0:1746066748.589538:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d01f80 00000100:00100000:3.0:1746066748.589671:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3939 00000100:00100000:3.0:1746066748.589680:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882982970496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066748.590166:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3940 00000100:00100000:2.0:1746066748.590181:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982970624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066748.591360:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.593254:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.593312:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982971008 00000100:00100000:1.0:1746066748.593321:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982971008 00000100:00100000:2.0:1746066748.593348:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982971136 00000100:00100000:2.0:1746066748.593351:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982971136 00002000:00100000:1.0:1746066748.593366:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d02680 x1830882982971008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.593367:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a4d03100 x1830882982971136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.593377:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d03100 with x1830882982971136 ext(3145728->4194303) 00002000:00100000:1.0:1746066748.593380:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d02680 with x1830882982971008 ext(2097152->4194303) 00002000:00010000:2.0:1746066748.593382:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d03100 00002000:00010000:1.0:1746066748.593383:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d02680 00000100:00100000:2.0:1746066748.593403:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3941 00000100:00100000:2.0:1746066748.593409:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882982971136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066748.596229:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3942 00000100:00100000:1.0:1746066748.596248:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982971008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066748.610017:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982970624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19829us (21604us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066748.610032:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3940 00002000:00100000:3.0:1746066748.610045:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a4d01f80 x1830882982970624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.610056:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01f80 with x1830882982970624 ext(3145728->4194303) 00002000:00010000:3.0:1746066748.610062:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d01f80 00000100:00100000:3.0:1746066748.621170:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882982971136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27750us (27910us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066748.621184:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3941 00002000:00100000:3.0:1746066748.621196:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a4d03100 x1830882982971136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.621205:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d03100 with x1830882982971136 ext(3145728->4194303) 00002000:00010000:3.0:1746066748.621212:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d03100 00000100:00100000:3.0:1746066748.631950:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882982970496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 42258us (43666us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066748.631964:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3939 00002000:00100000:3.0:1746066748.631977:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d01880 x1830882982970496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.631987:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01880 with x1830882982970496 ext(2097152->4194303) 00002000:00010000:3.0:1746066748.631994:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01880 00000100:00100000:0.0:1746066748.642219:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.642395:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982971392 00000100:00100000:2.0:1746066748.642406:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982971392 00000100:00100000:2.0:1746066748.642470:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16160 00000100:00100000:2.0:1746066748.642479:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:32766:x1830882982971392:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066748.642507:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.642525:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa590e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08da expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.642608:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642635:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642645:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642656:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642661:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642666:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642774:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642782:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642787:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066748.642796:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066748.642869:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642875:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642879:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642925:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642930:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066748.642934:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642939:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642953:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066748.642956:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066748.642960:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642964:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642983:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642988:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642992:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.642996:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066748.642998:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.643003:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.643008:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5e80300) 00010000:00010000:2.0:1746066748.643009:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066748.643011:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.643015:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa591c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.643049:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa590e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.643059:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.643064:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.643066:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066748.643068:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8c00, rc 0) 00000100:00100000:2.0:1746066748.643117:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:32766:x1830882982971392:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 638us (910us total) trans 8589936463 rc 0/0 00000100:00100000:2.0:1746066748.643123:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16160 00000100:00100000:1.0:1746066748.645696:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982971008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 49445us (54328us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066748.645708:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3942 00002000:00100000:1.0:1746066748.645719:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d02680 x1830882982971008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066748.645730:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d02680 with x1830882982971008 ext(2097152->4194303) 00002000:00010000:1.0:1746066748.645736:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d02680 00000100:00100000:0.0:1746066748.647761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.647917:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982971520 00000100:00100000:3.0:1746066748.647928:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982971520 00000100:00100000:3.0:1746066748.647986:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15324 00000100:00100000:3.0:1746066748.647994:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982971520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.648017:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.648036:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b32400/0xf1867c21abfa5931 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08e1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.648095:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984347904:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.648190:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.650978:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984347904:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066748.651016:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b32400/0xf1867c21abfa5931 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e1 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.651032:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b32400/0xf1867c21abfa5931 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e1 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.651296:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32400, rc 0) 00000100:00100000:3.0:1746066748.651350:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982971520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3356us (3597us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.651359:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15324 00000100:00100000:0.0:1746066748.651910:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.651989:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982971776 00000100:00100000:3.0:1746066748.651996:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982971776 00000100:00100000:3.0:1746066748.652161:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16161 00000100:00100000:3.0:1746066748.652168:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:32767:x1830882982971776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066748.652186:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.652203:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfa5938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08e8 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.652277:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652290:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652301:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652314:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652320:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652325:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652431:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652439:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652445:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066748.652454:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066748.652528:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652534:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652540:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652545:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652551:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b32e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.652554:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652561:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652571:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066748.652574:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.652579:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652583:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b32e00/0xf1867c21abfa593f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652593:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652597:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652602:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652609:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575b600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.652612:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652616:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652622:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097cfde00) 00010000:00010000:3.0:1746066748.652632:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.652635:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652640:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.652672:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfa5938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.652682:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.652687:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.652689:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066748.652691:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a400, rc 0) 00000100:00100000:3.0:1746066748.652717:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:32767:x1830882982971776:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 550us (808us total) trans 8589936464 rc 0/0 00000100:00100000:3.0:1746066748.652722:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16161 00000100:00100000:0.0:1746066748.654162:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.654880:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982972032 00000100:00100000:1.0:1746066748.654996:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982972032 00002000:00100000:1.0:1746066748.655046:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a4d03b80 x1830882982972032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066748.655056:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d03b80 with x1830882982972032 ext(4194304->5033983) 00002000:00010000:1.0:1746066748.655061:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d03b80 00000100:00100000:1.0:1746066748.655092:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3943 00000100:00100000:1.0:1746066748.655098:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882982972032:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066748.662953:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.663019:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982972288 00000100:00100000:3.0:1746066748.663029:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982972288 00002000:00100000:3.0:1746066748.663077:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a4d0c700 x1830882982972288/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.663088:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0c700 with x1830882982972288 ext(4194304->5033983) 00002000:00010000:3.0:1746066748.663094:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0c700 00000100:00100000:3.0:1746066748.663117:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3944 00000100:00100000:3.0:1746066748.663126:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982972288:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066748.668831:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882982972032:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13717us (14661us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066748.668845:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3943 00002000:00100000:1.0:1746066748.668862:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a4d03b80 x1830882982972032/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066748.668872:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d03b80 with x1830882982972032 ext(4194304->5033983) 00002000:00010000:1.0:1746066748.668878:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d03b80 00000100:00100000:3.0:1746066748.670722:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982972288:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7592us (7775us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066748.670731:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3944 00002000:00100000:3.0:1746066748.670739:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a4d0c700 x1830882982972288/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/440 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.670747:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0c700 with x1830882982972288 ext(4194304->5033983) 00002000:00010000:3.0:1746066748.670752:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0c700 00000100:00100000:0.0:1746066748.679540:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.679749:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982972416 00000100:00100000:3.0:1746066748.679760:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982972416 00000100:00100000:3.0:1746066748.679821:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15325 00000100:00100000:3.0:1746066748.679830:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982972416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.679850:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.679869:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa595b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08ef expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.679963:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984348032:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.682607:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.686916:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.687010:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982972672 00000100:00100000:1.0:1746066748.687019:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982972672 00000100:00100000:1.0:1746066748.687065:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5868 00000100:00100000:1.0:1746066748.687073:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:32759:x1830882982972672:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066748.687291:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:32759:x1830882982972672:12345-192.168.204.16@tcp:35:cat.0 Request processed in 218us (407us total) trans 8589936465 rc 0/0 00000100:00100000:1.0:1746066748.687298:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5868 00000100:00100000:3.0:1746066748.687686:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984348032:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066748.687723:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa595b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08ef expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.687735:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa595b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08ef expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.687755:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b400, rc 0) 00000100:00100000:3.0:1746066748.687785:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882982972416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7957us (8258us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.687792:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15325 00000100:00100000:0.0:1746066748.689198:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.690937:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982972800 00000100:00100000:3.0:1746066748.690950:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982972800 00000100:00100000:3.0:1746066748.691021:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15326 00000100:00100000:3.0:1746066748.691032:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982972800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066748.691054:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.691075:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa5962 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08f6 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.691144:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984348160:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.694455:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.697419:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984348160:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066748.697465:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa5962 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08f6 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.697482:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa5962 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08f6 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.697505:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c600, rc 0) 00000100:00100000:3.0:1746066748.697571:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982972800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6538us (8373us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.697580:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15326 00000100:00100000:0.0:1746066748.714123:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.714277:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973056 00000100:00100000:2.0:1746066748.714289:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973056 00000100:00100000:2.0:1746066748.714358:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5869 00000100:00100000:2.0:1746066748.714370:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:32760:x1830882982973056:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066748.714683:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:32760:x1830882982973056:12345-192.168.204.16@tcp:35:cat.0 Request processed in 313us (571us total) trans 8589936466 rc 0/0 00000100:00100000:2.0:1746066748.714691:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5869 00000100:00100000:0.0:1746066748.733877:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.734696:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973184 00000100:00100000:2.0:1746066748.734708:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973184 00000100:00100000:3.0:1746066748.736202:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16162 00000100:00100000:3.0:1746066748.736217:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:302:x1830882982973184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.736251:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.736274:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575be00/0xf1867c21abfa5969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d08fd expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.736348:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736364:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736377:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736394:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736401:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736406:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736494:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736505:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736511:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066748.736557:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066748.736562:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066748.736580:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736591:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736601:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736606:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736611:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736617:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736633:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575b600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.736638:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736644:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736654:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066748.736658:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.736662:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736667:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b600/0xf1867c21abfa5970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736697:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736702:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736706:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736710:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575b400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.736712:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736717:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736725:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097cfd900) 00010000:00010000:3.0:1746066748.736727:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.736729:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736733:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5977 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066748.736766:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575be00/0xf1867c21abfa5969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.736784:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.736790:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.736792:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066748.736794:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c600, rc 0) 00000100:00100000:3.0:1746066748.736906:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:302:x1830882982973184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 668us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.736914:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16162 00000100:00100000:0.0:1746066748.740315:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.740365:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.740417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.740433:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.740455:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973312 00000100:00100000:0.0:1746066748.740464:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973312 00000100:00100000:0.0:1746066748.740504:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973568 00000100:00100000:0.0:1746066748.740506:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973568 00000100:00100000:0.0:1746066748.740522:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973824 00000100:00100000:0.0:1746066748.740524:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973824 00000100:00100000:0.0:1746066748.740562:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973440 00000100:00100000:0.0:1746066748.740566:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973440 00000100:00100000:0.0:1746066748.740590:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15327 00000100:00100000:0.0:1746066748.740599:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982973312:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.740622:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.740656:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfa5985 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0904 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.740714:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984348288:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066748.740799:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.740819:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15328 00000100:00100000:0.0:1746066748.740824:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982973568:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.740832:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.740842:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0912 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.740854:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15329 00010000:00010000:0.0:1746066748.740854:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.740856:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066748.740861:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982973824:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.740865:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.740866:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.740872:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0920 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.740879:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.740880:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.740898:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.740902:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.740907:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bc400, rc 0) 00010000:00010000:2.0:1746066748.740910:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.740915:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8a00, rc 0) 00000100:00100000:0.0:1746066748.740929:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982973568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 105us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.740935:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15328 00000100:00100000:0.0:1746066748.740950:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15330 00000100:00100000:0.0:1746066748.740954:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882982973440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.740960:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.740966:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d090b expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.740976:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.740977:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.740982:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.740989:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.740995:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bce00, rc 0) 00000100:00100000:0.0:1746066748.741008:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982973440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 54us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.741016:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15330 00000100:00100000:0.0:1746066748.741040:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.741055:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973696 00000100:00100000:0.0:1746066748.741057:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973696 00000100:00100000:2.0:1746066748.741058:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982973824:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 198us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.741063:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15329 00000100:00100000:0.0:1746066748.741071:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15331 00000100:00100000:0.0:1746066748.741075:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982973696:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.741081:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.741086:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0919 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.741096:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.741097:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.741101:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 17 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.741110:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 17 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.741115:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bde00, rc 0) 00000100:00100000:2.0:1746066748.741118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.741128:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882982973696:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 52us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.741132:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15331 00000100:00100000:3.0:1746066748.746841:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982973952 00000100:00100000:3.0:1746066748.746852:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982973952 00000100:00100000:0.0:1746066748.747074:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984348288:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066748.747110:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfa5985 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0904 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.747129:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd800/0xf1867c21abfa5985 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0904 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.747144:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd800, rc 0) 00000100:00100000:0.0:1746066748.747191:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982973312:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6592us (6887us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066748.747198:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15327 00000100:00100000:0.0:1746066748.747218:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15332 00000100:00100000:0.0:1746066748.747224:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982973952:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066748.747239:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.747252:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0927 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.747271:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.747273:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.747280:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.747293:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.747302:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd600, rc 0) 00000100:00100000:0.0:1746066748.747318:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982973952:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 95us (6199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.747323:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15332 00000100:00100000:0.0:1746066748.753354:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.753427:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982974208 00000100:00100000:3.0:1746066748.753437:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982974208 00000100:00100000:3.0:1746066748.753488:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16163 00000100:00100000:3.0:1746066748.753496:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:302:x1830882982974208:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.753520:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.753540:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b000/0xf1867c21abfa59af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d092e expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.753650:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.753665:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.753671:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.753682:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.753687:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.753717:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.753727:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 9 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.753738:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.753837:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.753846:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 30 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.753853:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348544:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.753878:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.753903:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.753911:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348672:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.753939:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.756421:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.756504:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.756511:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348544:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.756515:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348672:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.756536:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066748.757725:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.758344:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.758368:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982974336 00000100:00100000:0.0:1746066748.758376:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982974464 00000100:00100000:1.0:1746066748.758377:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982974336 00000100:00100000:0.0:1746066748.758378:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982974464 00010000:00010000:1.0:1746066748.758413:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 10 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.758417:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982974592 00000100:00100000:2.0:1746066748.758420:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982974592 00000100:00100000:1.0:1746066748.758443:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6841 00000100:00100000:1.0:1746066748.758450:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882982974336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.758464:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.758469:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 10 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.758478:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 10 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.758500:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c600/0xf1867c21abfa597e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08fd expref: 10 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.758532:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.758536:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.758544:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.758548:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.758586:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882982974336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 136us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.758591:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6841 00010000:00010000:0.0:1746066748.758592:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 31 pid: 7243 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.758609:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6842 00000100:00100000:1.0:1746066748.758613:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982974464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.758619:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.758622:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 31 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.758642:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 31 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.758652:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa594d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08e8 expref: 31 pid: 7243 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.758661:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.758664:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.758669:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.758674:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.758691:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882982974464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (968us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066748.758692:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.758847:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6842 00000100:00100000:2.0:1746066748.759221:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6843 00000100:00100000:2.0:1746066748.759228:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882982974592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.759237:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.759241:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.759249:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.759265:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa5923 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08da expref: 12 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.759289:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.759292:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.759298:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.759305:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.759403:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.759431:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982974592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 203us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.759436:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6843 00010000:00010000:3.0:1746066748.759580:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.759589:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066748.759612:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066748.759799:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b000/0xf1867c21abfa59af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.760671:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.760679:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.760681:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066748.760684:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a4b600, rc 0) 00000100:00100000:3.0:1746066748.760728:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:302:x1830882982974208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7232us (7383us total) trans 8589936467 rc 0/0 00000100:00100000:3.0:1746066748.760735:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16163 00000100:00100000:0.0:1746066748.763329:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.763383:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982974720 00000100:00100000:3.0:1746066748.763391:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982974720 00000100:00100000:3.0:1746066748.763434:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16164 00000100:00100000:3.0:1746066748.763439:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:302:x1830882982974720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.763461:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.763474:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfa59c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0935 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.763555:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.763566:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.763570:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.763595:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.763604:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 10 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.763613:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348800:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.763709:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.765607:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984348800:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.765638:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.765729:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982974848 00000100:00100000:2.0:1746066748.765736:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982974848 00010000:00010000:2.0:1746066748.765767:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.765804:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6844 00000100:00100000:2.0:1746066748.765809:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882982974848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.765823:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.765828:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.765837:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.765858:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a4b600/0xf1867c21abfa59b6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d092e expref: 11 pid: 17253 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.765861:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.765873:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.765877:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.766661:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.766669:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.766698:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.766740:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882982974848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 930us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.766747:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6844 00010000:00010000:3.0:1746066748.766923:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.766932:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066748.766979:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066748.766982:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066748.766996:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.767022:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c600/0xf1867c21abfa59c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.767034:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.767040:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.767042:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066748.767045:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0dc00, rc 0) 00000100:00100000:3.0:1746066748.767081:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:302:x1830882982974720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3642us (3759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.767086:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16164 00000100:00100000:0.0:1746066748.770081:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.770182:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982974976 00000100:00100000:3.0:1746066748.770191:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982974976 00000100:00100000:3.0:1746066748.770235:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15333 00000100:00100000:3.0:1746066748.770242:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:32767:x1830882982974976:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066748.770262:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.770279:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d093c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.770315:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.770323:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.770330:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.770336:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.770338:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.770342:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1773568->2097151] (req 1773568->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.770374:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.770387:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 18 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.770399:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984348928:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.770485:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.770494:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 14 pid: 9592 timeout: 816 lvb_type: 1 00000100:00100000:3.0:1746066748.770502:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984349056:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.771205:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.771314:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.771315:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.771323:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984349184:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.771344:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.771403:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982975104 00000100:00100000:1.0:1746066748.771408:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982975104 00000100:00100000:1.0:1746066748.771440:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15334 00000100:00100000:1.0:1746066748.771446:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982975104:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066748.771454:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.771463:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa59d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0943 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.771490:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984349312:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066748.771852:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.774643:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.774812:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982975232 00000100:00100000:2.0:1746066748.774821:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982975232 00000100:00100000:2.0:1746066748.774863:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15335 00000100:00100000:2.0:1746066748.774870:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:32766:x1830882982975232:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066748.774912:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.774928:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d094a expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.774956:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.774968:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.774969:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066748.774973:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [610304->1048575] (req 610304->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.775001:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.775012:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.775024:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984349440:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.775113:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.775471:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984348928:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.775482:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984349056:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.775490:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984349184:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.775492:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984349312:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066748.775514:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1773568->2097151] (req 1773568->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.775515:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa59d9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0943 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.775524:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa59d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0943 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.775526:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0de00, rc 0) 00010000:00010000:1.0:1746066748.775536:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899e00, rc 0) 00000100:00100000:0.0:1746066748.775554:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:32767:x1830882982974976:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5312us (5480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.775555:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982975104:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4109us (4241us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066748.775561:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15333 00000100:00100000:1.0:1746066748.775571:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15334 00000100:00100000:0.0:1746066748.776970:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.777003:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.777044:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982975360 00000100:00100000:1.0:1746066748.777050:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982975360 00010000:00010000:1.0:1746066748.777074:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 15 pid: 9592 timeout: 816 lvb_type: 1 00000100:00100000:1.0:1746066748.777096:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982975488 00000100:00100000:1.0:1746066748.777098:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982975488 00010000:00010000:1.0:1746066748.777106:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 21 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.777110:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6845 00000100:00100000:2.0:1746066748.777119:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982975360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066748.777127:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6846 00010000:00010000:2.0:1746066748.777130:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066748.777132:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882982975488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.777139:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.777146:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 15 pid: 9592 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066748.777147:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 21 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.777156:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 21 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.777165:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 15 pid: 9592 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066748.777186:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa58c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0894 expref: 21 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:2.0:1746066748.777190:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa59a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0919 expref: 15 pid: 9592 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066748.777198:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066748.777207:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.777240:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982975488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.777246:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6846 00000100:00100000:2.0:1746066748.777292:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982975360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 174us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.777299:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6845 00000100:00100000:2.0:1746066748.777556:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984349440:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.777578:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [610304->1048575] (req 610304->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.777589:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9600, rc 0) 00000100:00100000:0.0:1746066748.777874:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.778026:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982975616 00000100:00100000:1.0:1746066748.778030:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982975616 00010000:00010000:1.0:1746066748.778044:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:2.0:1746066748.778045:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:32766:x1830882982975232:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3175us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.778052:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15335 00000100:00100000:1.0:1746066748.778071:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6847 00000100:00100000:1.0:1746066748.778105:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982975616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.778113:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.778124:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.778132:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.778145:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa58c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d088d expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.778154:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.778156:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.778162:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.778171:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.778199:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.778211:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984349568:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.778271:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.778505:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.778534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.778698:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982975744 00000100:00100000:3.0:1746066748.778702:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982975744 00002000:00100000:3.0:1746066748.778732:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (823296->905215) req@ffff880130d89f80 x1830882982975744/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.778741:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d89f80 with x1830882982975744 ext(823296->905215) 00010000:00010000:3.0:1746066748.778747:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.778758:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 30 pid: 12237 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066748.778764:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d89f80 00000100:00100000:3.0:1746066748.778789:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 849 00000100:00100000:3.0:1746066748.778795:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982975744:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066748.778911:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982976000 00000100:00100000:3.0:1746066748.778914:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982976000 00000100:00100000:3.0:1746066748.778944:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16165 00000100:00100000:3.0:1746066748.779022:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:302:x1830882982976000:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.779034:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.779678:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfa59e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0951 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.779705:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984349568:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.779722:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.779753:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982975616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1676us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.779760:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6847 00010000:00010000:3.0:1746066748.779779:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779792:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779801:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779812:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779818:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779824:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779830:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0d600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.779834:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779840:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779852:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.779855:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066748.779859:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779863:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa59ee lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.779909:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfa59e7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0951 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.779915:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfa59e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0951 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.779923:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d200, rc 0) 00000100:00100000:3.0:1746066748.779944:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:302:x1830882982976000:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 995us (1410us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.779949:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16165 00000100:00100000:2.0:1746066748.780188:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.780377:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982976256 00000100:00100000:0.0:1746066748.780381:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982976256 00002000:00100000:0.0:1746066748.780404:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1773568->1777663) req@ffff88012de5e300 x1830882982976256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066748.780412:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5e300 with x1830882982976256 ext(1773568->1777663) 00002000:00010000:0.0:1746066748.780415:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5e300 00000100:00100000:0.0:1746066748.780435:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3945 00000100:00100000:0.0:1746066748.780441:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982976256:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066748.780552:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882982976256:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 110us (365us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066748.780559:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3945 00002000:00100000:0.0:1746066748.780564:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1773568->1777663) req@ffff88012de5e300 x1830882982976256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066748.780571:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5e300 with x1830882982976256 ext(1773568->1777663) 00002000:00010000:0.0:1746066748.780574:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5e300 00000100:00100000:3.0:1746066748.782239:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982975744:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3439us (3729us total) trans 21474841742 rc 0/0 00000100:00100000:3.0:1746066748.782248:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 849 00002000:00100000:3.0:1746066748.782256:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (823296->905215) req@ffff880130d89f80 x1830882982975744/t21474841742(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.782262:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d89f80 with x1830882982975744 ext(823296->905215) 00010000:00010000:3.0:1746066748.782270:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 31 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.782275:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066748.782288:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 31 pid: 12237 timeout: 816 lvb_type: 0 00002000:00010000:3.0:1746066748.782294:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d89f80 00000100:00100000:1.0:1746066748.782545:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982976512 00000100:00100000:1.0:1746066748.782552:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982976512 00000100:00100000:1.0:1746066748.782598:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5870 00000100:00100000:1.0:1746066748.782605:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:302:x1830882982976512:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066748.783150:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:302:x1830882982976512:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 545us (874us total) trans 8589936468 rc 0/0 00000100:00100000:1.0:1746066748.783157:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5870 00000100:00100000:0.0:1746066748.783385:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.783422:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982976640 00000100:00100000:1.0:1746066748.783426:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982976640 00010000:00010000:1.0:1746066748.783442:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 31 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:1.0:1746066748.783476:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6848 00000100:00100000:1.0:1746066748.783481:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882982976640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.783491:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.783506:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 31 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.783516:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 31 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.783543:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa58ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 823296->905215) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0878 expref: 31 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:1.0:1746066748.783559:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.783561:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.783568:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.783577:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.783904:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.783918:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984349696:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066748.783985:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.785621:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.785767:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984349696:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066748.785783:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.785852:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882982976640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2370us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.785854:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982976768 00000100:00100000:0.0:1746066748.785859:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982976768 00000100:00100000:1.0:1746066748.785860:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6848 00000100:00100000:0.0:1746066748.785911:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15336 00000100:00100000:0.0:1746066748.785917:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:32767:x1830882982976768:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066748.785930:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066748.785944:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0958 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.785967:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.785975:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 13 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066748.785981:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.785986:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.785987:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.785991:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->2564095] (req 2097152->2564095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.785993:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.786014:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982977024 00010000:00010000:0.0:1746066748.786014:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 18 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.786017:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982977024 00010000:00010000:0.0:1746066748.786025:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 19 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.786035:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984349824:192.168.204.16@tcp:104: 00002000:00100000:3.0:1746066748.786042:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (610304->614399) req@ffff8800945d6d80 x1830882982977024/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.786050:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d6d80 with x1830882982977024 ext(610304->614399) 00002000:00010000:3.0:1746066748.786054:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d6d80 00000100:00100000:3.0:1746066748.786078:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3946 00010000:00010000:0.0:1746066748.786082:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 13 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066748.786083:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982977024:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:0.0:1746066748.786091:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 13 pid: 11630 timeout: 816 lvb_type: 1 00000100:00100000:0.0:1746066748.786099:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984349952:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066748.786122:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 31 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.786129:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 31 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.786136:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984350080:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.786149:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.786388:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982977024:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 303us (394us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066748.786393:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3946 00002000:00100000:3.0:1746066748.786399:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (610304->614399) req@ffff8800945d6d80 x1830882982977024/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.786405:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d6d80 with x1830882982977024 ext(610304->614399) 00002000:00010000:3.0:1746066748.786408:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d6d80 00000100:00100000:0.0:1746066748.788106:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.788150:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982977152 00000100:00100000:1.0:1746066748.788157:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982977152 00010000:00010000:1.0:1746066748.788180:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 14 pid: 11630 timeout: 816 lvb_type: 1 00000100:00100000:2.0:1746066748.788580:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984349824:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.788589:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984349952:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.788594:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984350080:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.788633:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->2564095] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.788648:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd400, rc 0) 00000100:00100000:2.0:1746066748.788684:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+31:32767:x1830882982976768:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2767us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.788694:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15336 00000100:00100000:1.0:1746066748.789002:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6849 00000100:00100000:1.0:1746066748.789010:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982977152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.789022:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.789041:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 14 pid: 11630 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066748.789053:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 14 pid: 11630 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066748.789077:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5993 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0920 expref: 14 pid: 11630 timeout: 816 lvb_type: 1 00010000:00010000:1.0:1746066748.789089:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.789115:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982977152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.789121:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6849 00000100:00100000:0.0:1746066748.790839:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.791154:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982977280 00000100:00100000:3.0:1746066748.791163:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982977280 00010000:00010000:3.0:1746066748.791193:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 19 pid: 12237 timeout: 816 lvb_type: 0 00000100:00100000:3.0:1746066748.791231:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6850 00000100:00100000:3.0:1746066748.791239:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882982977280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.791250:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066748.791267:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.791281:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982977408 00000100:00100000:0.0:1746066748.791284:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982977408 00010000:00010000:0.0:1746066748.791298:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 31 pid: 9591 timeout: 816 lvb_type: 0 00000100:00100000:0.0:1746066748.791315:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6851 00000100:00100000:0.0:1746066748.791320:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882982977408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066748.791327:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.791342:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 19 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066748.791342:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 31 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066748.791351:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 31 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.791497:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 19 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:0.0:1746066748.791515:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04a00/0xf1867c21abfa58f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08c5 expref: 31 pid: 9591 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.791519:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b33a00/0xf1867c21abfa58f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08be expref: 19 pid: 12237 timeout: 816 lvb_type: 0 00010000:00010000:3.0:1746066748.791533:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.791536:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.791541:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.791549:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.791580:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.791592:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984350208:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066748.791663:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.791716:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.791767:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982977408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 445us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.791775:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6851 00000100:00100000:0.0:1746066748.794999:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.795012:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984350208:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066748.795030:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.795068:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882982977280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3829us (4233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.795078:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6850 00000100:00100000:2.0:1746066748.795096:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982977536 00000100:00100000:2.0:1746066748.795103:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982977536 00000100:00100000:2.0:1746066748.795134:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15337 00000100:00100000:2.0:1746066748.795141:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:32766:x1830882982977536:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066748.795157:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.795174:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d095f expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.795208:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.795216:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.795223:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.795229:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.795231:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.795234:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 11 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.795260:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.795272:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 11 pid: 11630 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.795284:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984350336:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.795329:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066748.795335:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 13 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.795342:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 13 pid: 1893 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066748.795350:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984350464:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.795372:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.795380:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 26 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.795387:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984350592:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.795406:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.795593:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982977792 00000100:00100000:3.0:1746066748.795600:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982977792 00002000:00100000:3.0:1746066748.795638:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2560000->2564095) req@ffff880130d8aa00 x1830882982977792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.795647:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8aa00 with x1830882982977792 ext(2560000->2564095) 00002000:00010000:3.0:1746066748.795651:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d8aa00 00000100:00100000:3.0:1746066748.795948:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3947 00000100:00100000:3.0:1746066748.795955:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982977792:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066748.796247:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882982977792:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 291us (916us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066748.796252:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3947 00002000:00100000:3.0:1746066748.796257:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2560000->2564095) req@ffff880130d8aa00 x1830882982977792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.796265:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8aa00 with x1830882982977792 ext(2560000->2564095) 00002000:00010000:3.0:1746066748.796268:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d8aa00 00000100:00100000:2.0:1746066748.797872:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984350336:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.797896:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984350464:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.797903:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984350592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.797929:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1433599] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 11 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.797950:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9e00, rc 0) 00000100:00100000:2.0:1746066748.797997:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+11:32766:x1830882982977536:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2855us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.798004:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15337 00000100:00100000:0.0:1746066748.799085:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.799232:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982978176 00000100:00100000:3.0:1746066748.799240:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982978176 00010000:00010000:3.0:1746066748.799266:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 27 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.799292:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6852 00000100:00100000:3.0:1746066748.799298:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982978176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.799310:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.799327:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 27 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.799337:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 27 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.799361:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326dc00/0xf1867c21abfa5889 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d085c expref: 27 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.799374:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.799654:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982978176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 354us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.799661:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6852 00000100:00100000:2.0:1746066748.799721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.799787:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982978048 00000100:00100000:3.0:1746066748.799790:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982978048 00010000:00010000:3.0:1746066748.799802:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 11 pid: 11630 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.799816:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6853 00000100:00100000:3.0:1746066748.799821:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2014:x1830882982978048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.799827:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.799835:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 11 pid: 11630 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.799843:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 11 pid: 11630 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.799854:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b800/0xf1867c21abfa5890 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0855 expref: 11 pid: 11630 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.799864:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.799878:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882982978048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.799905:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6853 00000100:00100000:1.0:1746066748.800024:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.800093:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982977920 00000100:00100000:3.0:1746066748.800097:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982977920 00010000:00010000:3.0:1746066748.800108:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 14 pid: 1893 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066748.800157:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6854 00000100:00100000:3.0:1746066748.800162:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982977920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.800454:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.800463:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 14 pid: 1893 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.800473:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 14 pid: 1893 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.800489:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bce00/0xf1867c21abfa599a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d090b expref: 14 pid: 1893 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.800498:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.800500:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.800505:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.800514:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.800544:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.800555:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984350720:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066748.800615:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.800934:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.800999:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982978432 00000100:00100000:1.0:1746066748.801002:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982978432 00000100:00100000:1.0:1746066748.801025:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5871 00000100:00100000:1.0:1746066748.801030:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:32767:x1830882982978432:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066748.801307:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:32767:x1830882982978432:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 275us (372us total) trans 8589936469 rc 0/0 00000100:00100000:1.0:1746066748.801316:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5871 00000100:00100000:3.0:1746066748.801989:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984350720:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066748.802003:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.802031:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882982977920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1868us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.802036:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6854 00000100:00100000:0.0:1746066748.807679:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.807812:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982978688 00000100:00100000:3.0:1746066748.807822:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982978688 00002000:00100000:3.0:1746066748.807870:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1429504->1433599) req@ffff880130d89880 x1830882982978688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.807919:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d89880 with x1830882982978688 ext(1429504->1433599) 00002000:00010000:3.0:1746066748.807925:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d89880 00000100:00100000:3.0:1746066748.807957:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3948 00000100:00100000:3.0:1746066748.807965:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982978688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066748.808117:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982978688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 151us (447us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066748.808123:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3948 00002000:00100000:3.0:1746066748.808129:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1429504->1433599) req@ffff880130d89880 x1830882982978688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/4536 e 0 to 0 dl 1746066759 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.808135:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d89880 with x1830882982978688 ext(1429504->1433599) 00002000:00010000:3.0:1746066748.808138:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d89880 00000100:00100000:0.0:1746066748.812174:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.812242:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982978944 00000100:00100000:1.0:1746066748.812252:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982978944 00000100:00100000:1.0:1746066748.812295:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5872 00000100:00100000:1.0:1746066748.812302:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:32766:x1830882982978944:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066748.812552:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:32766:x1830882982978944:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 250us (389us total) trans 8589936470 rc 0/0 00000100:00100000:1.0:1746066748.812559:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5872 00000100:00100000:0.0:1746066748.903849:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.904011:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979072 00000100:00100000:3.0:1746066748.904022:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979072 00000100:00100000:3.0:1746066748.904165:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16166 00000100:00100000:3.0:1746066748.904176:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:309:x1830882982979072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.904210:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.904231:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfa5a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0966 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.904499:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904512:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904526:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904540:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904546:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904551:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904635:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa5a18 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904644:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa5a18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904650:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa5a18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066748.904690:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066748.904695:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066748.904711:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa5a18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904721:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa5a18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904729:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904734:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904739:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904749:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904755:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0d600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.904759:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904765:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904775:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066748.904778:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.904783:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904787:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904821:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904826:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904830:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.904834:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0ce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066748.905568:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.905579:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.905591:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097cfd900) 00010000:00010000:3.0:1746066748.905593:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066748.905596:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.905601:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa5a11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.905646:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d200/0xf1867c21abfa5a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0966 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.905659:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa5a18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0966 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.905665:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.905667:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066748.905669:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0cc00, rc 0) 00000100:00100000:3.0:1746066748.908069:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:309:x1830882982979072:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3877us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.908081:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16166 00000100:00100000:0.0:1746066748.911827:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.911857:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.911873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.911984:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979200 00000100:00100000:1.0:1746066748.911994:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979200 00000100:00100000:3.0:1746066748.912017:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979456 00000100:00100000:3.0:1746066748.912021:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979456 00000100:00100000:1.0:1746066748.912038:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979712 00000100:00100000:1.0:1746066748.912040:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979712 00000100:00100000:3.0:1746066748.912048:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15338 00000100:00100000:3.0:1746066748.912054:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982979200:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.912072:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.912088:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d096d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.912142:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984350848:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.912212:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.912226:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15339 00000100:00100000:3.0:1746066748.912230:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982979456:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066748.912233:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15340 00010000:00010000:3.0:1746066748.912236:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066748.912239:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982979712:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.912244:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfa5a26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0974 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.912247:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.912255:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa5a2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0982 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.912263:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984350976:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.912281:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.912281:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984351104:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066748.912306:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.912609:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.913018:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979328 00000100:00100000:3.0:1746066748.913022:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979328 00000100:00100000:3.0:1746066748.913063:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 774 00000100:00100000:3.0:1746066748.913068:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982979328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.913081:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.913103:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa5a18 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0966 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.913118:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.913121:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.913146:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882982979328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.913153:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 774 00000100:00100000:1.0:1746066748.913163:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.914098:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979584 00000100:00100000:2.0:1746066748.914103:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979584 00000100:00100000:2.0:1746066748.914146:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15341 00000100:00100000:2.0:1746066748.914151:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982979584:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066748.914161:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.914171:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5a34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d097b expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.914204:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984351232:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066748.914260:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.918980:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984350848:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066748.919017:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a1f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d096d expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.919032:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0d600/0xf1867c21abfa5a1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d096d expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.919050:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d600, rc 0) 00000100:00100000:2.0:1746066748.919102:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982979200:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7045us (7284us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066748.919111:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15338 00002000:00010000:1.0:1746066748.919152:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066748 -> 1746066749 00000100:00100000:1.0:1746066748.919165:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984351104:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066748.919181:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa5a2d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0982 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.919193:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa5a2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0982 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066748.919211:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898e00, rc 0) 00002000:00010000:3.0:1746066748.919359:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066748 -> 1746066749 00000100:00100000:3.0:1746066748.919373:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984350976:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066748.919391:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfa5a26 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0974 expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.919399:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c400/0xf1867c21abfa5a26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0974 expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.919406:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c400, rc 0) 00000100:00100000:3.0:1746066748.919428:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982979456:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7198us (7571us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.919434:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15339 00000100:00100000:1.0:1746066748.919593:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982979712:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 7353us (7717us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066748.919599:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15340 00002000:00010000:2.0:1746066748.920209:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066748 -> 1746066749 00000100:00100000:2.0:1746066748.920227:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984351232:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066748.920247:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5a34 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d097b expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.920255:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa5a34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d097b expref: 14 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.920263:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8800, rc 0) 00000100:00100000:2.0:1746066748.920285:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982979584:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6133us (7122us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066748.920291:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15341 00000100:00100000:0.0:1746066748.924506:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.924778:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979968 00000100:00100000:3.0:1746066748.924788:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979968 00000100:00100000:3.0:1746066748.924864:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 892 00000100:00100000:3.0:1746066748.924873:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+365:2015:x1830882982979968:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066748.924978:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.924997:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982980224 00000100:00100000:0.0:1746066748.925001:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982980224 00000100:00100000:0.0:1746066748.925024:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 893 00000100:00100000:3.0:1746066748.925025:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+365:2015:x1830882982979968:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 154us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.925029:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2015:x1830882982980224:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1746066748.925031:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 892 00000100:00100000:0.0:1746066748.925050:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2015:x1830882982980224:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 21us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066748.925056:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 893 00000100:00100000:3.0:1746066748.925069:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.925084:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982979840 00000100:00100000:3.0:1746066748.925086:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982979840 00000100:00100000:3.0:1746066748.925113:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 181 00000100:00100000:3.0:1746066748.925118:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009673d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882982979840:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1746066748.925139:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009673d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882982979840:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 20us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.925144:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 181 00000100:00080000:1.0:1746066748.925262:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066748.925548:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.926088:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982980096 00000100:00100000:2.0:1746066748.926093:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982980096 00000100:00100000:2.0:1746066748.926130:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 894 00000100:00100000:2.0:1746066748.926135:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882982980096:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066748.926163:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882982980096:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 29us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.926168:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 894 00000100:00080000:1.0:1746066748.926384:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746066748.926467:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.927161:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982980480 00000100:00100000:1.0:1746066748.927166:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982980480 00000100:00100000:1.0:1746066748.927197:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16167 00000100:00100000:1.0:1746066748.927203:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:309:x1830882982980480:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066748.927215:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.927235:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa5a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0989 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.927686:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.927707:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.927714:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.927743:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.927755:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 11 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066748.927766:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984351360:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.927839:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.930983:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.931243:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984351360:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.931269:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066748.931361:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982980608 00000100:00100000:3.0:1746066748.931368:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982980608 00010000:00010000:3.0:1746066748.931402:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.931426:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6855 00000100:00100000:3.0:1746066748.931432:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982980608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.931444:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.931449:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.931458:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.931481:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0dc00/0xf1867c21abfa59cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0935 expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.931494:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.931499:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.931506:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.931513:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.931529:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.931583:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882982980608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 150us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.931593:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6855 00010000:00010000:1.0:1746066748.931849:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066748.931856:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066748.931876:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066748.932033:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa5a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.932064:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.932071:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066748.932073:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066748.932075:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899800, rc 0) 00000100:00100000:1.0:1746066748.932106:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:309:x1830882982980480:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4903us (5639us total) trans 8589936471 rc 0/0 00000100:00100000:1.0:1746066748.932113:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16167 00000100:00100000:0.0:1746066748.934193:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.934281:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982980736 00000100:00100000:2.0:1746066748.934337:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982980736 00000100:00100000:2.0:1746066748.934392:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16168 00000100:00100000:2.0:1746066748.934400:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:309:x1830882982980736:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066748.934424:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.934440:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5a50 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0990 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.934569:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.934582:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.934588:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.934616:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.934641:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.934653:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984351488:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.935066:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.936230:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984351488:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.936248:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066748.936778:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.937033:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982980864 00000100:00100000:2.0:1746066748.937038:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982980864 00010000:00010000:2.0:1746066748.937064:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 13 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.937100:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6856 00000100:00100000:2.0:1746066748.937106:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982980864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.937118:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.937124:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 13 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.937134:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 13 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.937155:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899800/0xf1867c21abfa5a42 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0989 expref: 13 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.937170:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.937174:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.937182:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.937187:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.937204:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066748.937771:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982980864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 662us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.937777:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6856 00010000:00010000:2.0:1746066748.937799:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.937806:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066748.938001:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066748.938007:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066748.938023:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.938052:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa5a50 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0990 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.938064:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0990 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.938070:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.938076:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066748.938079:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8600, rc 0) 00000100:00100000:2.0:1746066748.938114:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:309:x1830882982980736:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3715us (3930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.938120:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16168 00000100:00100000:0.0:1746066748.940055:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.940254:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.940330:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982980992 00000100:00100000:3.0:1746066748.940339:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982980992 00000100:00100000:3.0:1746066748.940376:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982981120 00000100:00100000:3.0:1746066748.940378:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982981120 00000100:00100000:3.0:1746066748.940400:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15342 00000100:00100000:3.0:1746066748.940406:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982980992:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.940424:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.940440:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa5a5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0997 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.940489:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15343 00000100:00100000:1.0:1746066748.940497:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982981120:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066748.940505:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066748.940515:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898800/0xf1867c21abfa5a65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d099e expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.940562:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984351616:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066748.940631:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.940834:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984351744:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.940858:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066748.941184:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.941216:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.941474:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982981248 00000100:00100000:3.0:1746066748.941478:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982981248 00000100:00100000:3.0:1746066748.941500:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982981376 00000100:00100000:3.0:1746066748.941501:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982981376 00000100:00100000:3.0:1746066748.941521:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15344 00000100:00100000:3.0:1746066748.941527:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982981248:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.941535:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.941543:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfa5a6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09a5 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.941568:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984351872:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.941616:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.941637:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15345 00000100:00100000:3.0:1746066748.941643:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982981376:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.941649:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.941655:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa5a73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09ac expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.941679:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984352000:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066748.941697:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.942215:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984351616:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066748.942239:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898800/0xf1867c21abfa5a65 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d099e expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.942249:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898800/0xf1867c21abfa5a65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d099e expref: 14 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.942259:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898800, rc 0) 00000100:00100000:2.0:1746066748.942573:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982981120:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2075us (2316us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066748.942579:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15343 00000100:00100000:3.0:1746066748.943136:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984351744:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066748.943152:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa5a5e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0997 expref: 18 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.943160:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa5a5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0997 expref: 18 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.943168:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c600, rc 0) 00000100:00100000:3.0:1746066748.943189:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982980992:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2784us (3139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.943194:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15342 00000100:00100000:2.0:1746066748.943259:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984351872:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066748.943274:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfa5a6c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09a5 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.943281:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ec00/0xf1867c21abfa5a6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09a5 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066748.943289:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5ec00, rc 0) 00000100:00100000:2.0:1746066748.943304:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982981248:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1778us (2120us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066748.943309:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15344 00000100:00100000:3.0:1746066748.943599:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984352000:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066748.943616:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa5a73 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ac expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.943632:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5771e00/0xf1867c21abfa5a73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ac expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.943644:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5771e00, rc 0) 00000100:00100000:3.0:1746066748.943675:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982981376:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2032us (2458us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066748.943680:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15345 00000100:00100000:0.0:1746066748.945107:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.945484:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982981632 00000100:00100000:2.0:1746066748.945491:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982981632 00000100:00100000:2.0:1746066748.945594:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16169 00000100:00100000:2.0:1746066748.945602:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:309:x1830882982981632:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066748.945845:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066748.945864:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa5a7a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09b3 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.946032:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa5a81 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.946047:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa5a81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.946058:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa5a81 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066748.946070:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066748.946170:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa5a7a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09b3 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.946186:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa5a81 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09b3 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.946194:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.946197:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066748.946200:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8200, rc 0) 00000100:00100000:2.0:1746066748.946425:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:309:x1830882982981632:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 823us (1321us total) trans 8589936472 rc 0/0 00000100:00100000:2.0:1746066748.946431:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16169 00000100:00100000:0.0:1746066748.948080:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.948118:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.948145:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.948160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.948172:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.948197:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.948417:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982981760 00000100:00100000:3.0:1746066748.948426:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982981760 00000100:00100000:1.0:1746066748.948525:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982016 00000100:00100000:1.0:1746066748.948529:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982016 00000100:00100000:2.0:1746066748.948539:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982272 00000100:00100000:2.0:1746066748.948542:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982272 00000100:00100000:0.0:1746066748.948572:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982981888 00000100:00100000:3.0:1746066748.948575:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982144 00000100:00100000:0.0:1746066748.948575:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982981888 00000100:00100000:3.0:1746066748.948577:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982144 00000100:00100000:3.0:1746066748.948589:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982400 00000100:00100000:3.0:1746066748.948590:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982400 00000100:00100000:1.0:1746066748.948699:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15346 00000100:00100000:1.0:1746066748.948706:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982981760:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:0.0:1746066748.948742:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15347 00000100:00100000:0.0:1746066748.948747:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982982016:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066748.948780:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.948799:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.948804:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15348 00010000:00010000:0.0:1746066748.948807:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 15 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066748.948810:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982982272:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066748.948814:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.948820:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.948822:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.948825:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.948827:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.948841:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.948845:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.948847:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.948848:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.948852:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.948863:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.948863:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 9 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.948870:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 29 pid: 12237 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.948908:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984352256:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.948912:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.948920:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 17 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.948926:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066748.948927:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066748.948928:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.948953:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 17 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.948961:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 17 pid: 12237 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066748.948969:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984352384:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.948971:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.948988:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.948990:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15349 00000100:00100000:3.0:1746066748.948996:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982982144:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066748.949011:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949020:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949026:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.949027:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.949029:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949044:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949051:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 29 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.949059:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984352512:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.949077:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066748.949093:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15350 00000100:00100000:3.0:1746066748.949097:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982981888:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066748.949115:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949125:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949129:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.949130:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066748.949132:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.949140:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984352128:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.949145:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949151:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 9 pid: 12237 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.949158:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984352640:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066748.949165:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 15 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066748.949171:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066748.949172:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 15 pid: 1893 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1746066748.949179:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984352768:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.949182:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15351 00000100:00100000:3.0:1746066748.949186:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982982400:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066748.949199:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.949200:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949208:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.949212:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 25 pid: 11630 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.949218:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066748.949219:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984352896:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.949224:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949229:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.949230:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.949232:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.949232:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066748.949246:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949253:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 25 pid: 9591 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.949259:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984353024:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.949283:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066748.949558:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 15 pid: 12237 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066748.949568:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984353152:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.949596:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 9 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.949603:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 9 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.949610:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984353280:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066748.949634:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066748.953075:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.953089:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984352384:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.953101:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066748.953115:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.953175:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984353024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.953176:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984352128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.953185:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984352768:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066748.953192:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984352896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066748.953200:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984353152:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066748.953206:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.953226:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982656 00000100:00100000:0.0:1746066748.953231:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982656 00000100:00100000:1.0:1746066748.953241:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984353280:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066748.953257:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066748.953268:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1773568->2097151) req@ffff88011f78fb80 x1830882982982656/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066748.953278:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f78fb80 with x1830882982982656 ext(1773568->2097151) 00000100:00100000:3.0:1746066748.953428:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984352640:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.953442:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.953460:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984352512:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.953468:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.953484:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984352256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066748.953493:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.953794:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 30 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746066748.953807:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 30 pid: 20361 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746066748.953813:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f78fb80 00000100:00100000:0.0:1746066748.953843:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982528 00000100:00100000:0.0:1746066748.953846:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982528 00002000:00100000:0.0:1746066748.953860:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (610304->1048575) req@ffff88011f78f100 x1830882982982528/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066748.953867:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f78f100 with x1830882982982528 ext(610304->1048575) 00010000:00010000:0.0:1746066748.953872:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 18 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746066748.953879:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 18 pid: 12237 timeout: 817 lvb_type: 0 00002000:00010000:0.0:1746066748.953908:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f78f100 00000100:00100000:0.0:1746066748.953931:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 850 00000100:00100000:0.0:1746066748.953948:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982982656:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066748.954177:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 851 00000100:00100000:1.0:1746066748.954183:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882982982528:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066748.955769:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.955808:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982912 00000100:00100000:2.0:1746066748.955814:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982912 00002000:00100000:2.0:1746066748.955840:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1433599) req@ffff880096426300 x1830882982982912/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.955848:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426300 with x1830882982982912 ext(1048576->1433599) 00010000:00010000:2.0:1746066748.955854:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.955864:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066748.955875:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096426300 00000100:00100000:2.0:1746066748.955916:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 852 00000100:00100000:2.0:1746066748.955923:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982982912:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066748.956099:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.956210:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.956268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.956291:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982982784 00000100:00100000:3.0:1746066748.956295:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982982784 00002000:00100000:3.0:1746066748.956315:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2564095) req@ffff880096426d80 x1830882982982784/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/0 e 0 to 0 dl 1746066759 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.956322:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426d80 with x1830882982982784 ext(2097152->2564095) 00010000:00010000:3.0:1746066748.956328:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 32 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.956337:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 32 pid: 12237 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746066748.956342:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096426d80 00000100:00100000:3.0:1746066748.956369:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 853 00000100:00100000:3.0:1746066748.956374:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882982982784:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066748.958565:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.958945:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983168 00000100:00100000:2.0:1746066748.958946:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983040 00000100:00100000:3.0:1746066748.958953:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983168 00000100:00100000:2.0:1746066748.958953:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983040 00010000:00010000:3.0:1746066748.958989:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 16 pid: 1893 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1746066748.959474:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.959544:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983296 00000100:00100000:3.0:1746066748.959548:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983296 00010000:00010000:3.0:1746066748.959565:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 26 pid: 11630 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.959596:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6857 00000100:00100000:3.0:1746066748.959605:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982983168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.959617:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.959654:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 16 pid: 1893 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.959666:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 16 pid: 1893 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.959694:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bc400/0xf1867c21abfa598c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0912 expref: 16 pid: 1893 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.959715:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.959779:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6858 00000100:00100000:1.0:1746066748.959788:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882982983296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.959798:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.959807:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 26 pid: 11630 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.959816:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 26 pid: 11630 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.959834:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e0a800/0xf1867c21abfa58a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0871 expref: 26 pid: 11630 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.959849:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.959871:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882982983296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.959877:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6858 00000100:00100000:3.0:1746066748.960329:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982983168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 724us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.960335:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6857 00000100:00100000:0.0:1746066748.962051:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.962633:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983552 00000100:00100000:3.0:1746066748.962641:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983552 00010000:00010000:3.0:1746066748.962670:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 15 pid: 12237 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066748.962693:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983424 00000100:00100000:3.0:1746066748.962695:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983424 00010000:00010000:3.0:1746066748.962706:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 25 pid: 9591 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.962719:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6859 00000100:00100000:3.0:1746066748.962725:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982983552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.962736:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.962751:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 15 pid: 12237 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.962761:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 15 pid: 12237 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.962786:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd600/0xf1867c21abfa59a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0927 expref: 15 pid: 12237 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066748.962801:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.962834:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982983552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (3361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.962839:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6859 00000100:00100000:3.0:1746066748.962853:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6860 00000100:00100000:3.0:1746066748.962857:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882982983424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.962862:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.962868:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 25 pid: 9591 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.962876:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 25 pid: 9591 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.962907:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d04000/0xf1867c21abfa5907 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08d3 expref: 25 pid: 9591 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.962915:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.962929:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882982983424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.962934:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6860 00010000:00010000:2.0:1746066748.965438:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 12 pid: 12237 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.965492:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6861 00000100:00100000:2.0:1746066748.965504:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882982983040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066748.965518:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.965537:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 12 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.965547:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 12 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.965567:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d800/0xf1867c21abfa58ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0886 expref: 12 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.965580:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.965582:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066748.965586:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965598:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965633:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066748.965653:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965661:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965676:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965682:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965689:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965695:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bd800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066748.965698:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965705:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965714:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.965719:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bd800/0xf1867c21abfa5a8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.965798:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982982016:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 17049us (17678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.965807:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15347 00000100:00100000:2.0:1746066748.965847:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982983040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 347us (9578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.965852:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6861 00000100:00100000:2.0:1746066748.970820:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882982982656:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 16870us (17742us total) trans 21474841743 rc 0/0 00000100:00100000:2.0:1746066748.970831:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 850 00002000:00100000:2.0:1746066748.970843:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1773568->2097151) req@ffff88011f78fb80 x1830882982982656/t21474841743(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.970851:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f78fb80 with x1830882982982656 ext(1773568->2097151) 00010000:00010000:2.0:1746066748.970861:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 34 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.970874:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 34 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066748.971514:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882982982528:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 17329us (18409us total) trans 21474841744 rc 0/0 00000100:00100000:1.0:1746066748.971521:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 851 00002000:00100000:1.0:1746066748.971527:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (610304->1048575) req@ffff88011f78f100 x1830882982982528/t21474841744(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066748.971534:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f78f100 with x1830882982982528 ext(610304->1048575) 00010000:00010000:1.0:1746066748.971540:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 20 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.971548:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 20 pid: 12237 timeout: 817 lvb_type: 0 00002000:00010000:1.0:1746066748.971554:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f78f100 00002000:00010000:2.0:1746066748.971666:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011f78fb80 00000100:00100000:1.0:1746066748.971999:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.972553:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983680 00000100:00100000:0.0:1746066748.972564:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983680 00010000:00010000:0.0:1746066748.972597:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 11 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.972827:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6862 00000100:00100000:3.0:1746066748.972840:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982983680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.972855:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.972876:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 11 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.973034:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 11 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.973057:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b32600/0xf1867c21abfa5900 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d08cc expref: 11 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.973071:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.973073:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.973077:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.973084:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.973107:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.973135:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982983680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 299us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.973140:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6862 00010000:00010000:1.0:1746066748.973196:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973204:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973221:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973228:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973234:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973239:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5992c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066748.973242:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973248:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973258:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.973264:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa5ab2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.973319:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982982400:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 24132us (25121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.973326:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15351 00000100:00100000:0.0:1746066748.976446:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.976513:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066748.976581:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983808 00000100:00100000:1.0:1746066748.976591:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983808 00010000:00010000:1.0:1746066748.976633:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 20 pid: 12237 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066748.976658:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982983936 00000100:00100000:1.0:1746066748.976660:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982983936 00010000:00010000:1.0:1746066748.976670:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 34 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066748.976685:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6863 00000100:00100000:1.0:1746066748.976691:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882982983808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.976703:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.976720:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 20 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.976729:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 20 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.976751:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa59e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 610304->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d094a expref: 20 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.976767:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.976769:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.976773:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.976781:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.976807:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.976846:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882982983808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 155us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.976852:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6863 00000100:00100000:1.0:1746066748.976868:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6864 00000100:00100000:1.0:1746066748.976873:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882982983936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066748.976880:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066748.976905:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 34 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.976913:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 34 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.976924:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0de00/0xf1867c21abfa59d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1773568->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d093c expref: 34 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066748.976932:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.976933:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066748.976936:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.976941:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.976954:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066748.976969:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982983936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.976975:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6864 00010000:00010000:1.0:1746066748.976992:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977000:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977014:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977021:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977027:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977033:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5992800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066748.977037:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977043:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977053:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066748.977058:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa5aa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066748.977096:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982982144:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 28100us (28922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066748.977103:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15349 00010000:00010000:2.0:1746066748.977781:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977795:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977813:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977819:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977825:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977830:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5898c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066748.977833:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977839:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977849:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.977855:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa5a9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066748.977910:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882982981760:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 29203us (29832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066748.977916:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15346 00000100:00100000:2.0:1746066748.980017:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882982982912:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 24087us (24243us total) trans 17179874307 rc 0/0 00000100:00100000:2.0:1746066748.980031:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 852 00002000:00100000:2.0:1746066748.980043:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1433599) req@ffff880096426300 x1830882982982912/t17179874307(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066748.980052:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426300 with x1830882982982912 ext(1048576->1433599) 00010000:00010000:2.0:1746066748.980064:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066748.980076:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066748.980083:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096426300 00000100:00100000:3.0:1746066748.980200:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882982982784:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 23824us (23990us total) trans 21474841745 rc 0/0 00000100:00100000:3.0:1746066748.980207:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 853 00002000:00100000:3.0:1746066748.980211:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2564095) req@ffff880096426d80 x1830882982982784/t21474841745(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:154/0 lens 488/448 e 0 to 0 dl 1746066759 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066748.980224:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426d80 with x1830882982982784 ext(2097152->2564095) 00010000:00010000:3.0:1746066748.980229:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 33 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.980237:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 33 pid: 12237 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746066748.980242:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096426d80 00000100:00100000:0.0:1746066748.981980:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.982030:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.982231:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982984064 00000100:00100000:2.0:1746066748.982240:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982984064 00010000:00010000:2.0:1746066748.982268:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 33 pid: 12237 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.982301:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982984192 00000100:00100000:2.0:1746066748.982304:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982984192 00010000:00010000:2.0:1746066748.982315:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746066748.982491:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6865 00000100:00100000:3.0:1746066748.982496:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6866 00000100:00100000:0.0:1746066748.982499:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882982984064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066748.982502:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882982984192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.982513:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066748.982513:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.982531:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746066748.982531:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 33 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746066748.982540:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 33 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.982542:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.982561:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa59fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d095f expref: 10 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746066748.982561:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd400/0xf1867c21abfa59f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2564095) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0958 expref: 33 pid: 12237 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.982575:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.982577:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066748.982582:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.982583:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.982584:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066748.982586:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982591:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066748.982592:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982614:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066748.982614:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066748.982642:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982648:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.982657:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882982984064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 160us (683us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066748.982664:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066748.982664:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6865 00010000:00010000:3.0:1746066748.982670:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982676:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982683:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5992a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066748.982686:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982692:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982702:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982706:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa5a96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.982747:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882982982272:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 33937us (34600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.982755:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15348 00010000:00010000:3.0:1746066748.982904:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982911:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982924:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982930:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982937:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982942:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5993800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066748.982945:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982951:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982959:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.982965:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993800/0xf1867c21abfa5aab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066748.983010:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982981888:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 33911us (34848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.983019:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15350 00000100:00100000:3.0:1746066748.983042:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2014:x1830882982984192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 540us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.983047:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6866 00000100:00100000:0.0:1746066748.985828:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066748.985992:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982984448 00000100:00100000:2.0:1746066748.986002:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982984448 00000100:00100000:2.0:1746066748.986057:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16170 00000100:00100000:2.0:1746066748.986064:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:309:x1830882982984448:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746066748.986116:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066748.986142:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa5a57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0990 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.986155:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.986160:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066748.986187:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.986198:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.986205:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.986211:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.986241:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.986252:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.986265:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984353408:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.986365:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066748.986378:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 30 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066748.986385:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984353536:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.986405:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066748.988228:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984353408:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066748.988240:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984353536:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066748.988262:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066748.988404:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066748.988773:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066748.989116:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982984704 00000100:00100000:3.0:1746066748.989122:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982984704 00010000:00010000:3.0:1746066748.989154:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 31 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.989186:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982984576 00000100:00100000:3.0:1746066748.989189:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982984576 00010000:00010000:3.0:1746066748.989198:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 12 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066748.989215:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6867 00000100:00100000:3.0:1746066748.989221:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882982984704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.989233:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.989238:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 31 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.989247:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 31 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.989266:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c4800/0xf1867c21abfa5882 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d084e expref: 31 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.989280:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.989285:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.989292:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.989328:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882982984704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.989334:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6867 00000100:00100000:3.0:1746066748.989351:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6868 00000100:00100000:3.0:1746066748.989356:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882982984576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066748.989362:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066748.989365:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 12 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.989373:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 12 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.989383:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5897 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0863 expref: 12 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066748.989391:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.989394:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.989404:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.989411:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066748.989429:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066748.989443:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982984576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.989449:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6868 00010000:00010000:2.0:1746066748.989870:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.989877:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000040:00080000:2.0:1746066748.990125:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].562, 88 off57160 00000004:00080000:2.0:1746066748.990130:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717201246802ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.990155:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].504, 88 off52144 00000004:00080000:2.0:1746066748.990158:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717201274806ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.990751:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].505, 88 off52232 00000004:00080000:2.0:1746066748.990755:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717201871714ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.990765:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].563, 88 off57248 00000004:00080000:2.0:1746066748.990767:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717201883746ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.990907:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].565, 88 off57432 00000004:00080000:2.0:1746066748.990911:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717202027806ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.990923:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].506, 88 off52320 00000004:00080000:2.0:1746066748.990927:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717202043404ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.990934:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].507, 88 off52408 00000004:00080000:2.0:1746066748.990937:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717202053826ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.990944:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].508, 88 off52496 00000004:00080000:2.0:1746066748.990946:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717202063009ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.990954:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].566, 88 off57520 00000004:00080000:2.0:1746066748.990957:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717202073784ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.990965:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].509, 88 off52584 00000004:00080000:2.0:1746066748.990967:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717202084212ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.990974:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].567, 88 off57608 00000004:00080000:2.0:1746066748.990977:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717202093857ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.990984:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].510, 88 off52672 00000004:00080000:2.0:1746066748.990988:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717202104476ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066748.990995:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].568, 88 off57696 00000004:00080000:2.0:1746066748.990997:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717202114229ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.991005:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].569, 88 off57784 00000004:00080000:2.0:1746066748.991007:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717202124072ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.991014:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].570, 88 off57872 00000004:00080000:2.0:1746066748.991017:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717202133637ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.991024:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].571, 88 off57960 00000004:00080000:2.0:1746066748.991027:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717202143589ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066748.991034:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].511, 88 off52760 00000004:00080000:2.0:1746066748.991037:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717202153337ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066748.993076:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936473 is committed 00000004:00080000:3.0:1746066748.993087:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 502 committed 00000004:00080000:3.0:1746066748.993372:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 560 committed 00000004:00080000:3.0:1746066748.993386:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 559 committed 00000004:00080000:3.0:1746066748.993388:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 558 committed 00000004:00080000:3.0:1746066748.993390:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 557 committed 00000004:00080000:3.0:1746066748.993391:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 501 committed 00000004:00080000:3.0:1746066748.993393:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 556 committed 00000004:00080000:3.0:1746066748.993395:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 500 committed 00000004:00080000:3.0:1746066748.993396:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 555 committed 00000004:00080000:3.0:1746066748.993398:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 499 committed 00000004:00080000:3.0:1746066748.993399:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 498 committed 00000004:00080000:3.0:1746066748.993401:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 497 committed 00000004:00080000:3.0:1746066748.993402:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 554 committed 00000004:00080000:3.0:1746066748.993404:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 553 committed 00000004:00080000:3.0:1746066748.993406:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 496 committed 00000004:00080000:3.0:1746066748.993407:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 495 committed 00000004:00080000:3.0:1746066748.993409:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 552 committed 00000001:00080000:3.0:1746066748.993419:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936470 is committed 00000001:00080000:3.0:1746066748.993424:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936469 is committed 00000100:00100000:2.0:1746066748.993655:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984353792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.993724:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.993756:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984354304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.993775:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.993792:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746066748.993797:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984353920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.993814:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.993825:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984354432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.993839:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.993868:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984353792 00000100:00100000:2.0:1746066748.993876:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984353792 00000100:00100000:3.0:1746066748.993955:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984353664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.993977:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.994226:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984354816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.994607:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.994634:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.994658:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354304 00000100:00100000:2.0:1746066748.994661:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354304 00000100:00100000:2.0:1746066748.994678:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984353920 00000100:00100000:2.0:1746066748.994680:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984353920 00000100:00100000:2.0:1746066748.994690:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354432 00000100:00100000:2.0:1746066748.994691:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354432 00000100:00100000:2.0:1746066748.994700:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984353664 00000100:00100000:2.0:1746066748.994701:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984353664 00000100:00100000:2.0:1746066748.994713:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15352 00000100:00100000:2.0:1746066748.994720:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984353792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.994870:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984353792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 150us (1147us total) trans 21474841746 rc 0/0 00000100:00100000:2.0:1746066748.994876:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15352 00000100:00100000:2.0:1746066748.994905:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15353 00000100:00100000:2.0:1746066748.994910:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984354304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.994955:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984354304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1180us total) trans 21474841747 rc 0/0 00000100:00100000:2.0:1746066748.994959:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15353 00000100:00100000:2.0:1746066748.994967:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15354 00000100:00100000:2.0:1746066748.994970:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984353920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.995009:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984353920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (1194us total) trans 21474841748 rc 0/0 00000100:00100000:2.0:1746066748.995013:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15354 00000100:00100000:2.0:1746066748.995140:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15355 00000100:00100000:2.0:1746066748.995144:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984354432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066748.995177:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066748.995180:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066748.995182:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.995183:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066748.995185:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:2.0:1746066748.995198:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984354432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (1358us total) trans 21474841749 rc 0/0 00000100:00100000:2.0:1746066748.995201:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15355 00000100:00100000:2.0:1746066748.995208:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15356 00000100:00100000:2.0:1746066748.995211:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3777:x1830882984353664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.995244:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984353664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 33us (1267us total) trans 21474841750 rc 0/0 00000100:00100000:2.0:1746066748.995248:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15356 00000100:00100000:2.0:1746066748.995266:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984354944:0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746066748.995312:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800966e3b80 reply state ffff880093629c00 transno 8589936473 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995329:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995337:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.995340:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746066748.995344:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746066748.995414:0:17253:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746066748.995425:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:309:x1830882982984448:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 9360us (9606us total) trans 8589936473 rc 0/0 00000100:00100000:2.0:1746066748.995432:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16170 00010000:00010000:2.0:1746066748.995451:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995458:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995464:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995469:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066748.995473:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995480:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995489:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066748.995491:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066748.995493:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066748.995498:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8000/0xf1867c21abfa5ab9 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066748.996314:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354176 00000100:00100000:1.0:1746066748.996321:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354176 00000100:00100000:1.0:1746066748.996344:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15357 00000100:00100000:1.0:1746066748.996349:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984354176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066748.996415:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:1.0:1746066748.996418:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.996420:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066748.996421:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066748.996423:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:1.0:1746066748.996451:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3777:x1830882984354176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (1816us total) trans 21474841751 rc 0/0 00000100:00100000:1.0:1746066748.996456:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15357 00000100:00100000:1.0:1746066748.996478:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066748.996493:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984355328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066748.996512:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066748.996539:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb5880/2, rc 0, transno 21474841748 00000100:00100000:1.0:1746066748.996547:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984353920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066748.996555:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d9b2d80/2, rc 0, transno 21474841749 00000100:00100000:1.0:1746066748.996558:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984354432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066748.996566:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096425f80/2, rc 0, transno 21474841746 00000100:00100000:1.0:1746066748.996569:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984353792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066748.996575:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d9b0700/2, rc 0, transno 21474841747 00000100:00100000:1.0:1746066748.996578:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984354304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.996880:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.996902:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.996917:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.996918:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984355456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.996928:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.996931:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.996949:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354816 00000100:00100000:2.0:1746066748.996952:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354816 00000100:00100000:3.0:1746066748.996953:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.996966:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984355328 00000100:00100000:2.0:1746066748.996968:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984355328 00000004:00080000:3.0:1746066748.996969:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096427b80/2, rc 0, transno 21474841750 00000100:00100000:3.0:1746066748.996972:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984353664:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.996975:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354944 00000100:00100000:2.0:1746066748.996977:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354944 00000004:00080000:3.0:1746066748.996978:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e6b480/2, rc 0, transno 21474841751 00000100:00100000:3.0:1746066748.996980:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.996982:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354688 00000100:00100000:2.0:1746066748.996984:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354688 00000100:00100000:3.0:1746066748.996988:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.996989:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984355456 00000100:00100000:2.0:1746066748.996990:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984355456 00000100:00100000:2.0:1746066748.996995:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984355200 00000100:00100000:2.0:1746066748.996997:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984355200 00000100:00100000:3.0:1746066748.997003:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066748.997004:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15358 00000100:00100000:2.0:1746066748.997009:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3774:x1830882984354816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.997011:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1746066748.997014:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.997026:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.997032:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.997043:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.997049:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.997060:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.997066:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.997076:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066748.997095:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984355712 00000100:00100000:3.0:1746066748.997098:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984355712 00000100:00100000:3.0:1746066748.997110:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354048 00000100:00100000:3.0:1746066748.997112:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354048 00000100:00100000:3.0:1746066748.997117:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984354560 00000100:00100000:3.0:1746066748.997118:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984354560 00000100:00100000:3.0:1746066748.997123:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984355072 00000100:00100000:0.0:1746066748.997526:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984355584 00000100:00100000:0.0:1746066748.997530:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984355584 00000100:00100000:0.0:1746066748.997544:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15359 00000100:00100000:0.0:1746066748.997548:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984355328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.998167:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984354816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1156us (1687us total) trans 17179874308 rc 0/0 00000100:00100000:2.0:1746066748.998173:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15358 00000100:00100000:2.0:1746066748.998186:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15360 00000100:00100000:2.0:1746066748.998192:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882984354944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.998254:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984354944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1352us total) trans 17179874310 rc 0/0 00000100:00100000:2.0:1746066748.998259:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15360 00000100:00100000:2.0:1746066748.998268:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15361 00000100:00100000:2.0:1746066748.998271:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3777:x1830882984354688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.998325:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984354688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (1408us total) trans 17179874311 rc 0/0 00000100:00100000:2.0:1746066748.998330:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15361 00000100:00100000:2.0:1746066748.998338:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15362 00000100:00100000:2.0:1746066748.998342:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882984355456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.998392:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984355456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (1459us total) trans 17179874312 rc 0/0 00000100:00100000:2.0:1746066748.998396:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15362 00000100:00100000:2.0:1746066748.998404:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15363 00000100:00100000:2.0:1746066748.998408:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3777:x1830882984355200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066748.998444:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:2.0:1746066748.998447:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998449:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.998450:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998452:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:2.0:1746066748.998468:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984355200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (1514us total) trans 17179874313 rc 0/0 00000100:00100000:2.0:1746066748.998472:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15363 00000100:00100000:2.0:1746066748.998482:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15364 00000100:00100000:2.0:1746066748.998486:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3777:x1830882984355712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.998546:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3777:x1830882984355712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (1542us total) trans 21474841752 rc 0/0 00000100:00100000:2.0:1746066748.998550:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15364 00000100:00100000:2.0:1746066748.998563:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15365 00000100:00100000:2.0:1746066748.998568:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3777:x1830882984354048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066748.998605:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:2.0:1746066748.998607:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998609:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.998611:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998613:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:2.0:1746066748.998643:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3777:x1830882984354048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (1616us total) trans 21474841753 rc 0/0 00000100:00100000:2.0:1746066748.998648:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15365 00000100:00100000:2.0:1746066748.998658:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15366 00000100:00100000:2.0:1746066748.998662:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3777:x1830882984354560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066748.998691:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984355072 00002000:00010000:2.0:1746066748.998698:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:2.0:1746066748.998700:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998702:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066748.998703:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998705:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066748.998711:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15367 00000100:00100000:3.0:1746066748.998717:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984355584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066748.998722:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3777:x1830882984354560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1678us total) trans 21474841754 rc 0/0 00000100:00100000:2.0:1746066748.998727:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15366 00000100:00100000:2.0:1746066748.998735:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15368 00000100:00100000:2.0:1746066748.998739:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984355072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066748.998777:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066748.998779:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998780:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066748.998782:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066748.998783:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:3.0:1746066748.998784:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3777:x1830882984355584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1707us total) trans 17179874314 rc 0/0 00000100:00100000:3.0:1746066748.998790:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15367 00000100:00100000:2.0:1746066748.998800:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3777:x1830882984355072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (1739us total) trans 17179874315 rc 0/0 00000100:00100000:2.0:1746066748.998805:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15368 00000004:00080000:3.0:1746066748.998825:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb7100/2, rc 0, transno 21474841753 00000100:00100000:3.0:1746066748.998830:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354048:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.998837:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009d9b1500/2, rc 0, transno 21474841754 00000004:00080000:2.0:1746066748.998838:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78d500/2, rc 0, transno 17179874310 00000100:00100000:3.0:1746066748.998840:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066748.998842:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984354944:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.998847:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78d880/2, rc 0, transno 17179874315 00000100:00100000:3.0:1746066748.998850:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355072:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066748.998850:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78c000/2, rc 0, transno 17179874312 00000100:00100000:2.0:1746066748.998853:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984355456:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.998857:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78c380/2, rc 0, transno 17179874314 00000100:00100000:3.0:1746066748.998859:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.998865:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78e680/2, rc 0, transno 21474841752 00000100:00100000:3.0:1746066748.998867:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066748.998873:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78e300/2, rc 0, transno 17179874311 00000100:00100000:3.0:1746066748.998875:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984354688:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066748.998880:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78dc00/2, rc 0, transno 17179874313 00000100:00100000:3.0:1746066748.998898:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984355200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066748.999517:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984355328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1967us (3003us total) trans 17179874309 rc 0/0 00000100:00100000:0.0:1746066748.999523:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15359 00000100:00100000:0.0:1746066748.999592:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000004:00080000:1.0:1746066748.999655:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78d180/2, rc 0, transno 17179874308 00000100:00100000:1.0:1746066748.999659:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984354816:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066748.999668:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78df80/2, rc 0, transno 17179874309 00000100:00100000:1.0:1746066748.999671:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984355328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066748.999720:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982984832 00000100:00100000:3.0:1746066748.999723:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982984832 00000100:00100000:3.0:1746066748.999747:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16171 00000100:00100000:3.0:1746066748.999751:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:309:x1830882982984832:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066748.999767:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066748.999782:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09ba expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.999827:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.999839:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066748.999852:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066748.999854:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066748.999857:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:3.0:1746066748.999898:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:309:x1830882982984832:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 146us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066748.999903:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16171 00000100:00100000:0.0:1746066749.003233:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.003864:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982984960 00000100:00100000:2.0:1746066749.003874:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982984960 00000100:00100000:2.0:1746066749.004052:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16172 00000100:00100000:2.0:1746066749.004060:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:309:x1830882982984960:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066749.004080:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.004099:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5ac7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09c1 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.004189:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5ace lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.004202:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5ace lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.004212:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5ace lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066749.004244:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066749.004248:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066749.004261:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5ace lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.004282:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5ac7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c1 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.004895:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5ace lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c1 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.004908:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.004911:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066749.004914:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d800, rc 0) 00000100:00100000:2.0:1746066749.005005:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:309:x1830882982984960:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 945us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.005011:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16172 00000100:00100000:0.0:1746066749.007109:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.007227:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985088 00000100:00100000:2.0:1746066749.007235:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985088 00000100:00100000:0.0:1746066749.007241:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.007577:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.007740:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985216 00000100:00100000:3.0:1746066749.007745:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985216 00000100:00100000:0.0:1746066749.007745:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.007758:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.007824:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.007838:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985344 00000100:00100000:1.0:1746066749.007841:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985344 00000100:00100000:1.0:1746066749.007863:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985600 00000100:00100000:1.0:1746066749.007865:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985600 00000100:00100000:1.0:1746066749.007874:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985472 00000100:00100000:1.0:1746066749.007875:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985472 00000100:00100000:3.0:1746066749.007880:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15369 00000100:00100000:3.0:1746066749.007905:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982985088:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066749.007906:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15370 00000100:00100000:1.0:1746066749.007911:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882982985216:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066749.007923:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.007923:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.007941:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09c8 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.007941:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09cf expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066749.007961:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd3d, atime: 0x6812dd3d, ctime: 0x6812dd3d, blocks: 0x7b0 00002000:00010000:1.0:1746066749.007961:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd3d, atime: 0x6812dd3c, ctime: 0x6812dd3d, blocks: 0x808 00010000:00010000:3.0:1746066749.007978:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.007978:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.007980:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.007980:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.007988:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.007988:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.008001:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.008001:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 13 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.008012:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a000, rc 0) 00010000:00010000:1.0:1746066749.008012:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00000100:00100000:3.0:1746066749.008306:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982985088:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 400us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.008313:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15369 00000100:00100000:3.0:1746066749.008330:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15371 00000100:00100000:3.0:1746066749.008335:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982985344:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066749.008342:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.008349:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09d6 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066749.008360:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd3d, atime: 0x6812dd3c, ctime: 0x6812dd3d, blocks: 0x800 00010000:00010000:3.0:1746066749.008369:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.008370:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.008374:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.008383:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.008389:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b800, rc 0) 00000100:00100000:2.0:1746066749.008563:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985728 00000100:00100000:2.0:1746066749.008567:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985728 00000100:00100000:3.0:1746066749.008592:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982985344:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 257us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.008592:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982985216:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 679us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.008597:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15370 00000100:00100000:3.0:1746066749.008603:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15371 00000100:00100000:1.0:1746066749.008611:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15372 00000100:00100000:3.0:1746066749.008614:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15373 00000100:00100000:1.0:1746066749.008616:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982985600:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746066749.008626:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982985472:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066749.008630:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.008630:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.008638:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09dd expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.008638:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09e4 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066749.008648:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd3d, atime: 0x6812dd3c, ctime: 0x6812dd3d, blocks: 0x800 00002000:00010000:1.0:1746066749.008648:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd3d, atime: 0x6812dd3c, ctime: 0x6812dd3d, blocks: 0x1668 00010000:00010000:3.0:1746066749.008655:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.008655:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.008657:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.008657:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.008660:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.008660:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 17 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.008669:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.008669:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 17 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.008676:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a400, rc 0) 00010000:00010000:1.0:1746066749.008676:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b400, rc 0) 00000100:00100000:3.0:1746066749.008690:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982985472:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 72us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.008690:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982985600:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 74us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.008694:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15372 00000100:00100000:3.0:1746066749.008696:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15373 00000100:00100000:1.0:1746066749.008703:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15374 00000100:00100000:1.0:1746066749.008707:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882982985728:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066749.008712:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.008719:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09eb expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066749.008727:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd3d, atime: 0x6812dd3c, ctime: 0x6812dd3d, blocks: 0x1000 00010000:00010000:1.0:1746066749.008734:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.008735:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.008738:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.008746:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.008752:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b600, rc 0) 00000100:00100000:1.0:1746066749.008765:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982985728:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 58us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.008769:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15374 00000100:00100000:0.0:1746066749.015372:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.015438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.015467:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.015553:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.015555:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985856 00000100:00100000:2.0:1746066749.015566:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985856 00000100:00100000:0.0:1746066749.015582:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.015605:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982986112 00000100:00100000:0.0:1746066749.015609:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.015610:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982986112 00000100:00100000:1.0:1746066749.015670:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982986368 00000100:00100000:3.0:1746066749.015675:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982985984 00000100:00100000:1.0:1746066749.015675:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982986368 00000100:00100000:3.0:1746066749.015677:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982985984 00000100:00100000:3.0:1746066749.015689:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982986240 00000100:00100000:3.0:1746066749.015691:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982986240 00000100:00100000:1.0:1746066749.015692:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982986496 00000100:00100000:1.0:1746066749.015693:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982986496 00000100:00100000:3.0:1746066749.015704:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15375 00000100:00100000:1.0:1746066749.015713:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15376 00000100:00100000:3.0:1746066749.015714:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982986112:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066749.015718:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982985984:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066749.015732:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15377 00000100:00100000:3.0:1746066749.015736:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982986368:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066749.015803:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15378 00000100:00100000:2.0:1746066749.015807:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15379 00000100:00100000:0.0:1746066749.015809:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982986240:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066749.015812:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982986496:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066749.015919:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982986368:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 181us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.015925:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15377 00000100:00100000:3.0:1746066749.015942:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15380 00000100:00100000:3.0:1746066749.015947:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982985856:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066749.015950:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982986240:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 141us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066749.015954:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15378 00000100:00100000:3.0:1746066749.015977:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982985856:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.015982:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15380 00000100:00100000:3.0:1746066749.016012:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982986112:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 303us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.016017:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15375 00000100:00100000:2.0:1746066749.016081:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982986496:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 268us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.016087:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15379 00000100:00100000:1.0:1746066749.016134:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982985984:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 414us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.016139:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15376 00000100:00100000:0.0:1746066749.018099:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.018268:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.018295:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.018452:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982986624 00000100:00100000:2.0:1746066749.018460:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982986624 00000100:00100000:0.0:1746066749.018461:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.018509:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982986880 00000100:00100000:3.0:1746066749.018513:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982986880 00000100:00100000:0.0:1746066749.018541:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.018583:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982987136 00000100:00100000:2.0:1746066749.018591:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982986752 00000100:00100000:2.0:1746066749.018593:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982986752 00000100:00100000:1.0:1746066749.018596:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982987136 00000100:00100000:2.0:1746066749.018606:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15381 00000100:00100000:2.0:1746066749.018616:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982986880:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066749.018714:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882982986880:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 102us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.018998:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982987008 00000100:00100000:3.0:1746066749.019001:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982987008 00000100:00100000:1.0:1746066749.019569:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15382 00000100:00100000:1.0:1746066749.019577:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982986624:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066749.019629:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15381 00000100:00100000:1.0:1746066749.019644:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982986624:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 68us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.019648:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15383 00000100:00100000:1.0:1746066749.019651:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15382 00000100:00100000:2.0:1746066749.019654:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982986752:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066749.019660:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15384 00000100:00100000:1.0:1746066749.019664:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982987136:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066749.019687:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982986752:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 34us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.019687:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982987136:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 22us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.019691:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15384 00000100:00100000:3.0:1746066749.019717:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15385 00000100:00100000:3.0:1746066749.019724:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982987008:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066749.019759:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982987008:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 36us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.019765:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15385 00000100:00100000:2.0:1746066749.019824:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15383 00000100:00100000:0.0:1746066749.021502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.021908:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982987264 00000100:00100000:2.0:1746066749.021916:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982987264 00000100:00100000:2.0:1746066749.021959:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15386 00000100:00100000:2.0:1746066749.021965:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982987264:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066749.022635:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882982987264:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 668us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.022642:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15386 00000100:00100000:0.0:1746066749.025238:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.025847:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982987392 00000100:00100000:2.0:1746066749.025856:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982987392 00000100:00100000:2.0:1746066749.026114:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15387 00000100:00100000:2.0:1746066749.026126:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882982987392:12345-192.168.204.16@tcp:22:lfs.0 00002000:00010000:2.0:1746066749.026312:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066749.026316:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.026318:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066749.026320:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.026322:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:2.0:1746066749.026383:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982987392:12345-192.168.204.16@tcp:22:lfs.0 Request processed in 262us (1152us total) trans 17179874316 rc 0/0 00000100:00100000:2.0:1746066749.026389:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15387 00000100:00100000:2.0:1746066749.031539:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.031633:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982987520 00000100:00100000:0.0:1746066749.031642:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982987520 00000100:00100000:0.0:1746066749.031689:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15388 00000100:00100000:0.0:1746066749.031700:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882982987520:12345-192.168.204.16@tcp:22:lfs.0 00002000:00010000:0.0:1746066749.032691:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066749.032696:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066749.032699:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066749.032700:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066749.032703:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:0.0:1746066749.032761:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882982987520:12345-192.168.204.16@tcp:22:lfs.0 Request processed in 1064us (1232us total) trans 21474841755 rc 0/0 00000100:00100000:0.0:1746066749.032768:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15388 00000100:00100000:2.0:1746066749.040129:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.040166:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.040185:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982987904 00000100:00100000:2.0:1746066749.040191:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982987904 00000100:00100000:3.0:1746066749.040210:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982988032 00000100:00100000:3.0:1746066749.040219:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982988032 00000100:00100000:2.0:1746066749.040235:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3949 00000100:00100000:2.0:1746066749.040242:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982987904:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066749.040269:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.040280:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.040282:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.040285:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.040295:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.040491:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3950 00000100:00100000:3.0:1746066749.040501:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882982988032:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066749.040528:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.040540:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.040541:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.040544:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.040554:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.043574:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.045639:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982988288 00000100:00100000:0.0:1746066749.045648:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982988288 00000100:00100000:0.0:1746066749.045707:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3951 00000100:00100000:0.0:1746066749.045714:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882982988288:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066749.045742:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.045754:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066749.045756:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066749.045759:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.045769:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.047248:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.047277:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.047298:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.047311:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982988672 00000100:00100000:2.0:1746066749.047314:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982988672 00000100:00100000:2.0:1746066749.047336:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982989056 00000100:00100000:2.0:1746066749.047337:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982989056 00000100:00100000:2.0:1746066749.047346:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982988928 00000100:00100000:2.0:1746066749.047347:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982988928 00000100:00100000:2.0:1746066749.047356:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3952 00000100:00100000:2.0:1746066749.047361:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982988672:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066749.047380:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.047388:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.047389:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.047392:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.047399:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.047961:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3953 00000100:00100000:3.0:1746066749.047977:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882982989056:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066749.048014:0:20357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.048025:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.048027:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.048031:0:20357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.048043:0:20357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.048456:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3954 00000100:00100000:2.0:1746066749.048463:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882982988928:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066749.048484:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.048492:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.048493:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.048496:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.048505:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.058572:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.058587:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.058598:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.058604:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009326d600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066749.058608:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.058614:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.058642:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.058647:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326d600/0xf1867c21abfa5aff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.058832:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.058846:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.058853:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.058859:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066749.058863:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.058869:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.058910:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.058917:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a200/0xf1867c21abfa5b06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.059029:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2013:x1830882982988032:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18524us (18855us total) trans 0 rc 1003520/1003520 00000100:00100000:3.0:1746066749.059041:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3950 00000100:00100000:2.0:1746066749.060520:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982987904:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20272us (20392us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.060535:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3949 00010000:00010000:2.0:1746066749.066268:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.066281:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.066288:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.066298:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5771000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066749.066302:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.066310:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.066326:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.066332:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5771000/0xf1867c21abfa5b14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.066402:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882982988672:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 19036us (19152us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066749.066411:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3952 00010000:00010000:3.0:1746066749.076528:0:20357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.076551:0:20357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.076558:0:20357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.076564:0:20357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066749.076568:0:20357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.076575:0:20357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.076593:0:20357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.076599:0:20357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa5b1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->4194303] (req 2097152->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.076704:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882982989056:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 28728us (29420us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066749.076714:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3953 00010000:00010000:2.0:1746066749.076861:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.076876:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.076900:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.076906:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a4b600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066749.076910:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.076919:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.076934:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.076940:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa5b22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.077016:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882982988928:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 28550us (29713us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.077026:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3954 00010000:00010000:1.0:1746066749.082157:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.082172:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.082180:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.082186:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea5600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066749.082189:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.082196:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.082215:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.082220:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ea5600/0xf1867c21abfa5b0d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.082949:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882982988288:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 37230us (39376us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066749.082958:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3951 00000100:00100000:0.0:1746066749.096374:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.096467:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982989440 00000100:00100000:2.0:1746066749.096480:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982989440 00000100:00100000:2.0:1746066749.096658:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16173 00000100:00100000:2.0:1746066749.096667:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:309:x1830882982989440:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746066749.096708:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066749.096730:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5ace lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c1 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.096758:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.096762:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066749.096806:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.096816:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.096828:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00010000:2.0:1746066749.096943:0:7243:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880096fd6680 reply state ffff880096cf2000 transno 8589936474 ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.096951:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.096956:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.096959:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746066749.096961:0:7243:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746066749.097039:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:309:x1830882982989440:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 373us (674us total) trans 8589936474 rc 0/0 00000100:00100000:2.0:1746066749.097045:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16173 00000100:00100000:0.0:1746066749.098869:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.098992:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982989568 00000100:00100000:2.0:1746066749.098999:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982989568 00000100:00100000:2.0:1746066749.099044:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15389 00000100:00100000:2.0:1746066749.099051:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:309:x1830882982989568:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066749.099064:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.099075:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09f2 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.099097:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.099104:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.099105:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.099108:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 18 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.099134:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.099145:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.099156:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984355840:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.099254:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.102288:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984355840:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.102314:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 18 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.102327:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15400, rc 0) 00000100:00100000:2.0:1746066749.102373:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:309:x1830882982989568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3321us (3509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.102380:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15389 00000100:00100000:0.0:1746066749.102948:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.103035:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982989696 00000100:00100000:2.0:1746066749.103040:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982989696 00010000:00010000:2.0:1746066749.103099:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.103130:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6869 00000100:00100000:2.0:1746066749.103137:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982989696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066749.103148:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066749.103163:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746066749.103172:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746066749.103189:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a000/0xf1867c21abfa5ad5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09c8 expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:2.0:1746066749.103212:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.103214:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.103219:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.103226:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.103248:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.103257:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984355968:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066749.103312:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.105727:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.105754:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984355968:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066749.105771:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.105795:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982989824 00000100:00100000:3.0:1746066749.105800:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982989824 00000100:00100000:2.0:1746066749.105818:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982989696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2681us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.105826:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6869 00000100:00100000:3.0:1746066749.105829:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15390 00000100:00100000:3.0:1746066749.105834:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:309:x1830882982989824:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066749.105848:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.105861:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d09f9 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.105879:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.105989:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.105990:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.105994:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 16 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.106013:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.106024:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066749.106033:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984356096:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.106079:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.108426:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984356096:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.108452:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 16 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.108466:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848ba00, rc 0) 00000100:00100000:3.0:1746066749.108539:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:309:x1830882982989824:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2704us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.108546:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15390 00000100:00100000:0.0:1746066749.108832:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.108909:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982989952 00000100:00100000:3.0:1746066749.108914:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982989952 00010000:00010000:3.0:1746066749.108932:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066749.108963:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6870 00000100:00100000:3.0:1746066749.108969:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982989952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.108978:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.108993:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.109003:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.109021:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575a000/0xf1867c21abfa5adc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09cf expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.109041:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.109043:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.109048:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.109055:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.109287:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.109298:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984356224:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.109487:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.110930:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.110950:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984356224:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.111022:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066749.111039:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990080 00000100:00100000:2.0:1746066749.111045:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990080 00000100:00100000:3.0:1746066749.111067:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982989952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2097us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.111071:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15391 00000100:00100000:3.0:1746066749.111073:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6870 00000100:00100000:2.0:1746066749.111076:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:309:x1830882982990080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066749.111087:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.111099:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a00 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.111117:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.111129:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.111130:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.111133:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 16 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.111151:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.111161:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 16 pid: 3528 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.111168:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984356352:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.111216:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.112585:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984356352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.112602:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 16 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.112628:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14e00, rc 0) 00000100:00100000:2.0:1746066749.112651:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:309:x1830882982990080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1574us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.112657:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15391 00000100:00100000:0.0:1746066749.112844:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.112932:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990208 00000100:00100000:3.0:1746066749.112937:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990208 00010000:00010000:3.0:1746066749.112955:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 16 pid: 3528 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066749.112978:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6871 00000100:00100000:3.0:1746066749.112983:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882982990208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.112991:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.113006:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 16 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.113015:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 16 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.113030:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa5ae3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09d6 expref: 16 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.113047:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.113048:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.113053:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.113060:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.113153:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.113164:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984356480:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.113307:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.114427:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.114479:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984356480:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.114490:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066749.114568:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990336 00000100:00100000:2.0:1746066749.114572:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990336 00000100:00100000:2.0:1746066749.114599:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15392 00000100:00100000:2.0:1746066749.114604:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:309:x1830882982990336:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066749.114614:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.114634:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a07 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.114650:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.114656:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.114657:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.114660:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.114680:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.114690:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.114704:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984356608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.114763:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882982990208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1779us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.114769:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6871 00000100:00100000:2.0:1746066749.115311:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.117166:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984356608:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.117187:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.117199:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15e00, rc 0) 00000100:00100000:2.0:1746066749.117242:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:309:x1830882982990336:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2637us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.117248:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15392 00000100:00100000:0.0:1746066749.117534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.117683:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990464 00000100:00100000:3.0:1746066749.117688:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990464 00010000:00010000:3.0:1746066749.117708:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066749.117736:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6872 00000100:00100000:3.0:1746066749.117742:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982990464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.117753:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.117768:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.117777:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.117796:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa5aea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09dd expref: 18 pid: 3528 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.117819:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.117820:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.117826:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.117833:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.117854:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.117864:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984356736:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.117935:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.119468:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.119531:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984356736:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.119541:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.119561:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982990464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1819us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.119568:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6872 00000100:00100000:2.0:1746066749.119577:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990592 00000100:00100000:2.0:1746066749.119582:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990592 00000100:00100000:2.0:1746066749.119610:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15393 00000100:00100000:2.0:1746066749.119632:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:309:x1830882982990592:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066749.119644:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.119656:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a0e expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.119673:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.119679:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.119681:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.119684:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.119706:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.119716:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 18 pid: 12255 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.119725:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984356864:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.120156:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.121126:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984356864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.121143:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.121154:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15000, rc 0) 00000100:00100000:2.0:1746066749.121188:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:309:x1830882982990592:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1573us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.121193:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15393 00000100:00100000:1.0:1746066749.121474:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.121634:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990720 00000100:00100000:3.0:1746066749.121638:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990720 00010000:00010000:3.0:1746066749.121654:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 18 pid: 12255 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066749.121671:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6873 00000100:00100000:3.0:1746066749.121676:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882982990720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.121683:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.121696:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 18 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.121705:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 18 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.121720:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575b400/0xf1867c21abfa5af1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09e4 expref: 18 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.121730:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.121732:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.121736:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.121743:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.121761:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.121770:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984356992:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.121822:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.123174:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.123225:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984356992:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.123238:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066749.123317:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990848 00000100:00100000:2.0:1746066749.123322:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990848 00000100:00100000:2.0:1746066749.123349:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15394 00000100:00100000:2.0:1746066749.123354:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:309:x1830882982990848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066749.123367:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.123378:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a15 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.123398:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.123405:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.123406:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.123408:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 16 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.123425:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.123435:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.123444:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984357120:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.123447:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982990720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1770us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.123454:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6873 00000100:00100000:2.0:1746066749.123979:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.125319:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984357120:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.125336:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 16 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.125346:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14800, rc 0) 00000100:00100000:2.0:1746066749.125366:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:309:x1830882982990848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2012us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.125371:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15394 00000100:00100000:0.0:1746066749.126104:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.126169:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982990976 00000100:00100000:3.0:1746066749.126173:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982990976 00010000:00010000:3.0:1746066749.126193:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066749.126228:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6874 00000100:00100000:3.0:1746066749.126233:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982990976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.126255:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.126270:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.126280:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.126295:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b600/0xf1867c21abfa5af8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09eb expref: 16 pid: 12255 timeout: 817 lvb_type: 1 00010000:00010000:3.0:1746066749.126309:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.126311:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.126315:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.126322:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.126340:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 15 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.126348:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984357248:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.126400:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.127972:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984357248:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.127984:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.128016:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982990976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1781us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.128024:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6874 00000100:00100000:0.0:1746066749.128247:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.128283:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.128305:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.128359:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982991104 00000100:00100000:2.0:1746066749.128364:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982991104 00000100:00100000:2.0:1746066749.128388:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982991360 00000100:00100000:2.0:1746066749.128390:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982991360 00000100:00100000:2.0:1746066749.128412:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982991616 00000100:00100000:2.0:1746066749.128414:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982991616 00000100:00100000:2.0:1746066749.128427:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15395 00000100:00100000:2.0:1746066749.128432:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982991104:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746066749.128534:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15396 00002000:00010000:2.0:1746066749.128539:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746066749.128541:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982991360:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066749.128542:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.128544:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.128546:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066749 -> 1746066750 00002000:00010000:2.0:1746066749.128547:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:2.0:1746066749.128568:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982991104:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 135us (321us total) trans 21474841756 rc 0/0 00000100:00100000:2.0:1746066749.128572:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15395 00000100:00100000:2.0:1746066749.128582:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15397 00000100:00100000:2.0:1746066749.128586:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982991616:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066749.128598:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066749.128600:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066749.128602:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066748 -> 1746066749 00002000:00010000:1.0:1746066749.128604:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066749 -> 1746066750 00002000:00010000:1.0:1746066749.128606:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746066749.128631:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:2.0:1746066749.128633:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.128635:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066748 -> 1746066749 00002000:00010000:2.0:1746066749.128636:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066749 -> 1746066750 00000100:00100000:1.0:1746066749.128636:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982991360:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 95us (352us total) trans 17179874317 rc 0/0 00002000:00010000:2.0:1746066749.128638:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:1.0:1746066749.128640:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15396 00000100:00100000:2.0:1746066749.128650:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982991616:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 64us (345us total) trans 21474841757 rc 0/0 00000100:00100000:2.0:1746066749.128655:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15397 00000100:00100000:0.0:1746066749.129187:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.129200:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.129230:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.129239:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982991232 00000100:00100000:3.0:1746066749.129242:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982991232 00000100:00100000:3.0:1746066749.129261:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982991488 00000100:00100000:3.0:1746066749.129263:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982991488 00000100:00100000:3.0:1746066749.129271:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982991744 00000100:00100000:3.0:1746066749.129273:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982991744 00000100:00100000:3.0:1746066749.129291:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15398 00000100:00100000:3.0:1746066749.129297:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982991232:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746066749.129307:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15399 00000100:00100000:1.0:1746066749.129312:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982991488:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066749.129344:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066749.129344:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066749.129346:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066749.129346:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.129348:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066748 -> 1746066749 00002000:00010000:1.0:1746066749.129348:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066748 -> 1746066749 00002000:00010000:3.0:1746066749.129350:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066749 -> 1746066750 00002000:00010000:1.0:1746066749.129350:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066749 -> 1746066750 00002000:00010000:3.0:1746066749.129351:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746066749.129351:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066749.129370:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982991232:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 74us (184us total) trans 17179874318 rc 0/0 00000100:00100000:3.0:1746066749.129375:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15398 00000100:00100000:3.0:1746066749.129385:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15400 00000100:00100000:3.0:1746066749.129389:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982991744:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066749.129424:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066749.129426:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.129428:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066748 -> 1746066749 00002000:00010000:3.0:1746066749.129429:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066749 -> 1746066750 00002000:00010000:3.0:1746066749.129431:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746066749.129555:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882982991488:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 242us (353us total) trans 21474841758 rc 0/0 00000100:00100000:1.0:1746066749.129560:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15399 00000100:00100000:3.0:1746066749.129697:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982991744:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 306us (465us total) trans 17179874319 rc 0/0 00000100:00100000:3.0:1746066749.129702:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15400 00000100:00100000:0.0:1746066749.131723:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.131854:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982992000 00000100:00100000:1.0:1746066749.131860:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982992000 00000100:00100000:1.0:1746066749.131925:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5873 00000100:00100000:1.0:1746066749.131931:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:309:x1830882982992000:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:1.0:1746066749.131972:0:10554:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa5a81 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09b3 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.132006:0:10554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066749.132016:0:10554:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.132021:0:10554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066749.132044:0:10554:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.132054:0:10554:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 11 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.132065:0:10554:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882984357376:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066749.132361:0:10554:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.133186:0:10554:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:10554:1830882984357376:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066749.133200:0:10554:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000100:00100000:0.0:1746066749.133697:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.133775:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982992128 00000100:00100000:3.0:1746066749.133780:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982992128 00010000:00010000:3.0:1746066749.133800:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.133838:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6875 00000100:00100000:3.0:1746066749.133844:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882982992128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.133855:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.133859:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.133867:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.133880:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5ac0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09ba expref: 12 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.133932:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.133935:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066749.133942:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066749.133947:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 10554 initiator: MDT0 00010000:00010000:3.0:1746066749.133961:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.133985:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882982992128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 141us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.133991:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6875 00010000:00010000:1.0:1746066749.134149:0:10554:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066749.134155:0:10554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000040:00080000:1.0:1746066749.134425:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].572, 88 off58048 00000004:00080000:1.0:1746066749.134433:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717345549204ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.134533:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].512, 88 off52848 00000004:00080000:1.0:1746066749.134541:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717345657614ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066749.134664:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].513, 88 off52936 00000004:00080000:1.0:1746066749.134668:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717345784817ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066749.134679:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].573, 88 off58136 00000004:00080000:1.0:1746066749.134682:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717345798639ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.134690:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].574, 88 off58224 00000004:00080000:1.0:1746066749.134693:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717345809582ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.134938:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].514, 88 off53024 00000004:00080000:1.0:1746066749.134942:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717346059061ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066749.134963:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].515, 88 off53112 00000004:00080000:1.0:1746066749.134966:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717346082564ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066749.134978:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].516, 88 off53200 00000004:00080000:1.0:1746066749.134980:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717346097281ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066749.134989:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].575, 88 off58312 00000004:00080000:1.0:1746066749.134992:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717346108637ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.135133:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].517, 88 off53288 00000004:00080000:1.0:1746066749.135137:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717346253971ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066749.135159:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].576, 88 off58400 00000004:00080000:1.0:1746066749.135162:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717346278836ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.135180:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].518, 88 off53376 00000004:00080000:1.0:1746066749.135183:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717346299889ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066749.135193:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].577, 88 off58488 00000004:00080000:1.0:1746066749.135196:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717346312592ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.135203:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].578, 88 off58576 00000004:00080000:1.0:1746066749.135205:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717346322024ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.135214:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].579, 88 off58664 00000004:00080000:1.0:1746066749.135216:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717346332964ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.135224:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].580, 88 off58752 00000004:00080000:1.0:1746066749.135227:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717346343271ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066749.135235:0:10554:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].519, 88 off53464 00000004:00080000:1.0:1746066749.135238:0:10554:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717346354412ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066749.136313:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936475 is committed 00000004:00080000:3.0:1746066749.136319:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 510 committed 00000004:00080000:3.0:1746066749.136323:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 569 committed 00000004:00080000:3.0:1746066749.136334:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 568 committed 00000004:00080000:3.0:1746066749.136336:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 567 committed 00000004:00080000:3.0:1746066749.136337:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 566 committed 00000004:00080000:3.0:1746066749.136339:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 509 committed 00000004:00080000:3.0:1746066749.136340:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 565 committed 00000004:00080000:3.0:1746066749.136341:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 508 committed 00000004:00080000:3.0:1746066749.136343:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 564 committed 00000004:00080000:3.0:1746066749.136344:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 507 committed 00000004:00080000:3.0:1746066749.136346:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 506 committed 00000004:00080000:3.0:1746066749.136347:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 505 committed 00000004:00080000:3.0:1746066749.136348:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 563 committed 00000004:00080000:3.0:1746066749.136350:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 562 committed 00000004:00080000:3.0:1746066749.136351:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 504 committed 00000004:00080000:3.0:1746066749.136352:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 503 committed 00000004:00080000:3.0:1746066749.136353:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 561 committed 00000100:00100000:3.0:1746066749.136383:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984357632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.136425:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.136449:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984358144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.136460:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.136469:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746066749.136472:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984357504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.136482:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.136490:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984358016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.136500:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984357632 00000100:00100000:3.0:1746066749.136501:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066749.136505:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984357632 00000100:00100000:3.0:1746066749.136515:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984357760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.136526:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358144 00000100:00100000:0.0:1746066749.136528:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358144 00000100:00100000:3.0:1746066749.136529:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066749.136537:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984357504 00000100:00100000:3.0:1746066749.136538:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984358272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.136538:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984357504 00000100:00100000:3.0:1746066749.136549:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066749.136553:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358016 00000100:00100000:0.0:1746066749.136555:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358016 00000100:00100000:3.0:1746066749.136558:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746066749.136561:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984357888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.136564:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984357760 00000100:00100000:0.0:1746066749.136565:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984357760 00000100:00100000:0.0:1746066749.136572:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358272 00000100:00100000:3.0:1746066749.136574:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066749.136574:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358272 00000100:00100000:0.0:1746066749.136579:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984357888 00000100:00100000:3.0:1746066749.136580:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984358400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.136580:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984357888 00000100:00100000:0.0:1746066749.136587:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15401 00000100:00100000:3.0:1746066749.136591:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066749.136592:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3775:x1830882984357632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.136606:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358400 00000100:00100000:3.0:1746066749.136608:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358400 00000100:00100000:3.0:1746066749.136632:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15402 00000100:00100000:3.0:1746066749.136636:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3775:x1830882984358144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.136675:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15403 00000100:00100000:0.0:1746066749.136679:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3775:x1830882984357504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.136702:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3775:x1830882984358144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (240us total) trans 17179874321 rc 0/0 00000100:00100000:3.0:1746066749.136708:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15402 00002000:00010000:0.0:1746066749.136717:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746066749.136718:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15404 00002000:00010000:0.0:1746066749.136719:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:0.0:1746066749.136721:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00000100:00100000:3.0:1746066749.136722:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3775:x1830882984358016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066749.136723:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:0.0:1746066749.136725:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066749.136745:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3775:x1830882984357504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (262us total) trans 17179874322 rc 0/0 00000100:00100000:0.0:1746066749.136750:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15403 00002000:00010000:3.0:1746066749.136756:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00000100:00100000:0.0:1746066749.136758:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15405 00002000:00010000:3.0:1746066749.136759:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066749.136760:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746066749.136761:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882984357760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066749.136762:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066749.136764:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:3.0:1746066749.136789:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3775:x1830882984358016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (286us total) trans 17179874323 rc 0/0 00002000:00010000:0.0:1746066749.136792:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:3.0:1746066749.136793:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15404 00002000:00010000:0.0:1746066749.136794:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:0.0:1746066749.136796:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:0.0:1746066749.136798:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:0.0:1746066749.136800:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066749.136802:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15406 00000100:00100000:3.0:1746066749.136805:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882984358272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.136817:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882984357760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (288us total) trans 17179874324 rc 0/0 00000100:00100000:0.0:1746066749.136822:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15405 00000100:00100000:0.0:1746066749.136829:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15407 00000100:00100000:0.0:1746066749.136832:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882984357888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.136849:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882984358272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (299us total) trans 17179874325 rc 0/0 00000100:00100000:3.0:1746066749.136862:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15406 00002000:00010000:0.0:1746066749.136870:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066749.136872:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066749.136873:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:0.0:1746066749.136874:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066749.136876:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:0.0:1746066749.136914:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3776:x1830882984357888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (338us total) trans 17179874326 rc 0/0 00010000:00010000:2.0:1746066749.137068:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.137077:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.137082:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.137086:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066749.137090:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.137096:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.137108:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.137110:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066749.137114:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.137118:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b29 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066749.138665:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15407 00000100:00100000:0.0:1746066749.138677:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15408 00000100:00100000:0.0:1746066749.138683:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3776:x1830882984358400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.138865:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984358528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.138866:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984358912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.138905:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.138922:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984359424:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746066749.138926:0:10554:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009d8cb480 reply state ffff880130f54000 transno 8589936475 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10554 initiator: MDT0 00000100:00100000:3.0:1746066749.138935:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066749.138938:0:10554:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066749.138945:0:10554:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000100:00100000:3.0:1746066749.138946:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:1.0:1746066749.138947:0:10554:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066749.138950:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984358784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.138950:0:10554:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746066749.138954:0:10554:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.138957:0:10554:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:3.0:1746066749.138961:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066749.138961:0:10554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa5a81 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09b3 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.138968:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984359296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.138978:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066749.139004:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb7480/2, rc 0, transno 17179874326 00000100:00100000:3.0:1746066749.139009:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984357888:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066749.139014:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c7fd500/2, rc 0, transno 17179874327 00000100:00100000:3.0:1746066749.139017:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984358400:0@lo:2:osp-syn-1-0.0 00010000:00080000:1.0:1746066749.139017:0:10554:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:3.0:1746066749.139023:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb5f80/2, rc 0, transno 17179874324 00000100:00100000:3.0:1746066749.139025:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984357760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.139025:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:309:x1830882982992000:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 7094us (7307us total) trans 8589936475 rc 0/0 00000004:00080000:3.0:1746066749.139031:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb6300/2, rc 0, transno 17179874325 00000100:00100000:1.0:1746066749.139031:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5873 00000100:00100000:3.0:1746066749.139033:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984358272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.139043:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984358656:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746066749.139047:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066749.139052:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10554 initiator: MDT0 00000100:00100000:3.0:1746066749.139057:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066749.139057:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10554 initiator: MDT0 00010000:00010000:1.0:1746066749.139062:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a575a400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066749.139064:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10554 initiator: MDT0 00000100:00100000:3.0:1746066749.139066:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984359168:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746066749.139070:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10554 initiator: MDT0 00000100:00100000:3.0:1746066749.139075:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066749.139077:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.139079:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066749.139081:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10554 initiator: MDT0 00000004:00080000:3.0:1746066749.139084:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098483800/2, rc 0, transno 17179874322 00000100:00100000:3.0:1746066749.139086:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984357504:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746066749.139086:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a400/0xf1867c21abfa5b5a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10554 initiator: MDT0 00000004:00080000:3.0:1746066749.139092:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb4000/2, rc 0, transno 17179874323 00000100:00100000:3.0:1746066749.139095:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984358016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.139099:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358912 00000004:00080000:3.0:1746066749.139102:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb7800/2, rc 0, transno 17179874321 00000100:00100000:1.0:1746066749.139103:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358912 00000100:00100000:3.0:1746066749.139104:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984358144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.139114:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984359424 00000100:00100000:3.0:1746066749.139116:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984359424 00000100:00100000:1.0:1746066749.139116:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358784 00000100:00100000:1.0:1746066749.139117:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358784 00000100:00100000:1.0:1746066749.139121:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984359296 00000100:00100000:1.0:1746066749.139123:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984359296 00000100:00100000:3.0:1746066749.139125:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358656 00000100:00100000:3.0:1746066749.139126:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358656 00000100:00100000:1.0:1746066749.139128:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984359168 00000100:00100000:1.0:1746066749.139129:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984359168 00000100:00100000:3.0:1746066749.139133:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15409 00000100:00100000:3.0:1746066749.139136:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+46:3777:x1830882984358912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.139137:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15410 00000100:00100000:1.0:1746066749.139140:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3777:x1830882984358784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.139184:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15411 00000100:00100000:3.0:1746066749.139188:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984359424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066749.139192:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:1.0:1746066749.139194:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066749.139196:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066749.139197:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:1.0:1746066749.139199:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:1.0:1746066749.139228:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984358784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (266us total) trans 21474841760 rc 0/0 00000004:00080000:3.0:1746066749.139233:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78c700/2, rc 0, transno 21474841760 00000100:00100000:1.0:1746066749.139234:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15410 00000100:00100000:3.0:1746066749.139240:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984358784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.139242:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15412 00000100:00100000:1.0:1746066749.139246:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984359296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.139254:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066749.139263:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984359040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.139267:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066749.139272:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984359552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.139276:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.139286:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066749.139288:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984358528 00000100:00100000:1.0:1746066749.139290:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984358528 00000100:00100000:1.0:1746066749.139298:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984359040 00000100:00100000:1.0:1746066749.139299:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984359040 00000100:00100000:1.0:1746066749.139304:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984359552 00000100:00100000:1.0:1746066749.139306:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984359552 00000100:00100000:1.0:1746066749.139312:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15413 00000100:00100000:1.0:1746066749.139316:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3775:x1830882984358656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066749.139552:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3776:x1830882984358400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (2172us total) trans 17179874327 rc 0/0 00000100:00100000:0.0:1746066749.139558:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15408 00000100:00100000:0.0:1746066749.139569:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15414 00000100:00100000:0.0:1746066749.139574:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3775:x1830882984359168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066749.139598:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066749.139601:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:0.0:1746066749.139603:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:0.0:1746066749.139604:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:0.0:1746066749.139624:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066749.139937:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15415 00000100:00100000:2.0:1746066749.139942:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882984358528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066749.139952:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15416 00000100:00100000:2.0:1746066749.139955:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882984359040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066749.139962:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15417 00000100:00100000:2.0:1746066749.139965:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3775:x1830882984359552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066749.140585:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3775:x1830882984357632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3991us (4158us total) trans 17179874320 rc 0/0 00000100:00100000:0.0:1746066749.140590:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15401 00002000:00010000:3.0:1746066749.141083:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:3.0:1746066749.141085:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066749.141087:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066749.141088:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066749.141090:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066749.141314:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882984359424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2124us (2376us total) trans 21474841761 rc 0/0 00000100:00100000:3.0:1746066749.141319:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15411 00000004:00080000:0.0:1746066749.141329:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e420380/2, rc 0, transno 21474841761 00000100:00100000:0.0:1746066749.141333:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984359424:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066749.141350:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098480e00/2, rc 0, transno 17179874320 00000100:00100000:3.0:1746066749.141353:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984357632:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066749.141610:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:2.0:1746066749.141613:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.141629:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066749.141630:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.141632:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:2.0:1746066749.141672:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882984358912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2533us (2765us total) trans 21474841759 rc 0/0 00000100:00100000:2.0:1746066749.141678:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15409 00000004:00080000:0.0:1746066749.141738:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78f480/2, rc 0, transno 21474841759 00000100:00100000:0.0:1746066749.141742:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984358912:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066749.141772:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066749.141774:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066749.141776:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066749.141777:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066749.141779:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:1.0:1746066749.141799:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882984359296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2553us (2820us total) trans 21474841762 rc 0/0 00000100:00100000:1.0:1746066749.141804:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15412 00000004:00080000:0.0:1746066749.141810:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5c00/2, rc 0, transno 21474841762 00000100:00100000:0.0:1746066749.141812:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984359296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066749.141938:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3775:x1830882984359168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2363us (2860us total) trans 21474841763 rc 0/0 00000100:00100000:0.0:1746066749.141943:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15414 00002000:00010000:2.0:1746066749.142010:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066749.142013:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.142015:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.142016:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:2.0:1746066749.142018:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066749.142041:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3775:x1830882984358656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2723us (2982us total) trans 21474841764 rc 0/0 00000100:00100000:2.0:1746066749.142046:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15413 00000004:00080000:3.0:1746066749.142375:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78f800/2, rc 0, transno 21474841764 00000100:00100000:3.0:1746066749.142382:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984358656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066749.142388:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5f80/2, rc 0, transno 21474841763 00000100:00100000:3.0:1746066749.142390:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984359168:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066749.142450:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066749.142452:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.142454:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.142456:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:3.0:1746066749.142457:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:3.0:1746066749.142487:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984358528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2545us (3232us total) trans 21474841765 rc 0/0 00000100:00100000:3.0:1746066749.142492:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15415 00002000:00010000:2.0:1746066749.142583:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:2.0:1746066749.142586:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.142588:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066749.142589:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.142591:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:2.0:1746066749.142612:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984359040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2656us (3334us total) trans 21474841766 rc 0/0 00000100:00100000:2.0:1746066749.142630:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15416 00000100:00100000:3.0:1746066749.142874:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3775:x1830882984359552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2907us (3586us total) trans 21474841767 rc 0/0 00000100:00100000:3.0:1746066749.142879:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15417 00000004:00080000:1.0:1746066749.142907:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f78ea00/2, rc 0, transno 21474841765 00000100:00100000:1.0:1746066749.142910:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f78ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984358528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066749.142916:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5880/2, rc 0, transno 21474841766 00000100:00100000:1.0:1746066749.142919:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984359040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066749.143082:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.143140:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982992256 00000100:00100000:3.0:1746066749.143145:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982992256 00000100:00100000:3.0:1746066749.143171:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16174 00000100:00100000:3.0:1746066749.143176:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:309:x1830882982992256:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066749.143190:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.143201:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a1c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.143238:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.143251:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.143262:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.143265:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066749.143267:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895800, rc 0) 00000100:00100000:3.0:1746066749.143291:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:309:x1830882982992256:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 115us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.143295:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16174 00000004:00080000:2.0:1746066749.143380:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54d880/2, rc 0, transno 21474841767 00000100:00100000:2.0:1746066749.143384:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984359552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066749.146151:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.146431:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982992512 00000100:00100000:1.0:1746066749.146437:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982992512 00000100:00100000:1.0:1746066749.146479:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5874 00000100:00100000:1.0:1746066749.146485:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:309:x1830882982992512:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066749.146657:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:309:x1830882982992512:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 171us (511us total) trans 8589936476 rc 0/0 00000100:00100000:1.0:1746066749.146663:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5874 00000100:00100000:0.0:1746066749.161636:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.161697:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982992768 00000100:00100000:2.0:1746066749.161705:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982992768 00000100:00100000:2.0:1746066749.161753:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16175 00000100:00100000:2.0:1746066749.161761:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+7:323:x1830882982992768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.161779:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.161793:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa5b68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a23 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.161849:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.161860:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.161869:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.161880:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.161913:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.161918:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.161994:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162000:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162006:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066749.162012:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066749.162059:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162065:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162070:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162074:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162078:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066749.162081:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162086:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162094:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066749.162096:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066749.162100:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162105:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14600/0xf1867c21abfa5b6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162126:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162131:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162136:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162140:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629b200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066749.162142:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162146:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162152:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5e80200) 00010000:00010000:2.0:1746066749.162153:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066749.162155:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162159:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b200/0xf1867c21abfa5b76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.162186:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa5b68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.162195:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.162201:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.162203:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066749.162204:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a400, rc 0) 00000100:00100000:2.0:1746066749.162245:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:323:x1830882982992768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 484us (629us total) trans 8589936477 rc 0/0 00000100:00100000:2.0:1746066749.162250:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16175 00000100:00100000:0.0:1746066749.164648:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.164684:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.164697:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982993024 00000100:00100000:3.0:1746066749.164704:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982993024 00000100:00100000:3.0:1746066749.164752:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16176 00000100:00100000:3.0:1746066749.164758:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:319:x1830882982993024:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066749.164776:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.164787:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895400/0xf1867c21abfa5b8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a2a expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.164834:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164844:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164851:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164861:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164868:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164873:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164975:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164982:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.164987:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066749.164993:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066749.165042:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165047:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165052:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165057:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165061:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.165064:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165069:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165081:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066749.165083:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.165086:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165090:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa5b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165112:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165117:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165122:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165125:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.165127:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165131:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165136:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0f200) 00010000:00010000:3.0:1746066749.165138:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.165141:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165145:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894e00/0xf1867c21abfa5b99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.165172:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895400/0xf1867c21abfa5b8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.165183:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.165189:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.165191:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066749.165192:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894400, rc 0) 00000100:00100000:3.0:1746066749.165235:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:319:x1830882982993024:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 477us (593us total) trans 8589936478 rc 0/0 00000100:00100000:3.0:1746066749.165241:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16176 00000100:00100000:3.0:1746066749.165262:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982993152 00000100:00100000:3.0:1746066749.165265:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982993152 00000100:00100000:3.0:1746066749.165305:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15418 00000100:00100000:3.0:1746066749.165310:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:323:x1830882982993152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.165318:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.165328:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a31 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.165343:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 19 pid: 1893 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746066749.165345:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746066749.165349:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.165351:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.165353:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.165375:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 19 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.165384:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066749.165386:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 19 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.165396:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984359680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.165453:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.165493:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982993408 00000100:00100000:2.0:1746066749.165498:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982993408 00000100:00100000:2.0:1746066749.165519:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16177 00000100:00100000:2.0:1746066749.165524:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:318:x1830882982993408:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066749.165536:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.165543:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfa5bb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a38 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.165581:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.165607:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.165613:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.165639:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.165656:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.165664:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 27 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.165673:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984359808:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.165705:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.165712:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 10 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.165719:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984359936:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.165735:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.167187:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984359680:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.167208:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.167221:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:0.0:1746066749.167248:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.167260:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:323:x1830882982993152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1949us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.167266:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15418 00000100:00100000:2.0:1746066749.167334:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984359808:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.167342:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984359936:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.167359:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746066749.167530:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982993536 00000100:00100000:1.0:1746066749.167535:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982993536 00010000:00010000:1.0:1746066749.167553:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 20 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746066749.167696:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.167959:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982993664 00000100:00100000:1.0:1746066749.168042:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982993664 00010000:00010000:1.0:1746066749.168055:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.168076:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6876 00000100:00100000:1.0:1746066749.168082:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882982993536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.168090:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.168103:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 20 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.168111:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 20 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.168124:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5b30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f2 expref: 20 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.168135:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.168137:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.168142:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.168149:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.168167:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 19 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.168176:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984360064:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066749.168228:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6877 00000100:00100000:2.0:1746066749.168233:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982993664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066749.168240:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066749.168244:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.168251:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.168260:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a400/0xf1867c21abfa5b7d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a23 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.168267:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.168271:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.168277:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.168281:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.168497:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.168522:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982993664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 288us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.168531:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6877 00000100:00100000:0.0:1746066749.168563:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.168649:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982993792 00000100:00100000:2.0:1746066749.168653:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982993792 00010000:00010000:2.0:1746066749.168664:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 28 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.168690:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6878 00000100:00100000:2.0:1746066749.168695:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882982993792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066749.168702:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066749.168705:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 28 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.168712:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 28 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.168722:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa5ba0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a2a expref: 28 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.168729:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.168732:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.168737:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.168741:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.168752:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066749.168760:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.168768:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066749.168782:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066749.168865:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a800/0xf1867c21abfa5bb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.168878:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882982993792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 182us (314us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066749.168905:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.168910:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066749.168911:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066749.168912:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629aa00, rc 0) 00000100:00100000:0.0:1746066749.168931:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:318:x1830882982993408:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3406us (3548us total) trans 8589936479 rc 0/0 00000100:00100000:0.0:1746066749.168936:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16177 00000100:00100000:2.0:1746066749.169032:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6878 00000100:00100000:0.0:1746066749.169698:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.169760:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982994048 00000100:00100000:2.0:1746066749.169764:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982994048 00000100:00100000:2.0:1746066749.169802:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16178 00000100:00100000:2.0:1746066749.169817:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:324:x1830882982994048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.169831:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.169840:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfa5bca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a3f expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.169898:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.169906:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.169913:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.169924:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.169929:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.169934:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.169995:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa5bdf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170002:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa5bdf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170008:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa5bdf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066749.170014:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066749.170045:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170050:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170055:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170061:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170065:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066749.170069:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170074:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170080:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066749.170082:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066749.170085:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170090:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a000/0xf1867c21abfa5bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170098:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170106:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170109:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170112:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066749.170114:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170118:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170122:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5e80900) 00010000:00010000:2.0:1746066749.170124:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066749.170125:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170129:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa5bd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.170149:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfa5bca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a3f expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.170156:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa5bdf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a3f expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.170160:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.170162:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066749.170163:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629be00, rc 0) 00000100:00100000:2.0:1746066749.170196:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:324:x1830882982994048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 380us (498us total) trans 8589936480 rc 0/0 00000100:00100000:2.0:1746066749.170201:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16178 00000100:00100000:0.0:1746066749.171685:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.171740:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982994176 00000100:00100000:2.0:1746066749.171745:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982994176 00000100:00100000:2.0:1746066749.171783:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16179 00000100:00100000:2.0:1746066749.171788:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:323:x1830882982994176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.171801:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.171811:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a46 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.171841:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.171851:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.171864:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.171866:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066749.171868:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d800, rc 0) 00000100:00100000:1.0:1746066749.171921:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984360064:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.171936:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066749.172581:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:323:x1830882982994176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 788us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.172588:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16179 00000100:00100000:0.0:1746066749.173342:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.173404:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982994304 00000100:00100000:3.0:1746066749.173409:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982994304 00000100:00100000:1.0:1746066749.173914:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982993536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5830us (6665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.173923:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6876 00000100:00100000:3.0:1746066749.173993:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15419 00000100:00100000:3.0:1746066749.174000:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:324:x1830882982994304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.174012:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.174025:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a4d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.174044:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.174046:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.174065:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.174081:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.174089:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894600, rc 0) 00000100:00100000:3.0:1746066749.174110:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:324:x1830882982994304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 111us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.174115:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15419 00000100:00080000:0.0:1746066749.174155:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066749.179000:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.179739:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.179803:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982994560 00000100:00100000:2.0:1746066749.179810:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982994560 00000100:00100000:1.0:1746066749.179815:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982994816 00000100:00100000:1.0:1746066749.179818:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982994816 00002000:00100000:2.0:1746066749.179846:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d0fb80 x1830882982994560/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.179846:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d0f800 x1830882982994816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.179856:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0fb80 with x1830882982994560 ext(0->1048575) 00002000:00100000:1.0:1746066749.179856:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0f800 with x1830882982994816 ext(0->1048575) 00002000:00010000:2.0:1746066749.179860:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0fb80 00002000:00010000:1.0:1746066749.179860:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0f800 00000100:00100000:1.0:1746066749.180918:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3955 00000100:00100000:3.0:1746066749.180923:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3956 00000100:00100000:1.0:1746066749.180925:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982994560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.180929:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982994816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066749.190634:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.190831:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882982994560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9906us (11839us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066749.190841:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3955 00002000:00100000:1.0:1746066749.190850:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d0fb80 x1830882982994560/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.190859:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0fb80 with x1830882982994560 ext(0->1048575) 00000100:00100000:2.0:1746066749.190860:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995072 00002000:00010000:1.0:1746066749.190864:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0fb80 00000100:00100000:2.0:1746066749.190866:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995072 00000100:00100000:2.0:1746066749.190914:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16180 00000100:00100000:2.0:1746066749.190921:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:319:x1830882982995072:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066749.191006:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882982994816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10076us (11269us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066749.191013:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3956 00002000:00100000:3.0:1746066749.191018:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d0f800 x1830882982994816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.191025:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d0f800 with x1830882982994816 ext(0->1048575) 00002000:00010000:3.0:1746066749.191028:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d0f800 00010000:00010000:2.0:1746066749.191232:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.191235:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066749.191255:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa5bdf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a3f expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.191271:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.191275:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066749.191284:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfa5bfb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a54 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.191322:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.191332:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.191338:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.191344:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.191365:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.191375:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 10 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.191386:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984360192:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.191453:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.191461:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 8 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.191468:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984360320:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.191485:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.193699:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984360192:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.193708:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984360320:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.193729:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066749.196680:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.196727:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.196754:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995200 00000100:00100000:1.0:1746066749.196762:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995200 00000100:00100000:3.0:1746066749.196792:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995328 00010000:00010000:1.0:1746066749.196792:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.196796:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995328 00010000:00010000:3.0:1746066749.196809:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 9 pid: 17253 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.196828:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6879 00000100:00100000:1.0:1746066749.196835:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882982995200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066749.196845:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6880 00010000:00010000:1.0:1746066749.196846:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066749.196850:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882982995328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.196851:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.196857:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.196860:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 9 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.196861:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.196868:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 9 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.196907:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d800/0xf1867c21abfa5bed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a46 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.196911:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa5b61 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a1c expref: 9 pid: 17253 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.196922:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.196926:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.196934:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.196939:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.197042:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.197045:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.197153:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882982995328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 301us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.197160:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6880 00010000:00010000:1.0:1746066749.197297:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.197315:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982995200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 480us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.197323:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6879 00010000:00010000:2.0:1746066749.197346:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066749.197352:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:02000000:2.0:1746066749.197393:0:7243:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:0.0:1746066749.200460:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.200534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.201349:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995456 00000100:00100000:3.0:1746066749.201357:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995456 00000100:00100000:3.0:1746066749.201408:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995584 00000100:00100000:3.0:1746066749.201411:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995584 00000100:00080000:0.0:1746066749.201573:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066749.201652:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15420 00000100:00100000:3.0:1746066749.201660:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+9:323:x1830882982995456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.201675:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.201688:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a5b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.201712:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.201783:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.201785:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.201789:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.203998:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 17 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.204014:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 17 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.204038:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984360448:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.204135:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.204171:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15421 00000100:00100000:3.0:1746066749.204178:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:324:x1830882982995584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.204187:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.204195:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a62 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.204209:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.204211:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.204218:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.204226:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895000, rc 0) 00000100:00100000:3.0:1746066749.204241:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:324:x1830882982995584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 66us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.204245:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15421 00000100:00100000:3.0:1746066749.206119:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984360448:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.206144:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.206157:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894800, rc 0) 00000100:00100000:3.0:1746066749.206199:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:323:x1830882982995456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4539us (5745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.206205:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15420 00000100:00100000:0.0:1746066749.206338:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.206374:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995712 00000100:00100000:1.0:1746066749.206380:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995712 00010000:00010000:1.0:1746066749.206398:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 18 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.206426:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6881 00000100:00100000:1.0:1746066749.206431:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982995712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.206440:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.206452:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 18 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.206462:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 18 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.206477:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa5b37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d09f9 expref: 18 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.206485:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.206487:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.206491:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.206498:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.206503:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.206504:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.206508:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 24 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.206513:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 24 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.206532:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 24 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.206539:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984360576:192.168.204.16@tcp:105: 00000040:00080000:2.0:1746066749.207515:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].581, 88 off58840 00000004:00080000:2.0:1746066749.207521:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717418637304ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.207543:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].520, 88 off53552 00000004:00080000:2.0:1746066749.207546:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717418662324ns, next at 665959948938ns, rc = 0 00010000:00010000:1.0:1746066749.207551:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746066749.207556:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].521, 88 off53640 00000004:00080000:2.0:1746066749.207559:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717418675214ns, next at 665959948938ns, rc = 0 00000100:00100000:1.0:1746066749.207561:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984360704:192.168.204.16@tcp:105: 00000040:00080000:2.0:1746066749.207566:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].582, 88 off58928 00000004:00080000:2.0:1746066749.207569:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717418685599ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.207575:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].583, 88 off59016 00000004:00080000:2.0:1746066749.207577:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717418694121ns, next at 665943319442ns, rc = 0 00000100:00100000:1.0:1746066749.207583:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000040:00080000:2.0:1746066749.207584:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].522, 88 off53728 00000004:00080000:2.0:1746066749.207586:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717418703136ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066749.207593:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].523, 88 off53816 00000004:00080000:2.0:1746066749.207595:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717418711466ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066749.207601:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].524, 88 off53904 00000004:00080000:2.0:1746066749.207603:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717418719657ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066749.207609:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].584, 88 off59104 00000004:00080000:2.0:1746066749.207611:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717418728119ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.209011:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].525, 88 off53992 00000004:00080000:2.0:1746066749.209019:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717420135557ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066749.209037:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].585, 88 off59192 00000004:00080000:2.0:1746066749.209039:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717420156164ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.209048:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].526, 88 off54080 00000004:00080000:2.0:1746066749.209050:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717420166434ns, next at 665959948938ns, rc = 0 00000040:00080000:2.0:1746066749.209057:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].586, 88 off59280 00000004:00080000:2.0:1746066749.209059:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717420175871ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.209066:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].587, 88 off59368 00000004:00080000:2.0:1746066749.209069:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717420185354ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.209076:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].588, 88 off59456 00000004:00080000:2.0:1746066749.209078:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717420194891ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.209085:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].589, 88 off59544 00000004:00080000:2.0:1746066749.209087:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717420203716ns, next at 665943319442ns, rc = 0 00000040:00080000:2.0:1746066749.209094:0:7243:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].527, 88 off54168 00000004:00080000:2.0:1746066749.209097:0:7243:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717420213776ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066749.213077:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936481 is committed 00000004:00080000:3.0:1746066749.213086:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 518 committed 00000004:00080000:3.0:1746066749.213100:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 578 committed 00000004:00080000:3.0:1746066749.213112:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 577 committed 00000004:00080000:3.0:1746066749.213113:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 576 committed 00000004:00080000:3.0:1746066749.213115:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 575 committed 00000004:00080000:3.0:1746066749.213117:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 517 committed 00000004:00080000:3.0:1746066749.213118:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 574 committed 00000004:00080000:3.0:1746066749.213120:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 516 committed 00000004:00080000:3.0:1746066749.213121:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 573 committed 00000004:00080000:3.0:1746066749.213122:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 515 committed 00000004:00080000:3.0:1746066749.213123:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 514 committed 00000004:00080000:3.0:1746066749.213125:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 513 committed 00000004:00080000:3.0:1746066749.213126:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 572 committed 00000004:00080000:3.0:1746066749.213128:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 571 committed 00000004:00080000:3.0:1746066749.213130:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 512 committed 00000004:00080000:3.0:1746066749.213131:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 511 committed 00000004:00080000:3.0:1746066749.213132:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 570 committed 00000001:00080000:3.0:1746066749.213138:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936479 is committed 00000001:00080000:3.0:1746066749.213145:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936476 is committed 00000100:00100000:1.0:1746066749.213206:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066749.213223:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.213249:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984361216:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066749.213270:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.213270:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066749.213281:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.213283:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1746066749.213292:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984360832:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066749.213295:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326d600/0xf1867c21abfa5bfb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 28 pid: 7243 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746066749.213295:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066749.213307:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066749.213308:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066749.213314:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984361600:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.213319:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066749.213331:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066749.213332:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066749.213334:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746066749.213336:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c400, rc 0) 00000100:00100000:1.0:1746066749.213352:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361088 00000100:00100000:0.0:1746066749.213355:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984362112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.213357:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361088 00000100:00100000:1.0:1746066749.213365:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066749.213374:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:319:x1830882982995072:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 22453us (22760us total) trans 8589936481 rc 0/0 00000100:00100000:0.0:1746066749.213377:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361216 00000100:00100000:0.0:1746066749.213380:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361216 00000100:00100000:1.0:1746066749.213381:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066749.213382:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16180 00000100:00100000:1.0:1746066749.213396:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066749.213414:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984360832 00000100:00100000:0.0:1746066749.213417:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984360832 00000100:00100000:1.0:1746066749.213419:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.213438:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.213663:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984360960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.213683:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.214291:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984361472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.214304:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.214311:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984361984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.214321:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.214326:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984362496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.214337:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066749.214352:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361600 00000100:00100000:3.0:1746066749.214355:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361600 00000100:00100000:3.0:1746066749.214366:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361728 00000100:00100000:3.0:1746066749.214368:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361728 00000100:00100000:3.0:1746066749.214374:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984362240 00000100:00100000:3.0:1746066749.214375:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984362240 00000100:00100000:3.0:1746066749.214381:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984362752 00000100:00100000:3.0:1746066749.214382:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984362752 00000100:00100000:3.0:1746066749.214387:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984360960 00000100:00100000:3.0:1746066749.214389:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984360960 00000100:00100000:3.0:1746066749.214394:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361472 00000100:00100000:3.0:1746066749.214395:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361472 00000100:00100000:3.0:1746066749.214400:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361984 00000100:00100000:3.0:1746066749.214401:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361984 00000100:00100000:3.0:1746066749.214406:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984362496 00000100:00100000:3.0:1746066749.214407:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984362496 00000100:00100000:3.0:1746066749.214415:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15422 00000100:00100000:3.0:1746066749.214420:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3777:x1830882984361216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066749.214431:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15423 00000100:00100000:2.0:1746066749.214438:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3774:x1830882984360832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066749.214496:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15424 00000100:00100000:2.0:1746066749.214501:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984361600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066749.214561:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066749.214564:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.214565:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.214567:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:2.0:1746066749.214569:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066749.214591:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984361600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1259us total) trans 17179874328 rc 0/0 00000100:00100000:2.0:1746066749.214596:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15424 00000100:00100000:2.0:1746066749.214608:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15425 00000100:00100000:2.0:1746066749.214612:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882984361728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.214665:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1746066749.214670:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.214692:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066749.214699:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361856:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.214710:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066749.214714:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.214724:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066749.214740:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361344 00000100:00100000:1.0:1746066749.214743:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361344 00000100:00100000:1.0:1746066749.214754:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984361856 00000100:00100000:1.0:1746066749.214756:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984361856 00000100:00100000:1.0:1746066749.214761:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984362368 00000100:00100000:1.0:1746066749.214763:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984362368 00000100:00100000:1.0:1746066749.214769:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15426 00000100:00100000:1.0:1746066749.214773:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882984362240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066749.214958:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:3.0:1746066749.214962:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.214963:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.214965:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:3.0:1746066749.214967:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:2.0:1746066749.214976:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3774:x1830882984361728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 363us (1609us total) trans 21474841770 rc 0/0 00000100:00100000:2.0:1746066749.214980:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15425 00000100:00100000:3.0:1746066749.214985:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3777:x1830882984361216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 565us (1690us total) trans 21474841768 rc 0/0 00000100:00100000:3.0:1746066749.214990:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15422 00000100:00100000:2.0:1746066749.214993:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15427 00000100:00100000:2.0:1746066749.214997:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984362752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066749.215000:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15428 00000100:00100000:3.0:1746066749.215004:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3776:x1830882984360960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066749.215037:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066749.215039:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.215040:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:3.0:1746066749.215042:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:3.0:1746066749.215043:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066749.215049:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882984362752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (1611us total) trans 17179874329 rc 0/0 00000100:00100000:2.0:1746066749.215053:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15427 00000100:00100000:3.0:1746066749.215059:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882984360960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (1375us total) trans 21474841772 rc 0/0 00000100:00100000:2.0:1746066749.215062:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15429 00000100:00100000:3.0:1746066749.215064:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15428 00000100:00100000:2.0:1746066749.215066:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882984361472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066749.215072:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15430 00000100:00100000:3.0:1746066749.215076:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3776:x1830882984361984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066749.215101:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:2.0:1746066749.215103:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066749.215104:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066749.215105:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066749.215106:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066749.215107:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066749.215107:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066749.215109:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066749.215109:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00002000:00010000:3.0:1746066749.215111:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:3.0:1746066749.215125:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882984361984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (803us total) trans 21474841774 rc 0/0 00000100:00100000:2.0:1746066749.215125:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3776:x1830882984361472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (820us total) trans 21474841773 rc 0/0 00000100:00100000:0.0:1746066749.215132:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15431 00000100:00100000:2.0:1746066749.215136:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15429 00000100:00100000:0.0:1746066749.215139:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3776:x1830882984362496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066749.215145:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15432 00000100:00100000:2.0:1746066749.215149:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882984361344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066749.215176:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:2.0:1746066749.215178:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.215179:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066749.215181:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.215183:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:2.0:1746066749.215195:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3774:x1830882984361344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (502us total) trans 21474841775 rc 0/0 00000100:00100000:2.0:1746066749.215199:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15432 00000100:00100000:2.0:1746066749.215207:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15433 00000100:00100000:2.0:1746066749.215211:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984361856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066749.215237:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066749.215239:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.215241:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.215242:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:2.0:1746066749.215244:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066749.215256:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882984361856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (545us total) trans 17179874330 rc 0/0 00000100:00100000:2.0:1746066749.215260:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15433 00000100:00100000:0.0:1746066749.215289:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3776:x1830882984362496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (951us total) trans 17179874331 rc 0/0 00000100:00100000:0.0:1746066749.215295:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15431 00000100:00100000:0.0:1746066749.215317:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15434 00000100:00100000:0.0:1746066749.215321:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984362368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066749.215367:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066749.215369:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066749.215371:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066749.215373:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066749.215375:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066749.215392:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882984362368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (667us total) trans 17179874332 rc 0/0 00000100:00100000:0.0:1746066749.215397:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15434 00000100:00100000:0.0:1746066749.215413:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066749.215425:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984362624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.215441:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066749.215461:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb74380/2, rc 0, transno 21474841768 00000100:00100000:0.0:1746066749.215473:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984361216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066749.215481:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984362112 00000004:00080000:0.0:1746066749.215481:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b7480/2, rc 0, transno 17179874328 00000100:00100000:2.0:1746066749.215484:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984362112 00000100:00100000:0.0:1746066749.215484:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984361600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.215494:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984362624 00000100:00100000:0.0:1746066749.215496:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984362624 00000100:00100000:0.0:1746066749.215507:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15435 00000100:00100000:0.0:1746066749.215510:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3777:x1830882984362624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066749.215523:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066749.215525:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.215527:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:2.0:1746066749.215529:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:2.0:1746066749.215531:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00002000:00010000:1.0:1746066749.215942:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:1.0:1746066749.215944:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066749.215946:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066749.215948:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066749.215950:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066749.216735:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15430 00000100:00100000:2.0:1746066749.216944:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3774:x1830882984360832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2505us (3634us total) trans 21474841769 rc 0/0 00000100:00100000:0.0:1746066749.216946:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984362624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1433us (1502us total) trans 17179874333 rc 0/0 00000100:00100000:2.0:1746066749.216951:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15423 00000100:00100000:0.0:1746066749.216954:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15435 00000100:00100000:1.0:1746066749.216975:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f78ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882984362240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2167us (3543us total) trans 21474841771 rc 0/0 00000004:00080000:0.0:1746066749.216975:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ac9180/2, rc 0, transno 17179874333 00000100:00100000:0.0:1746066749.216978:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984362624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.216981:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15426 00000100:00100000:2.0:1746066749.216985:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15436 00000100:00100000:2.0:1746066749.216990:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3777:x1830882984362112:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066749.217004:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb74a80/2, rc 0, transno 21474841775 00000100:00100000:1.0:1746066749.217007:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066749.217015:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b6d80/2, rc 0, transno 17179874330 00000100:00100000:1.0:1746066749.217017:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066749.217023:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ac9c00/2, rc 0, transno 17179874332 00000100:00100000:1.0:1746066749.217026:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362368:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066749.217031:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb75880/2, rc 0, transno 21474841770 00000100:00100000:1.0:1746066749.217033:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361728:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066749.217038:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d4380/2, rc 0, transno 21474841771 00000100:00100000:1.0:1746066749.217040:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362240:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066749.217041:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066749.217043:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066749.217045:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00000004:00080000:1.0:1746066749.217045:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093acb100/2, rc 0, transno 17179874329 00002000:00010000:2.0:1746066749.217047:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00000100:00100000:1.0:1746066749.217047:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362752:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066749.217048:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000004:00080000:1.0:1746066749.217052:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb75500/2, rc 0, transno 21474841769 00000100:00100000:1.0:1746066749.217054:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984360832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.217058:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746066749.217063:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066749.217075:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984362112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (1661us total) trans 17179874334 rc 0/0 00000100:00100000:2.0:1746066749.217078:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15436 00000100:00100000:1.0:1746066749.217081:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066749.217087:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984362880 00000100:00100000:2.0:1746066749.217090:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984362880 00000004:00080000:0.0:1746066749.217095:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b6300/2, rc 0, transno 17179874334 00000100:00100000:2.0:1746066749.217099:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15437 00000100:00100000:0.0:1746066749.217099:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984362112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066749.217101:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882984362880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066749.217109:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15438 00000100:00100000:1.0:1746066749.217113:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3774:x1830882984361088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066749.217135:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.217145:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3774:x1830882984362880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (64us total) trans 21474841776 rc 0/0 00000100:00100000:2.0:1746066749.217148:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15437 00002000:00010000:1.0:1746066749.217153:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066749.217155:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066749 -> 1746066749 00000100:00100000:0.0:1746066749.217156:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066749.217157:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066749 -> 1746066749 00002000:00010000:1.0:1746066749.217159:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066750 -> 1746066750 00002000:00010000:1.0:1746066749.217160:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000004:00080000:2.0:1746066749.217162:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d4a80/2, rc 0, transno 21474841776 00000100:00100000:2.0:1746066749.217165:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984362880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066749.217169:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995968 00000100:00100000:0.0:1746066749.217172:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995968 00000004:00080000:2.0:1746066749.217189:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d0d500/2, rc 0, transno 17179874335 00000100:00100000:2.0:1746066749.217191:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984361088:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066749.217317:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb76d80/2, rc 0, transno 21474841772 00000100:00100000:3.0:1746066749.217322:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984360960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066749.217332:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb77b80/2, rc 0, transno 21474841773 00000100:00100000:3.0:1746066749.217334:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984361472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066749.217339:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb76300/2, rc 0, transno 21474841774 00000100:00100000:3.0:1746066749.217341:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984361984:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066749.217348:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093acb800/2, rc 0, transno 17179874331 00000100:00100000:3.0:1746066749.217350:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984362496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066749.217458:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3774:x1830882984361088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (4187us total) trans 17179874335 rc 0/0 00000100:00100000:1.0:1746066749.217463:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15438 00000100:00100000:1.0:1746066749.217546:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098927480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984360576:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.217553:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098924380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984360704:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.217564:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.217695:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982995712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11262us (11355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.217702:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6881 00000100:00100000:1.0:1746066749.217720:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982995840 00000100:00100000:1.0:1746066749.217723:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982995840 00000100:00100000:0.0:1746066749.217927:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16181 00000100:00100000:0.0:1746066749.217933:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:323:x1830882982995840:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066749.217935:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16182 00000100:00100000:1.0:1746066749.217942:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:324:x1830882982995968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066749.217943:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.217950:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066749.217956:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a70 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.217957:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfa5c1e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a69 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.217992:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.218151:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfa5c1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a69 expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.218160:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfa5c1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a69 expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.218161:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.218174:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.218176:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066749.218179:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944e00, rc 0) 00010000:00010000:0.0:1746066749.218179:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066749.218182:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066749.218184:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47a00, rc 0) 00000100:00100000:1.0:1746066749.218207:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:324:x1830882982995968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 266us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066749.218208:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:323:x1830882982995840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 275us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.218212:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16182 00000100:00100000:0.0:1746066749.218216:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16181 00000100:00100000:0.0:1746066749.219639:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.220091:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982996096 00000100:00100000:1.0:1746066749.220096:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982996096 00000100:00100000:1.0:1746066749.220132:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 775 00000100:00100000:1.0:1746066749.220137:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982996096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.220145:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.220157:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944e00/0xf1867c21abfa5c1e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a69 expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.220171:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.220174:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.220194:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882982996096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.220719:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 775 00000100:00100000:0.0:1746066749.225515:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.225552:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.225841:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982996480 00000100:00100000:3.0:1746066749.225849:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982996480 00002000:00100000:3.0:1746066749.225900:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095cedf80 x1830882982996480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.225909:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cedf80 with x1830882982996480 ext(1048576->2097151) 00002000:00010000:3.0:1746066749.225914:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cedf80 00000100:00100000:0.0:1746066749.225984:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.226027:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982996352 00000100:00100000:1.0:1746066749.226031:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982996352 00000100:00100000:1.0:1746066749.226053:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15439 00000100:00100000:1.0:1746066749.226068:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:319:x1830882982996352:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066749.226079:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.226094:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a77 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.226116:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 16 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.226123:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066749.226125:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066749.226128:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2400256->2826239] (req 2400256->2826239) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.226151:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 16 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.226161:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 16 pid: 13363 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.226171:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984363008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.226360:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982996736 00000100:00100000:3.0:1746066749.226363:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982996736 00002000:00100000:3.0:1746066749.226377:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095cece00 x1830882982996736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.226384:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cece00 with x1830882982996736 ext(1048576->2097151) 00002000:00010000:3.0:1746066749.226387:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cece00 00000100:00100000:3.0:1746066749.226398:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3957 00000100:00100000:3.0:1746066749.226403:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982996480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066749.226995:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.227016:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3958 00000100:00100000:1.0:1746066749.227023:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982996736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066749.243170:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984363008:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066749.243213:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2400256->2826239] (req 2400256->2826239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.243228:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945c00, rc 0) 00000100:00100000:3.0:1746066749.243381:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882982996480:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 16975us (17870us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066749.243390:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3957 00002000:00100000:3.0:1746066749.243399:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095cedf80 x1830882982996480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.243407:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cedf80 with x1830882982996480 ext(1048576->2097151) 00002000:00010000:3.0:1746066749.243411:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cedf80 00000100:00100000:1.0:1746066749.243506:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:319:x1830882982996352:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 17436us (17951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.243513:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15439 00000100:00100000:0.0:1746066749.249569:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.249710:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982996864 00000100:00100000:1.0:1746066749.249717:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982996864 00010000:00010000:1.0:1746066749.249755:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 17 pid: 13363 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.249764:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882982996736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22739us (23777us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.249773:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3958 00002000:00100000:2.0:1746066749.249782:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095cece00 x1830882982996736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.249790:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cece00 with x1830882982996736 ext(1048576->2097151) 00002000:00010000:2.0:1746066749.249794:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cece00 00000100:00100000:1.0:1746066749.249798:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6882 00000100:00100000:1.0:1746066749.249804:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882982996864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.249816:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.249831:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 17 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.249841:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 17 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.249863:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14800/0xf1867c21abfa5b53 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a15 expref: 17 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.249916:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.249918:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.249927:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.249935:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.249961:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.249972:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984363136:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.250021:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.251321:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984363136:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.251337:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.251495:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882982996864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1690us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.251503:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6882 00000100:00100000:0.0:1746066749.252249:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.252413:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982997120 00000100:00100000:2.0:1746066749.252419:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982997120 00002000:00100000:2.0:1746066749.252458:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2400256->2404351) req@ffff880098fbca80 x1830882982997120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.252466:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882982997120 ext(2400256->2404351) 00002000:00010000:2.0:1746066749.252470:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:2.0:1746066749.252498:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3959 00000100:00100000:2.0:1746066749.252505:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982997120:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066749.252602:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882982997120:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 97us (354us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066749.252607:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3959 00002000:00100000:2.0:1746066749.252612:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2400256->2404351) req@ffff880098fbca80 x1830882982997120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.252630:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882982997120 ext(2400256->2404351) 00002000:00010000:2.0:1746066749.252632:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:0.0:1746066749.257242:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.257328:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.257711:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982997248 00000100:00100000:2.0:1746066749.257719:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982997248 00000100:00100000:2.0:1746066749.257767:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982997376 00000100:00100000:2.0:1746066749.257769:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982997376 00000100:00100000:2.0:1746066749.257788:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15440 00000100:00100000:2.0:1746066749.257795:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:318:x1830882982997248:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066749.257811:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.257826:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a7e expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.257850:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.257857:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.257858:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.257861:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.257916:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.257927:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 18 pid: 13363 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.257933:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15441 00000100:00100000:2.0:1746066749.257939:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984363264:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.257940:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:324:x1830882982997376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.257947:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.257955:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a85 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.257967:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.257971:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.257972:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.257973:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.257984:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 15 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.257992:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 15 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.257997:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984363392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.257997:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.258015:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.261021:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.261182:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982997632 00000100:00100000:2.0:1746066749.261189:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982997632 00002000:00100000:2.0:1746066749.261224:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2822144->2826239) req@ffff880098fbd180 x1830882982997632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.261233:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882982997632 ext(2822144->2826239) 00002000:00010000:2.0:1746066749.261238:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:2.0:1746066749.261254:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3960 00000100:00100000:2.0:1746066749.261260:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982997632:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066749.261410:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984363264:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.261435:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2465792->3145727] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.261449:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894000, rc 0) 00000100:00100000:3.0:1746066749.261481:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+21:318:x1830882982997248:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3687us (4247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.261487:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15440 00000100:00100000:1.0:1746066749.262293:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.262312:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982997760 00000100:00100000:1.0:1746066749.262315:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982997760 00010000:00010000:1.0:1746066749.262331:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 19 pid: 13363 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.262362:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6883 00000100:00100000:1.0:1746066749.262368:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882982997760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.262376:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.262390:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 19 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.262398:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 19 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.262416:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15000/0xf1867c21abfa5b4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a0e expref: 19 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.262437:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.262439:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.262445:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.262457:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.262483:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.262493:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984363520:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.262539:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.262660:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882982997632:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1399us (1646us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066749.262666:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3960 00002000:00100000:2.0:1746066749.262671:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2822144->2826239) req@ffff880098fbd180 x1830882982997632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.262678:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882982997632 ext(2822144->2826239) 00002000:00010000:2.0:1746066749.262680:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:0.0:1746066749.263039:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.263123:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984363392:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.263142:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.263152:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3c00, rc 0) 00000100:00100000:3.0:1746066749.263175:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:324:x1830882982997376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5236us (5846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.263180:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15441 00000100:00100000:3.0:1746066749.263193:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982997888 00000100:00100000:3.0:1746066749.263195:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982997888 00000100:00100000:3.0:1746066749.263211:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15442 00000100:00100000:3.0:1746066749.263215:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:323:x1830882982997888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.263224:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.263303:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a8c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.263319:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746066749.263697:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066749.263914:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.263929:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.263937:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be2c00, rc 0) 00000100:00100000:2.0:1746066749.263940:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982998016 00000100:00100000:2.0:1746066749.263943:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982998016 00010000:00010000:2.0:1746066749.263957:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 16 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.263962:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+11:323:x1830882982997888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 746us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.263968:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15442 00000100:00100000:2.0:1746066749.263974:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6884 00000100:00100000:2.0:1746066749.263979:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882982998016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066749.263986:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066749.263997:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 16 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.264005:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 16 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.264017:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5b3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a00 expref: 16 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.264039:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.264041:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.264045:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.264051:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.264057:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.264058:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.264061:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.264066:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.264084:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.264092:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984363648:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066749.264143:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.264151:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984363776:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066749.264168:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.267822:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.267839:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984363520:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.267858:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.267906:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982997760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5537us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.267915:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6883 00000100:00100000:3.0:1746066749.267958:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984363648:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066749.268041:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.268063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.268152:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982998528 00000100:00100000:2.0:1746066749.268158:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982998528 00000100:00100000:2.0:1746066749.268186:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5875 00000100:00100000:2.0:1746066749.268191:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:319:x1830882982998528:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066749.268313:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984363776:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.268326:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.268374:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982998272 00000100:00100000:1.0:1746066749.268377:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982998272 00002000:00100000:1.0:1746066749.268398:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2465792->2469887) req@ffff880098fbc700 x1830882982998272/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.268407:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc700 with x1830882982998272 ext(2465792->2469887) 00002000:00010000:1.0:1746066749.268410:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbc700 00000100:00100000:1.0:1746066749.268423:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982998784 00000100:00100000:1.0:1746066749.268424:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982998784 00002000:00100000:1.0:1746066749.268433:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098fbe300 x1830882982998784/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.268439:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882982998784 ext(1048576->2097151) 00002000:00010000:1.0:1746066749.268442:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbe300 00000100:00100000:1.0:1746066749.268456:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3961 00000100:00100000:1.0:1746066749.268461:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982998272:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066749.268570:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:319:x1830882982998528:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 378us (528us total) trans 8589936482 rc 0/0 00000100:00100000:2.0:1746066749.268576:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5875 00000100:00100000:2.0:1746066749.268624:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3962 00000100:00100000:2.0:1746066749.268629:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882982998784:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066749.268677:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882982998016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4696us (4979us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.268685:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6884 00000100:00100000:1.0:1746066749.268972:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882982998272:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 510us (1157us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066749.268978:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3961 00002000:00100000:1.0:1746066749.268983:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2465792->2469887) req@ffff880098fbc700 x1830882982998272/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.268989:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc700 with x1830882982998272 ext(2465792->2469887) 00002000:00010000:1.0:1746066749.268992:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbc700 00000100:00100000:0.0:1746066749.269005:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.269013:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982999040 00000100:00100000:1.0:1746066749.269015:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982999040 00002000:00100000:1.0:1746066749.269027:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098fbce00 x1830882982999040/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.269033:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbce00 with x1830882982999040 ext(1048576->2097151) 00002000:00010000:1.0:1746066749.269035:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbce00 00000100:00100000:1.0:1746066749.269045:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3963 00000100:00100000:1.0:1746066749.269049:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982999040:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066749.279569:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.279751:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982999168 00000100:00100000:3.0:1746066749.279758:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982999168 00000100:00100000:1.0:1746066749.279770:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882982999040:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10718us (10762us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066749.279780:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3963 00002000:00100000:1.0:1746066749.279794:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098fbce00 x1830882982999040/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066749.279795:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15443 00000100:00100000:3.0:1746066749.279802:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+13:318:x1830882982999168:12345-192.168.204.16@tcp:101:multiop.0 00002000:00100000:1.0:1746066749.279808:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbce00 with x1830882982999040 ext(1048576->2097151) 00002000:00010000:1.0:1746066749.279813:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbce00 00010000:00010000:3.0:1746066749.279817:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.279829:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a93 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.279854:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.279861:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.279862:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.279865:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->2146303] (req 2097152->2146303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 14 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.279907:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.279916:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 26 pid: 9590 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.279925:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984363904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.279978:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.280393:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882982998784:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11761us (12327us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.280399:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3962 00002000:00100000:2.0:1746066749.280404:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098fbe300 x1830882982998784/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.280411:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882982998784 ext(1048576->2097151) 00002000:00010000:2.0:1746066749.280413:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbe300 00000100:00100000:3.0:1746066749.281922:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984363904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.281945:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->2146303] (req 2097152->2146303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 12 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.281957:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3400, rc 0) 00000100:00100000:3.0:1746066749.281980:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+12:318:x1830882982999168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2178us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.281986:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15443 00000100:00100000:0.0:1746066749.282661:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.282761:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982999296 00000100:00100000:2.0:1746066749.282766:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982999296 00002000:00100000:2.0:1746066749.282796:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2400256->2826239) req@ffff880098fbf100 x1830882982999296/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.282804:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882982999296 ext(2400256->2826239) 00010000:00010000:2.0:1746066749.282809:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 27 pid: 9590 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.282819:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 27 pid: 9590 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066749.282825:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbf100 00000100:00100000:2.0:1746066749.283141:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 854 00000100:00100000:2.0:1746066749.283148:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882982999296:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066749.287045:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.287136:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982999424 00000100:00100000:3.0:1746066749.287142:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982999424 00000100:00100000:3.0:1746066749.287191:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15444 00000100:00100000:3.0:1746066749.287198:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+33:324:x1830882982999424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.287212:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.287225:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0a9a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.287249:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.287256:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.287258:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.287260:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.287286:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.287296:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 17 pid: 13363 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.287307:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984364032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.287669:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.289853:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882982999296:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6699us (7187us total) trans 17179874336 rc 0/0 00000100:00100000:2.0:1746066749.289862:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 854 00002000:00100000:2.0:1746066749.289871:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2400256->2826239) req@ffff880098fbf100 x1830882982999296/t17179874336(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/448 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.289880:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882982999296 ext(2400256->2826239) 00010000:00010000:2.0:1746066749.289912:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 29 pid: 9590 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.289924:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 29 pid: 9590 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066749.289930:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbf100 00000100:00100000:3.0:1746066749.290249:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984364032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.290272:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.290289:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15400, rc 0) 00000100:00100000:3.0:1746066749.290309:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:324:x1830882982999424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3112us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.290314:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15444 00000100:00100000:0.0:1746066749.290863:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.290964:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982999552 00000100:00100000:3.0:1746066749.290970:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982999552 00010000:00010000:3.0:1746066749.290992:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 18 pid: 13363 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.291020:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6885 00000100:00100000:3.0:1746066749.291027:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882982999552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.291037:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.291051:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 18 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.291060:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 18 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.291107:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa5b45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a07 expref: 18 pid: 13363 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.291506:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.291509:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.291514:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.291522:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.291546:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.291556:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984364160:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.291635:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.293747:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.293797:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.293880:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982999680 00000100:00100000:1.0:1746066749.293916:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982999680 00010000:00010000:1.0:1746066749.293943:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 29 pid: 9590 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.293979:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6886 00000100:00100000:1.0:1746066749.293985:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882982999680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.293995:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066749.294007:0:7232:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066749 -> 1746066750 00010000:00010000:1.0:1746066749.294013:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 29 pid: 9590 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.294023:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 29 pid: 9590 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.294041:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b945c00/0xf1867c21abfa5c25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2400256->2826239) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a77 expref: 29 pid: 9590 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.294067:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.294069:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.294074:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.294081:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.294135:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882982999808 00000100:00100000:3.0:1746066749.294138:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882982999808 00000100:00100000:3.0:1746066749.294161:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15445 00000100:00100000:3.0:1746066749.294166:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+21:323:x1830882982999808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.294177:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.294188:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0aa1 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.294200:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.294201:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.294205:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 22 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.294214:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 22 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.294222:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14600, rc 0) 00000100:00100000:3.0:1746066749.294254:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:323:x1830882982999808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 87us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.294258:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15445 00010000:00010000:1.0:1746066749.294553:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.294563:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984364288:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.294687:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984364160:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.294699:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.294714:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882982999552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3688us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.294720:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6885 00000100:00100000:1.0:1746066749.295318:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.296189:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984364288:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.296201:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.296222:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882982999680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2237us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.296229:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6886 00000100:00100000:0.0:1746066749.297416:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.297489:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983000064 00000100:00100000:2.0:1746066749.297495:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983000064 00002000:00100000:2.0:1746066749.297525:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880098fbdc00 x1830882983000064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.297533:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdc00 with x1830882983000064 ext(1048576->2097151) 00002000:00010000:2.0:1746066749.297537:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbdc00 00000100:00100000:0.0:1746066749.297998:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.298352:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983000320 00000100:00100000:2.0:1746066749.298356:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983000320 00002000:00100000:2.0:1746066749.298376:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2142208->2146303) req@ffff880098fbf480 x1830882983000320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.298384:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882983000320 ext(2142208->2146303) 00002000:00010000:2.0:1746066749.298387:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf480 00000100:00100000:2.0:1746066749.298410:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3964 00000100:00100000:2.0:1746066749.298417:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983000064:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066749.298425:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3965 00000100:00100000:0.0:1746066749.298430:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983000320:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066749.298510:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983000320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 80us (512us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066749.298515:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3965 00002000:00100000:0.0:1746066749.298519:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2142208->2146303) req@ffff880098fbf480 x1830882983000320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066749.298525:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882983000320 ext(2142208->2146303) 00002000:00010000:0.0:1746066749.298527:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf480 00000100:00100000:0.0:1746066749.299039:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.299071:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983000576 00000100:00100000:3.0:1746066749.299194:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983000576 00002000:00100000:3.0:1746066749.299211:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880098fbd500 x1830882983000576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.299218:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd500 with x1830882983000576 ext(1048576->2097151) 00002000:00010000:3.0:1746066749.299221:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbd500 00000100:00100000:3.0:1746066749.299244:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3966 00000100:00100000:3.0:1746066749.299250:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983000576:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066749.307334:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983000064:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8909us (9912us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.307345:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3964 00002000:00100000:2.0:1746066749.307356:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880098fbdc00 x1830882983000064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.307365:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdc00 with x1830882983000064 ext(1048576->2097151) 00002000:00010000:2.0:1746066749.307371:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbdc00 00000100:00100000:3.0:1746066749.307955:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983000576:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8703us (8914us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066749.307961:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3966 00002000:00100000:3.0:1746066749.307966:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880098fbd500 x1830882983000576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.307974:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd500 with x1830882983000576 ext(1048576->2097151) 00002000:00010000:3.0:1746066749.307977:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbd500 00000100:00100000:0.0:1746066749.310267:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.310312:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.310380:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983000832 00000100:00100000:2.0:1746066749.310386:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983000832 00000100:00100000:2.0:1746066749.310423:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983000704 00000100:00100000:2.0:1746066749.310425:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983000704 00000100:00100000:2.0:1746066749.310438:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15446 00000100:00100000:2.0:1746066749.310443:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983000832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.310456:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.310469:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009357a600/0xf1867c21abfa5c56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0aaf expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.310514:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984364416:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066749.310570:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.310588:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15447 00000100:00100000:2.0:1746066749.310593:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983000704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.310600:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.310608:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5c5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0aa8 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.310643:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984364544:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066749.310662:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db240 going to sleep for 11 seconds 00002000:00010000:2.0:1746066749.312364:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066749 -> 1746066750 00002000:00010000:2.0:1746066749.312368:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066749 -> 1746066750 00000100:00100000:2.0:1746066749.312383:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984364544:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066749.312401:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5c5d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa8 expref: 35 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.312409:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5c5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa8 expref: 35 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.312421:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357aa00, rc 0) 00002000:00010000:3.0:1746066749.312600:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066749 -> 1746066750 00000100:00100000:3.0:1746066749.312610:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984364416:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066749.312634:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009357a600/0xf1867c21abfa5c56 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aaf expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.312642:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009357a600/0xf1867c21abfa5c56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aaf expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.312660:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357a600, rc 0) 00000100:00100000:3.0:1746066749.312693:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983000832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2249us (2431us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066749.312699:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15446 00000100:00100000:2.0:1746066749.312789:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983000704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2195us (2476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066749.312794:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15447 00000100:00100000:0.0:1746066749.315232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.315329:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983000960 00000100:00100000:2.0:1746066749.315335:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983000960 00000100:00100000:2.0:1746066749.315401:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15448 00000100:00100000:2.0:1746066749.315408:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:324:x1830882983000960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.315422:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.315435:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ab6 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.315458:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.315463:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.315465:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.315467:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.315500:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.315510:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 21 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.315519:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984364672:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.315590:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.317756:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.317789:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.317843:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.318008:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983001344 00000100:00100000:3.0:1746066749.318014:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983001344 00002000:00100000:3.0:1746066749.318048:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2146304->4194303) req@ffff8800958ad500 x1830882983001344/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.318056:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad500 with x1830882983001344 ext(2146304->4194303) 00002000:00010000:3.0:1746066749.318060:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ad500 00000100:00100000:3.0:1746066749.318080:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983001472 00000100:00100000:3.0:1746066749.318082:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983001472 00002000:00100000:3.0:1746066749.318091:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800958af100 x1830882983001472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 504/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.318097:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af100 with x1830882983001472 ext(2097152->4194303) 00010000:00010000:3.0:1746066749.318102:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 22 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.318113:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 22 pid: 20361 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746066749.318118:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958af100 00000100:00100000:3.0:1746066749.318131:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983001600 00000100:00100000:3.0:1746066749.318133:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983001600 00002000:00100000:3.0:1746066749.318141:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2465792->3145727) req@ffff8800958ac380 x1830882983001600/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.318146:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac380 with x1830882983001600 ext(2465792->3145727) 00010000:00010000:3.0:1746066749.318149:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 23 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.318155:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 23 pid: 20361 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746066749.318159:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958ac380 00000100:00100000:3.0:1746066749.318167:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 855 00000100:00100000:3.0:1746066749.318173:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983001472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.318949:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 856 00000100:00100000:3.0:1746066749.318956:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983001600:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066749.319056:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3967 00000100:00100000:3.0:1746066749.319062:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983001344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066749.320085:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984364672:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.320107:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.320119:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a5c600, rc 0) 00000100:00100000:2.0:1746066749.320140:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:324:x1830882983000960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4732us (4914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.320146:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15448 00000100:00100000:3.0:1746066749.331341:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983001472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13161us (13544us total) trans 0 rc 1417216/1417216 00000100:00100000:3.0:1746066749.331351:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 855 00002000:00100000:3.0:1746066749.331360:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800958af100 x1830882983001472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 504/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 1417216/1417216 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.331369:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958af100 with x1830882983001472 ext(2097152->4194303) 00010000:00010000:3.0:1746066749.331377:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.331389:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746066749.331395:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958af100 00000100:00100000:2.0:1746066749.341351:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983001344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22281us (23593us total) trans 0 rc 2048000/2048000 00000100:00100000:2.0:1746066749.341361:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3967 00002000:00100000:2.0:1746066749.341371:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2146304->4194303) req@ffff8800958ad500 x1830882983001344/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 2048000/2048000 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.341380:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad500 with x1830882983001344 ext(2146304->4194303) 00002000:00010000:2.0:1746066749.341385:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958ad500 00000100:00100000:3.0:1746066749.344345:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983001600:12345-192.168.204.16@tcp:4:cat.0 Request processed in 25382us (26494us total) trans 21474841777 rc 0/0 00000100:00100000:3.0:1746066749.344356:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 856 00002000:00100000:3.0:1746066749.344365:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2465792->3145727) req@ffff8800958ac380 x1830882983001600/t21474841777(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/448 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.344374:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac380 with x1830882983001600 ext(2465792->3145727) 00010000:00010000:3.0:1746066749.344382:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.344396:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00002000:00010000:3.0:1746066749.344402:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958ac380 00000100:00100000:0.0:1746066749.345159:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.345222:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983001728 00000100:00100000:2.0:1746066749.345229:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983001728 00000100:00100000:2.0:1746066749.345369:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15449 00000100:00100000:2.0:1746066749.345377:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+24:323:x1830882983001728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.345389:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.345400:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0abd expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.345420:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.345422:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.345425:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.345435:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.345444:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb5400, rc 0) 00000100:00100000:2.0:1746066749.346364:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+25:323:x1830882983001728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 985us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.346370:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15449 00000100:00100000:0.0:1746066749.348856:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.349520:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983001856 00000100:00100000:1.0:1746066749.349528:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983001856 00010000:00010000:1.0:1746066749.349558:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 25 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.349598:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6887 00000100:00100000:1.0:1746066749.349605:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882983001856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.349625:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.349642:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 25 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.349653:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 25 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.349676:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894000/0xf1867c21abfa5c2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2465792->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a7e expref: 25 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.349706:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.349708:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.349714:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.349721:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.349728:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.349729:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.349732:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.349737:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.349761:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.349771:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984364800:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.349860:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.349872:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984364928:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.349916:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.351842:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984364800:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.351851:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984364928:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.351867:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.351917:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983001856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2311us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.351925:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6887 00000100:00100000:0.0:1746066749.354989:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.355090:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983002368 00000100:00100000:3.0:1746066749.355102:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983002368 00002000:00100000:3.0:1746066749.355138:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012ce04700 x1830882983002368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.355152:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04700 with x1830882983002368 ext(3145728->4194303) 00002000:00010000:3.0:1746066749.355157:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce04700 00000100:00100000:0.0:1746066749.355215:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.355305:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3968 00000100:00100000:3.0:1746066749.355313:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983002368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066749.355955:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983002240 00000100:00100000:0.0:1746066749.355958:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983002240 00002000:00100000:0.0:1746066749.355976:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012ce04a80 x1830882983002240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066749.355982:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04a80 with x1830882983002240 ext(2097152->3145727) 00002000:00010000:0.0:1746066749.355985:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce04a80 00000100:00100000:0.0:1746066749.356008:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3969 00000100:00100000:0.0:1746066749.356013:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983002240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.365112:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983002368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9791us (10120us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066749.365123:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3968 00002000:00100000:3.0:1746066749.365133:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012ce04700 x1830882983002368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.365142:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04700 with x1830882983002368 ext(3145728->4194303) 00002000:00010000:3.0:1746066749.365147:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce04700 00000100:00100000:2.0:1746066749.366333:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983002240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10315us (11113us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.366340:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3969 00002000:00100000:2.0:1746066749.366346:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012ce04a80 x1830882983002240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.366354:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04a80 with x1830882983002240 ext(2097152->3145727) 00002000:00010000:2.0:1746066749.366359:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce04a80 00000100:00100000:0.0:1746066749.372555:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.373281:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.374222:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983002752 00000100:00100000:3.0:1746066749.374231:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983002752 00000100:00100000:2.0:1746066749.374392:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983002624 00000100:00100000:2.0:1746066749.374397:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983002624 00000100:00100000:3.0:1746066749.374425:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15450 00002000:00100000:2.0:1746066749.374429:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ce07b80 x1830882983002624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066749.374432:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:324:x1830882983002752:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:2.0:1746066749.374439:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07b80 with x1830882983002624 ext(4194304->5033983) 00002000:00010000:2.0:1746066749.374443:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce07b80 00010000:00010000:3.0:1746066749.374444:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.374458:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ac4 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.374459:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3970 00000100:00100000:2.0:1746066749.374464:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983002624:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066749.374481:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.374487:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.374489:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.374492:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.374516:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.374526:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 11 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.374536:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984365056:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.374625:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.377005:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984365056:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.377030:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.377046:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14000, rc 0) 00000100:00100000:0.0:1746066749.377153:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.377366:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:324:x1830882983002752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2931us (4082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.377373:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15450 00000100:00100000:2.0:1746066749.377622:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983002880 00000100:00100000:2.0:1746066749.377628:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983002880 00002000:00100000:2.0:1746066749.377658:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2146303) req@ffff880094304380 x1830882983002880/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.377666:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830882983002880 ext(2097152->2146303) 00010000:00010000:2.0:1746066749.377672:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 12 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.377687:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 12 pid: 1893 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066749.377693:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304380 00000100:00100000:2.0:1746066749.377719:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 857 00000100:00100000:2.0:1746066749.377726:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983002880:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066749.381298:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983002880:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3565us (4139us total) trans 17179874337 rc 0/0 00000100:00100000:2.0:1746066749.381310:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 857 00002000:00100000:2.0:1746066749.381319:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2146303) req@ffff880094304380 x1830882983002880/t17179874337(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/448 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.381328:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830882983002880 ext(2097152->2146303) 00010000:00010000:2.0:1746066749.381336:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 14 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.381348:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 14 pid: 1893 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066749.381354:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094304380 00000100:00100000:2.0:1746066749.383176:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983002624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8707us (10623us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066749.383185:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3970 00002000:00100000:2.0:1746066749.383192:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ce07b80 x1830882983002624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.383207:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07b80 with x1830882983002624 ext(4194304->5033983) 00002000:00010000:2.0:1746066749.383210:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce07b80 00000100:00100000:0.0:1746066749.386951:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.387012:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983003008 00000100:00100000:1.0:1746066749.387020:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983003008 00010000:00010000:1.0:1746066749.387050:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 14 pid: 1893 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.387090:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6888 00000100:00100000:1.0:1746066749.387098:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983003008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.387110:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.387125:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 14 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.387137:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 14 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.387156:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be3400/0xf1867c21abfa5c41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2146303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a93 expref: 14 pid: 1893 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.387189:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.387191:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.387197:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.387206:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.387235:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.387247:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984365184:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.387467:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.394021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.394196:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983003136 00000100:00100000:3.0:1746066749.394202:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983003136 00000100:00100000:1.0:1746066749.394204:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984365184:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.394222:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.394236:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15451 00000100:00100000:3.0:1746066749.394242:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983003136:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066749.394256:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983003008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7158us (7311us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066749.394257:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066749.394265:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6888 00010000:00010000:3.0:1746066749.394271:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0acb expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.394294:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.394296:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.394302:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.394316:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.394323:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14e00, rc 0) 00000100:00100000:3.0:1746066749.394341:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983003136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 100us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.394345:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15451 00000100:00100000:0.0:1746066749.399096:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.399153:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.399202:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.399301:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983003776 00000100:00100000:3.0:1746066749.399310:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983003776 00000100:00100000:2.0:1746066749.399350:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983003392 00000100:00100000:2.0:1746066749.399354:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983003392 00000100:00100000:2.0:1746066749.399386:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5876 00000100:00100000:2.0:1746066749.399393:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:323:x1830882983003392:12345-192.168.204.16@tcp:35:cat.0 00002000:00100000:3.0:1746066749.399402:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880094305180 x1830882983003776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.399412:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830882983003776 ext(2097152->4194303) 00002000:00010000:3.0:1746066749.399417:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:3.0:1746066749.399437:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983003904 00000100:00100000:3.0:1746066749.399440:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983003904 00002000:00100000:3.0:1746066749.399451:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880094304e00 x1830882983003904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.399458:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830882983003904 ext(3145728->4194303) 00002000:00010000:3.0:1746066749.399461:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:3.0:1746066749.399471:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3971 00000100:00100000:3.0:1746066749.399478:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983003776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066749.399550:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:323:x1830882983003392:12345-192.168.204.16@tcp:35:cat.0 Request processed in 157us (462us total) trans 8589936483 rc 0/0 00000100:00100000:2.0:1746066749.399556:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5876 00000100:00100000:2.0:1746066749.399575:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3972 00000100:00100000:2.0:1746066749.399580:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983003904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.417490:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983003776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18003us (18328us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066749.417501:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3971 00002000:00100000:3.0:1746066749.417520:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880094305180 x1830882983003776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.417529:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830882983003776 ext(2097152->4194303) 00002000:00010000:3.0:1746066749.417534:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:2.0:1746066749.420096:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983003904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20507us (20885us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.420106:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3972 00002000:00100000:2.0:1746066749.420116:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880094304e00 x1830882983003904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.420124:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304e00 with x1830882983003904 ext(3145728->4194303) 00002000:00010000:2.0:1746066749.420129:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304e00 00000100:00100000:0.0:1746066749.427755:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.427836:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983004160 00000100:00100000:2.0:1746066749.427842:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983004160 00002000:00100000:2.0:1746066749.427879:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880094307480 x1830882983004160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.427912:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307480 with x1830882983004160 ext(4194304->5033983) 00002000:00010000:2.0:1746066749.427918:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307480 00000100:00100000:2.0:1746066749.427946:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3973 00000100:00100000:2.0:1746066749.427954:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983004160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066749.432797:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983004160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4837us (5043us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066749.432805:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3973 00002000:00100000:2.0:1746066749.432814:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880094307480 x1830882983004160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.432821:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307480 with x1830882983004160 ext(4194304->5033983) 00002000:00010000:2.0:1746066749.432825:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307480 00000100:00100000:0.0:1746066749.439379:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.440083:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983004416 00000100:00100000:2.0:1746066749.440091:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983004416 00000100:00100000:2.0:1746066749.440393:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5877 00000100:00100000:2.0:1746066749.440401:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:324:x1830882983004416:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066749.440787:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:324:x1830882983004416:12345-192.168.204.16@tcp:35:cat.0 Request processed in 385us (1432us total) trans 8589936484 rc 0/0 00000100:00100000:2.0:1746066749.440794:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5877 00000100:00100000:1.0:1746066749.468002:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.468577:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983004544 00000100:00100000:0.0:1746066749.468585:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983004544 00000100:00100000:0.0:1746066749.468692:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16183 00000100:00100000:0.0:1746066749.468700:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:329:x1830882983004544:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066749.468721:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066749.468734:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa5c80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ad2 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.468779:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468789:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468797:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468806:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468811:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468816:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468868:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468875:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.468896:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066749.468918:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.468927:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 9 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:0.0:1746066749.468940:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984365312:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066749.469014:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.473032:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.473126:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983004800 00000100:00100000:3.0:1746066749.473135:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983004800 00000100:00100000:3.0:1746066749.473171:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5878 00000100:00100000:3.0:1746066749.473178:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:314:x1830882983004800:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066749.473217:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984365312:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.473235:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746066749.473866:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:314:x1830882983004800:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 687us (840us total) trans 8589936485 rc 0/0 00000100:00100000:3.0:1746066749.473873:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5878 00000100:00100000:0.0:1746066749.475851:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.475975:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983004928 00000100:00100000:1.0:1746066749.475984:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983004928 00010000:00010000:1.0:1746066749.476019:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.476131:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6889 00000100:00100000:1.0:1746066749.476138:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983004928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.476152:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.476158:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.476168:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.476188:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629aa00/0xf1867c21abfa5bbc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a38 expref: 11 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.476624:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.476630:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.476640:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.476647:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.476870:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066749.477239:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477247:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066749.477301:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066749.477306:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066749.477326:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477336:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477349:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477354:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477361:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477366:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477372:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.477375:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477381:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477390:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066749.477393:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.477396:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477400:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3c00/0xf1867c21abfa5c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477411:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477416:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477420:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.477425:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.479944:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.479956:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.479972:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096476600) 00010000:00010000:3.0:1746066749.479975:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.479978:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.479983:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa5c8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.480038:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa5c80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.480050:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 8 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.480056:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.480058:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066749.480061:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2200, rc 0) 00000100:00100000:1.0:1746066749.480551:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983004928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4408us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.480563:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6889 00000100:00100000:3.0:1746066749.481060:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:329:x1830882983004544:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 12359us (13063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.481067:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16183 00000100:00100000:0.0:1746066749.484815:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.485056:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983005056 00000100:00100000:2.0:1746066749.485066:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983005056 00000100:00100000:2.0:1746066749.485123:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15452 00000100:00100000:2.0:1746066749.485131:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983005056:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066749.485149:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.485169:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ad9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.485192:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.485194:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.485202:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.485217:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.485228:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb5600, rc 0) 00000100:00100000:2.0:1746066749.485393:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983005056:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 262us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.485400:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15452 00000100:00100000:1.0:1746066749.485450:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.485543:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.485555:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.485568:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.485594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.485623:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983005312 00000100:00100000:1.0:1746066749.485627:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983005312 00000100:00100000:1.0:1746066749.485650:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983005568 00000100:00100000:1.0:1746066749.485652:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983005568 00000100:00100000:1.0:1746066749.485663:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983005184 00000100:00100000:1.0:1746066749.485665:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983005184 00000100:00100000:1.0:1746066749.485673:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983005440 00000100:00100000:1.0:1746066749.485675:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983005440 00000100:00100000:1.0:1746066749.485682:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983005696 00000100:00100000:1.0:1746066749.485684:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983005696 00000100:00100000:1.0:1746066749.485695:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15453 00000100:00100000:1.0:1746066749.485700:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983005312:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066749.485708:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.485718:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ae7 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.485729:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485730:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485735:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485746:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485753:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0400, rc 0) 00000100:00100000:1.0:1746066749.485772:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983005312:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.485778:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15453 00000100:00100000:1.0:1746066749.485788:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15454 00000100:00100000:1.0:1746066749.485793:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983005568:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066749.485799:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.485805:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0af5 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.485813:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485814:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485818:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485827:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485834:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0a00, rc 0) 00000100:00100000:1.0:1746066749.485846:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983005568:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 53us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.485851:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15454 00000100:00100000:1.0:1746066749.485859:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15455 00000100:00100000:1.0:1746066749.485863:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983005184:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066749.485868:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.485873:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ae0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.485899:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485901:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485905:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485918:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485925:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1000, rc 0) 00000100:00100000:1.0:1746066749.485939:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983005184:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 76us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.485943:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15455 00000100:00100000:1.0:1746066749.485951:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15456 00000100:00100000:1.0:1746066749.485956:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983005440:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066749.485961:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.485966:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0aee expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.485975:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485976:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.485980:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485988:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.485995:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0000, rc 0) 00000100:00100000:1.0:1746066749.486006:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983005440:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 50us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.486010:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15456 00000100:00100000:1.0:1746066749.486017:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15457 00000100:00100000:1.0:1746066749.486021:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983005696:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066749.486026:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.486031:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0afc expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.486038:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.486040:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.486043:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.486051:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066749.486058:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1800, rc 0) 00000100:00100000:1.0:1746066749.486069:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983005696:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 47us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.486074:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15457 00000100:00100000:0.0:1746066749.488148:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.488315:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983005952 00000100:00100000:3.0:1746066749.488323:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983005952 00000100:00100000:3.0:1746066749.488380:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16184 00000100:00100000:3.0:1746066749.488388:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:329:x1830882983005952:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066749.488407:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.488425:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a600/0xf1867c21abfa5cc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b03 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.488528:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.488542:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.488549:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.488579:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.488590:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 9 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.488601:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984365440:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.488689:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800962089c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.490810:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.490834:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983006080 00000100:00100000:1.0:1746066749.490840:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983006080 00010000:00010000:1.0:1746066749.490868:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 10 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.491086:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6890 00000100:00100000:1.0:1746066749.491094:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983006080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.491106:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.491114:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 10 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.491125:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 10 pid: 7243 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.491146:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.491151:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.491159:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.491165:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066749.491183:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.491215:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983006080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.491222:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6890 00010000:00010000:3.0:1746066749.491391:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa5c95 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad2 expref: 9 pid: 7243 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.491405:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984365440:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.491423:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.491434:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.491440:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066749.491456:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066749.491655:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a600/0xf1867c21abfa5cc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b03 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.491671:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b03 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.491677:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.491679:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066749.491681:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357aa00, rc 0) 00000100:00100000:3.0:1746066749.491716:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:329:x1830882983005952:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3328us (3575us total) trans 8589936486 rc 0/0 00000100:00100000:3.0:1746066749.491722:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16184 00000100:00100000:0.0:1746066749.493200:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.493381:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983006336 00000100:00100000:3.0:1746066749.493389:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983006336 00000100:00100000:3.0:1746066749.493440:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16185 00000100:00100000:3.0:1746066749.493448:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:331:x1830882983006336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066749.493470:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.493484:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357be00/0xf1867c21abfa5cdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b0a expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.493548:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493559:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493567:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493579:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493584:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493589:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493675:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493682:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493688:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066749.493695:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066749.493747:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493752:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493757:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493762:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493767:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.493770:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493775:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493784:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066749.493786:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.493789:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493793:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5ce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493804:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493808:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493812:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493816:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.493817:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493822:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493827:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34e400) 00010000:00010000:3.0:1746066749.493829:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.493831:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493835:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14800/0xf1867c21abfa5ce9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.493863:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357be00/0xf1867c21abfa5cdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 32 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.493872:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.493877:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.493878:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746066749.493880:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098be3400, rc 0) 00000100:00100000:3.0:1746066749.493950:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:331:x1830882983006336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 503us (757us total) trans 8589936487 rc 0/0 00000100:00100000:3.0:1746066749.493956:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16185 00010000:00010000:1.0:1746066749.494519:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066749.494853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.494977:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983006592 00000100:00100000:1.0:1746066749.494981:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983006592 00000100:00100000:1.0:1746066749.495015:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16186 00000100:00100000:1.0:1746066749.495021:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:329:x1830882983006592:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066749.495034:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.495036:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066749.495049:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5ccd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b03 expref: 9 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.495071:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.495075:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066749.495085:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0600/0xf1867c21abfa5cfe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b11 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.495136:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495145:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495151:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495158:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495163:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495167:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495172:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a1e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066749.495174:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495178:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495184:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.495187:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066749.495189:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495193:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa5d05 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.495212:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0600/0xf1867c21abfa5cfe lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b11 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.495219:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0600/0xf1867c21abfa5cfe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b11 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.495225:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0600, rc 0) 00000100:00100000:1.0:1746066749.495266:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:329:x1830882983006592:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 244us (414us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066749.495271:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16186 00000100:00100000:0.0:1746066749.496599:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.496656:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983006720 00000100:00100000:2.0:1746066749.496661:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983006720 00000100:00100000:2.0:1746066749.496695:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15458 00000100:00100000:2.0:1746066749.496700:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:331:x1830882983006720:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066749.496710:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.496719:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b18 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.496738:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.496749:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.496756:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.496762:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.496764:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.496770:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [299008->315391] (req 299008->315391) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.496793:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.496803:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 36 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.496812:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984365568:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.496917:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.496926:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 19 pid: 9590 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.496933:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984365696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.496972:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.496979:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 23 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.496987:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984365824:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.497012:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.497311:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.497416:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983006976 00000100:00100000:3.0:1746066749.497419:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983006976 00000100:00100000:3.0:1746066749.497441:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5879 00000100:00100000:3.0:1746066749.497446:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:329:x1830882983006976:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066749.497742:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:329:x1830882983006976:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 294us (429us total) trans 8589936488 rc 0/0 00000100:00100000:3.0:1746066749.497748:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5879 00000100:00100000:0.0:1746066749.498326:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.498356:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.498406:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.498472:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983007104 00000100:00100000:1.0:1746066749.498475:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983007104 00010000:00010000:1.0:1746066749.498491:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.498505:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983007232 00000100:00100000:1.0:1746066749.498507:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983007232 00000100:00100000:0.0:1746066749.498513:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983007360 00010000:00010000:1.0:1746066749.498514:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 20 pid: 9590 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1746066749.498515:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983007360 00000100:00100000:1.0:1746066749.498526:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6891 00010000:00010000:0.0:1746066749.498526:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.498530:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983007104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066749.498545:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6892 00000100:00100000:1.0:1746066749.498548:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6893 00000100:00100000:0.0:1746066749.498550:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983007232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066749.498552:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983007360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066749.498557:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.498558:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.498569:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:0.0:1746066749.498569:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 20 pid: 9590 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1746066749.498577:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 20 pid: 9590 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.498870:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984365568:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.498879:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984365696:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.498905:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984365824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066749.498965:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.498981:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5bae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a31 expref: 24 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.498991:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.499012:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983007360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 459us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.499017:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6893 00010000:00010000:1.0:1746066749.499039:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.499046:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.499053:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.499061:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa5bf4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a4d expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.499068:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.499079:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882983007104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 549us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.499083:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6891 00010000:00010000:0.0:1746066749.499174:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa5c9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ad9 expref: 20 pid: 9590 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1746066749.499193:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066749.499195:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066749.499200:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.499207:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.499228:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066749.499237:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984365952:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066749.499266:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.499276:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb4000, rc 0) 00000100:00100000:0.0:1746066749.499286:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800975583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.499296:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:331:x1830882983006720:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2596us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.499301:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15458 00000100:00100000:0.0:1746066749.502658:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.502768:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983007616 00000100:00100000:3.0:1746066749.502778:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983007616 00002000:00100000:3.0:1746066749.502824:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (299008->303103) req@ffff8800a4d80e00 x1830882983007616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.502845:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80e00 with x1830882983007616 ext(299008->303103) 00002000:00010000:3.0:1746066749.502850:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d80e00 00000100:00100000:3.0:1746066749.502875:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3974 00000100:00100000:3.0:1746066749.502911:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983007616:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066749.502927:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984365952:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066749.502948:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066749.503005:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983007232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4453us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.503016:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6892 00000100:00100000:3.0:1746066749.503048:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983007616:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 165us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066749.503053:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3974 00002000:00100000:3.0:1746066749.503058:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (299008->303103) req@ffff8800a4d80e00 x1830882983007616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.503065:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80e00 with x1830882983007616 ext(299008->303103) 00002000:00010000:3.0:1746066749.503068:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d80e00 00000100:00100000:0.0:1746066749.510046:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.510170:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983007872 00000100:00100000:2.0:1746066749.510181:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983007872 00002000:00100000:2.0:1746066749.510233:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (311296->315391) req@ffff8800a4d81180 x1830882983007872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.510242:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d81180 with x1830882983007872 ext(311296->315391) 00002000:00010000:2.0:1746066749.510247:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d81180 00000100:00100000:2.0:1746066749.510468:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3975 00000100:00100000:2.0:1746066749.510477:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983007872:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066749.510641:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983007872:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 162us (605us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066749.510648:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3975 00002000:00100000:2.0:1746066749.510653:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (311296->315391) req@ffff8800a4d81180 x1830882983007872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.510659:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d81180 with x1830882983007872 ext(311296->315391) 00002000:00010000:2.0:1746066749.510662:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d81180 00000100:00100000:0.0:1746066749.513418:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.513482:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983008128 00000100:00100000:3.0:1746066749.513491:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983008128 00000100:00100000:3.0:1746066749.513543:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5880 00000100:00100000:3.0:1746066749.513551:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:331:x1830882983008128:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066749.513788:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:331:x1830882983008128:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 236us (379us total) trans 8589936489 rc 0/0 00000100:00100000:3.0:1746066749.513794:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5880 00000100:00100000:0.0:1746066749.522302:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.522568:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983008384 00000100:00100000:3.0:1746066749.522580:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983008384 00000100:00100000:3.0:1746066749.522653:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16187 00000100:00100000:3.0:1746066749.522661:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:334:x1830882983008384:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066749.522688:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.523029:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a600/0xf1867c21abfa5d13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b1f expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.523113:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523126:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523137:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523150:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523155:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523160:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523260:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523268:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523274:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066749.523282:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066749.523355:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523362:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523368:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523374:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523379:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.523383:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523389:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523399:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066749.523401:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.523405:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523409:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523438:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523442:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523447:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523451:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be3600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066749.523453:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523462:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523468:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34e700) 00010000:00010000:3.0:1746066749.523469:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066749.523471:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.523476:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3600/0xf1867c21abfa5d21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.528286:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a600/0xf1867c21abfa5d13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.528310:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.528318:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.528321:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066749.528324:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575a000, rc 0) 00000100:00100000:3.0:1746066749.528412:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:334:x1830882983008384:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5750us (6120us total) trans 8589936490 rc 0/0 00000100:00100000:3.0:1746066749.528421:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16187 00000100:00100000:1.0:1746066749.538811:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.539156:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983008640 00000100:00100000:3.0:1746066749.539165:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983008640 00000100:00100000:3.0:1746066749.539211:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16188 00000100:00100000:3.0:1746066749.539218:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:338:x1830882983008640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.539243:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.539260:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b26 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.539364:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.539379:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066749.539389:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066749.539400:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066749.539518:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5d36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 15 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.539536:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.539545:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.539547:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746066749.539551:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357a000, rc 0) 00000100:00100000:3.0:1746066749.539596:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:338:x1830882983008640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 378us (794us total) trans 8589936491 rc 0/0 00000100:00100000:3.0:1746066749.539602:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16188 00000100:00100000:0.0:1746066749.542305:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.542370:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983008768 00000100:00100000:2.0:1746066749.542378:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983008768 00000100:00100000:2.0:1746066749.542431:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15459 00000100:00100000:2.0:1746066749.542437:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983008768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.542453:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.542469:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5d4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b2d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066749.542518:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366080:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066749.542620:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066749.544562:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066749 -> 1746066750 00002000:00010000:2.0:1746066749.544568:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066749 -> 1746066750 00000100:00100000:2.0:1746066749.544587:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366080:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066749.544626:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5d4b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b2d expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.544638:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa5d4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b2d expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.544652:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:2.0:1746066749.544684:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983008768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2246us (2386us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066749.544690:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15459 00000100:00100000:0.0:1746066749.549014:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.549445:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983008896 00000100:00100000:2.0:1746066749.549455:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983008896 00000100:00100000:2.0:1746066749.549501:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15460 00000100:00100000:2.0:1746066749.549509:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:338:x1830882983008896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.549527:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.549544:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b34 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.549574:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.549581:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.549582:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.549586:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.549630:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.549642:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 34 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.549653:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.549736:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.552692:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366208:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066749.552725:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066749.552748:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb4400, rc 0) 00000100:00100000:0.0:1746066749.552798:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:338:x1830882983008896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3289us (3793us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066749.552807:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15460 00000100:00100000:0.0:1746066749.555872:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.556050:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983009024 00000100:00100000:2.0:1746066749.556059:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983009024 00002000:00100000:2.0:1746066749.556102:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (299008->315391) req@ffff880096990450 x1830882983009024/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 16872/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.556112:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096990450 with x1830882983009024 ext(299008->315391) 00010000:00010000:2.0:1746066749.556121:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 35 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.556133:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 35 pid: 20361 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066749.556140:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096990450 00000100:00100000:2.0:1746066749.556172:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 858 00000100:00100000:2.0:1746066749.556179:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983009024:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066749.558348:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096990450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983009024:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2162us (2479us total) trans 21474841778 rc 0/0 00000100:00100000:2.0:1746066749.558362:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 858 00002000:00100000:2.0:1746066749.558373:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (299008->315391) req@ffff880096990450 x1830882983009024/t21474841778(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 16872/448 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.558382:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096990450 with x1830882983009024 ext(299008->315391) 00010000:00010000:2.0:1746066749.558393:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:2.0:1746066749.558407:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00002000:00010000:2.0:1746066749.558421:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096990450 00000100:00100000:0.0:1746066749.561724:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.561796:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983009152 00000100:00100000:3.0:1746066749.561805:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983009152 00010000:00010000:3.0:1746066749.561843:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.561871:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6894 00000100:00100000:3.0:1746066749.561879:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983009152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.561910:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.561929:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.561939:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.561961:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4000/0xf1867c21abfa5d0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 299008->315391) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b18 expref: 37 pid: 20361 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.561991:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.561992:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.562000:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.562007:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.562040:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.562050:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984366336:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.562135:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.566396:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984366336:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.566416:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.566466:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882983009152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4586us (4751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.566476:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6894 00000100:00100000:0.0:1746066749.571236:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.571380:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983009408 00000100:00100000:3.0:1746066749.571390:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983009408 00002000:00100000:3.0:1746066749.571435:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d82680 x1830882983009408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.571446:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d82680 with x1830882983009408 ext(0->1048575) 00002000:00010000:3.0:1746066749.571451:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d82680 00000100:00100000:3.0:1746066749.571470:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3976 00000100:00100000:3.0:1746066749.571476:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983009408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.582105:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983009408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10615us (10867us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066749.582117:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3976 00002000:00100000:3.0:1746066749.582130:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d82680 x1830882983009408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.582139:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d82680 with x1830882983009408 ext(0->1048575) 00002000:00010000:3.0:1746066749.582146:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d82680 00000100:00100000:0.0:1746066749.609596:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.609656:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.609769:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983009792 00000100:00100000:3.0:1746066749.609780:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983009792 00002000:00100000:3.0:1746066749.609838:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d82a00 x1830882983009792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.609848:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d82a00 with x1830882983009792 ext(2097152->4194303) 00002000:00010000:3.0:1746066749.609854:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d82a00 00000100:00100000:3.0:1746066749.610512:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983009920 00000100:00100000:3.0:1746066749.610517:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983009920 00002000:00100000:3.0:1746066749.610536:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800a4d82d80 x1830882983009920/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.610543:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d82d80 with x1830882983009920 ext(2097152->3145727) 00002000:00010000:3.0:1746066749.610546:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d82d80 00000100:00100000:1.0:1746066749.610672:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3977 00000100:00100000:1.0:1746066749.610684:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983009792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066749.617166:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3978 00000100:00100000:0.0:1746066749.617202:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983009920:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066749.629223:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983009792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18530us (19626us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066749.629237:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3977 00002000:00100000:1.0:1746066749.629251:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d82a00 x1830882983009792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.629261:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d82a00 with x1830882983009792 ext(2097152->4194303) 00002000:00010000:1.0:1746066749.629266:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d82a00 00000100:00100000:2.0:1746066749.632205:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983009920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15014us (22537us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066749.632219:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3978 00002000:00100000:2.0:1746066749.632230:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800a4d82d80 x1830882983009920/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.632239:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d82d80 with x1830882983009920 ext(2097152->3145727) 00002000:00010000:2.0:1746066749.632246:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d82d80 00000100:00100000:3.0:1746066749.644133:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984366464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746066749.644209:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066749.644447:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984366464 00000100:00100000:2.0:1746066749.644456:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984366464 00000100:00100000:2.0:1746066749.644741:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1746066749.644750:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984366464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746066749.644775:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1060478272 pending 1421312 free 3912097792 avail 3669438464 00000100:00080000:1.0:1746066749.644813:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066749.647181:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984366464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2425us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.647193:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:3.0:1746066749.647303:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984366464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066749.655243:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.655548:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983010176 00000100:00100000:1.0:1746066749.655558:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983010176 00000100:00100000:1.0:1746066749.655629:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16189 00000100:00100000:1.0:1746066749.655639:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:340:x1830882983010176:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066749.655664:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.655682:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017e00/0xf1867c21abfa5d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b3b expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.655755:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.655768:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.655779:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.655793:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.655802:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.655807:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656046:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656056:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656062:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066749.656070:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066749.656144:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656150:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656155:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656161:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656167:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097017200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066749.656171:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656177:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656189:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066749.656192:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066749.656196:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.656201:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017200/0xf1867c21abfa5d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657555:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657564:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657568:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657573:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097017600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066749.657576:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657581:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657589:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9800) 00010000:00010000:1.0:1746066749.657591:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066749.657593:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657597:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa5d67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.657652:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017e00/0xf1867c21abfa5d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 35 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.657663:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 34 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.657669:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.657671:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066749.657673:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017c00, rc 0) 00000100:00100000:1.0:1746066749.658928:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:340:x1830882983010176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3286us (3691us total) trans 8589936492 rc 0/0 00000100:00100000:1.0:1746066749.658937:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16189 00000100:00100000:0.0:1746066749.665073:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.665177:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983010304 00000100:00100000:2.0:1746066749.665188:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983010304 00000100:00100000:2.0:1746066749.666297:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15461 00000100:00100000:2.0:1746066749.666308:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:340:x1830882983010304:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066749.666330:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.666349:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b42 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.666383:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 37 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.666391:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.666399:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.666405:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.666408:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.666410:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2916352->2936831] (req 2916352->2936831) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.666444:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.666456:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 23 pid: 3528 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.666469:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.667630:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.667641:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 18 pid: 9591 timeout: 817 lvb_type: 1 00000100:00100000:2.0:1746066749.667650:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366720:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.667862:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 37 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.667872:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 37 pid: 3528 timeout: 817 lvb_type: 0 00000100:00100000:2.0:1746066749.667899:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.668383:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.673769:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366592:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066749.675350:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.675488:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983010432 00000100:00100000:3.0:1746066749.675498:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983010432 00010000:00010000:3.0:1746066749.675542:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 24 pid: 3528 timeout: 817 lvb_type: 0 00000100:00100000:3.0:1746066749.675579:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6895 00000100:00100000:3.0:1746066749.675589:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983010432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.675615:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.675643:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 24 pid: 3528 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.675655:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 24 pid: 3528 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.675680:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5400/0xf1867c21abfa5c6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0abd expref: 24 pid: 3528 timeout: 817 lvb_type: 0 00010000:00010000:3.0:1746066749.677242:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.677317:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983010432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1725us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.677327:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6895 00000100:00100000:0.0:1746066749.680317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.680351:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983010560 00000100:00100000:0.0:1746066749.680359:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983010560 00010000:00010000:0.0:1746066749.680392:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 19 pid: 9591 timeout: 817 lvb_type: 1 00000100:00100000:0.0:1746066749.680418:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6896 00000100:00100000:0.0:1746066749.680424:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983010560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066749.680438:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066749.680458:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 19 pid: 9591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1746066749.680470:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 19 pid: 9591 timeout: 817 lvb_type: 1 00010000:00010000:0.0:1746066749.680493:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066749.680525:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983010560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066749.680530:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6896 00010000:00010000:3.0:1746066749.681208:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa5caa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0af5 expref: 18 pid: 9591 timeout: 817 lvb_type: 1 00000100:00100000:3.0:1746066749.681222:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366720:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.684972:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984366848:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.685023:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2916352->2936831] (req 2916352->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.685043:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718c200, rc 0) 00000100:00100000:2.0:1746066749.685104:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:340:x1830882983010304:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 18796us (20040us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.685116:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15461 00000100:00100000:0.0:1746066749.685241:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.685459:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983010816 00000100:00100000:1.0:1746066749.685468:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983010816 00000100:00100000:1.0:1746066749.685520:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16190 00000100:00100000:1.0:1746066749.685530:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:345:x1830882983010816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066749.685555:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.685575:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017800/0xf1867c21abfa5d83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b49 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.685710:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.685728:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.685740:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066749.685753:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066749.685875:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017800/0xf1867c21abfa5d83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 37 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.686114:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 36 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.686123:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.686126:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746066749.686128:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017400, rc 0) 00000100:00100000:1.0:1746066749.686165:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:345:x1830882983010816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 636us (926us total) trans 8589936493 rc 0/0 00000100:00100000:1.0:1746066749.686171:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16190 00000100:00100000:0.0:1746066749.689602:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.689672:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983010944 00000100:00100000:1.0:1746066749.689682:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983010944 00010000:00010000:1.0:1746066749.689717:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 37 pid: 3528 timeout: 817 lvb_type: 0 00000100:00100000:1.0:1746066749.689744:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6897 00000100:00100000:1.0:1746066749.689751:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983010944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.689764:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.689783:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 37 pid: 3528 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.689795:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 37 pid: 3528 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.689817:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a5c600/0xf1867c21abfa5c64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ab6 expref: 37 pid: 3528 timeout: 817 lvb_type: 0 00010000:00010000:1.0:1746066749.689849:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.689851:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066749.689858:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.689866:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.689913:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066749.689925:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984366976:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.690002:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.692322:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.692352:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.692601:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983011072 00000100:00100000:2.0:1746066749.692621:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983011072 00000100:00100000:2.0:1746066749.693177:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983011200 00000100:00100000:2.0:1746066749.693183:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983011200 00000100:00100000:3.0:1746066749.693262:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15462 00000100:00100000:3.0:1746066749.693295:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983011072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.693317:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.693337:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b50 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.693363:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.693365:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.693377:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 39 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.693393:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 39 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.693405:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7c00, rc 0) 00000100:00100000:3.0:1746066749.693462:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983011072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 189us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.693469:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15462 00000100:00100000:3.0:1746066749.693494:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15463 00000100:00100000:3.0:1746066749.693500:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983011200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.693509:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.693517:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5d9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b57 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.693565:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367104:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066749.693633:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.695140:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984366976:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066749.695157:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.695182:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882983010944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5431us (5590us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.695190:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6897 00000100:00100000:3.0:1746066749.697602:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367104:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066749.697642:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5d9f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b57 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.697656:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5d9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b57 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.697673:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7e00, rc 0) 00000100:00100000:3.0:1746066749.698205:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983011200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4703us (5850us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066749.698214:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15463 00000100:00100000:1.0:1746066749.698413:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.698471:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983011456 00000100:00100000:1.0:1746066749.698476:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983011456 00002000:00100000:1.0:1746066749.698512:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2916352->2920447) req@ffff88012e423800 x1830882983011456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.698521:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423800 with x1830882983011456 ext(2916352->2920447) 00002000:00010000:1.0:1746066749.698526:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423800 00000100:00100000:1.0:1746066749.698540:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3979 00000100:00100000:1.0:1746066749.698546:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983011456:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066749.698670:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983011456:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 122us (255us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066749.698677:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3979 00002000:00100000:1.0:1746066749.698684:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2916352->2920447) req@ffff88012e423800 x1830882983011456/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.698691:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423800 with x1830882983011456 ext(2916352->2920447) 00002000:00010000:1.0:1746066749.698695:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423800 00000100:00100000:1.0:1746066749.704546:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.704646:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983011712 00000100:00100000:0.0:1746066749.704656:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983011712 00002000:00100000:0.0:1746066749.704704:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2932736->2936831) req@ffff88012e420000 x1830882983011712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066749.704713:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882983011712 ext(2932736->2936831) 00002000:00010000:0.0:1746066749.704718:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:0.0:1746066749.704746:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3980 00000100:00100000:0.0:1746066749.704754:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983011712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066749.704922:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983011712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 168us (391us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066749.704928:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3980 00002000:00100000:0.0:1746066749.704934:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2932736->2936831) req@ffff88012e420000 x1830882983011712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066749.704947:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420000 with x1830882983011712 ext(2932736->2936831) 00002000:00010000:0.0:1746066749.704950:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e420000 00000100:00100000:0.0:1746066749.706763:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.706811:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.707127:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983011968 00000100:00100000:1.0:1746066749.707134:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983011968 00002000:00100000:1.0:1746066749.707166:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098fbea00 x1830882983011968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.707175:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882983011968 ext(0->1048575) 00002000:00010000:1.0:1746066749.707181:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:1.0:1746066749.707194:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3981 00000100:00100000:1.0:1746066749.707200:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983011968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.707935:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983012224 00000100:00100000:3.0:1746066749.707940:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983012224 00000100:00100000:3.0:1746066749.707968:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5881 00000100:00100000:3.0:1746066749.707973:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:340:x1830882983012224:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066749.708898:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:340:x1830882983012224:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 922us (2084us total) trans 8589936494 rc 0/0 00000100:00100000:3.0:1746066749.708906:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5881 00000100:00100000:1.0:1746066749.717806:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983011968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10592us (11036us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066749.717818:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3981 00002000:00100000:1.0:1746066749.729046:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098fbea00 x1830882983011968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.729062:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882983011968 ext(0->1048575) 00002000:00010000:1.0:1746066749.729070:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:0.0:1746066749.754322:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.756299:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983012480 00000100:00100000:1.0:1746066749.756313:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983012480 00002000:00100000:1.0:1746066749.756369:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880098fbca80 x1830882983012480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 504/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.756380:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882983012480 ext(2097152->4194303) 00002000:00010000:1.0:1746066749.756386:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:1.0:1746066749.756415:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3982 00000100:00100000:1.0:1746066749.756422:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983012480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066749.780870:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983012480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24437us (26546us total) trans 0 rc 2076672/2076672 00000100:00100000:1.0:1746066749.780911:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3982 00002000:00100000:1.0:1746066749.780924:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880098fbca80 x1830882983012480/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 504/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 2076672/2076672 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.780934:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbca80 with x1830882983012480 ext(2097152->4194303) 00002000:00010000:1.0:1746066749.780940:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbca80 00000100:00100000:0.0:1746066749.792709:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.792812:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983012864 00000100:00100000:1.0:1746066749.792822:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983012864 00002000:00100000:1.0:1746066749.792871:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880098fbd180 x1830882983012864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.792915:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882983012864 ext(4194304->5033983) 00002000:00010000:1.0:1746066749.792922:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:1.0:1746066749.792953:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3983 00000100:00100000:1.0:1746066749.792963:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983012864:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066749.797809:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.797932:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983012608 00000100:00100000:3.0:1746066749.797943:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983012608 00000100:00100000:3.0:1746066749.798000:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15464 00000100:00100000:3.0:1746066749.798008:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983012608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.798030:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.798050:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5da6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b5e expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.798106:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367232:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066749.798220:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066749.801376:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983012864:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8405us (8670us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066749.801388:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3983 00002000:00100000:1.0:1746066749.801398:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880098fbd180 x1830882983012864/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.801408:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882983012864 ext(4194304->5033983) 00002000:00010000:1.0:1746066749.801414:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:3.0:1746066749.808871:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367232:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066749.808934:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5da6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b5e expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.808948:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5da6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b5e expref: 24 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.808983:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6a00, rc 0) 00000100:00100000:3.0:1746066749.809045:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983012608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 11036us (11248us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066749.809053:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15464 00000100:00100000:0.0:1746066749.815789:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.817154:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983012992 00000100:00100000:3.0:1746066749.817165:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983012992 00000100:00100000:3.0:1746066749.817207:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15465 00000100:00100000:3.0:1746066749.817215:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+23:334:x1830882983012992:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066749.817233:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.817250:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b65 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.817280:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.817289:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.817296:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.817301:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.817303:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.817307:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1781760->2097151] (req 1781760->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.817333:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 24 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.817344:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 24 pid: 1893 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.817356:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.817453:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.817460:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 17 pid: 9591 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746066749.817469:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367488:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.817491:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 36 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.817498:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 36 pid: 1893 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.817506:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367616:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.817521:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.821351:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.821700:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983013120 00000100:00100000:2.0:1746066749.821709:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983013120 00000100:00100000:2.0:1746066749.821754:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15466 00000100:00100000:2.0:1746066749.821762:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:349:x1830882983013120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.821781:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.821799:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b6c expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.821827:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.821834:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.821835:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066749.821838:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.821865:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.821876:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 36 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066749.821919:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984367744:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.822003:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.823992:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096426300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367360:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.824004:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096426d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367488:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.824011:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984367616:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.824041:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1781760->2097151] (req 1781760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.824056:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7e00, rc 0) 00000100:00100000:3.0:1746066749.824089:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+26:334:x1830882983012992:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6874us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.824096:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15465 00000100:00100000:2.0:1746066749.824434:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984367744:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.824689:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.824698:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2800, rc 0) 00000100:00100000:2.0:1746066749.824728:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:349:x1830882983013120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2967us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.824733:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15466 00000100:00100000:0.0:1746066749.827077:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.827124:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.827268:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983013376 00000100:00100000:2.0:1746066749.827275:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983013376 00002000:00100000:2.0:1746066749.827315:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2916352->2936831) req@ffff880098fbf480 x1830882983013376/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.827326:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882983013376 ext(2916352->2936831) 00010000:00010000:2.0:1746066749.827334:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 37 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066749.827344:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 37 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066749.827351:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbf480 00000100:00100000:1.0:1746066749.827431:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983013248 00000100:00100000:1.0:1746066749.827435:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983013248 00010000:00010000:1.0:1746066749.827452:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1746066749.827471:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6898 00000100:00100000:1.0:1746066749.827478:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882983013248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.827491:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066749.827509:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746066749.827520:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746066749.827542:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa5cb8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aee expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746066749.827565:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066749.827599:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983013248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.827616:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6898 00000100:00100000:2.0:1746066749.828191:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 859 00000100:00100000:2.0:1746066749.828199:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983013376:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066749.828455:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.828468:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983013504 00000100:00100000:0.0:1746066749.828470:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983013504 00010000:00010000:0.0:1746066749.828485:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 25 pid: 1893 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066749.828498:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6899 00000100:00100000:0.0:1746066749.828502:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882983013504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066749.828508:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066749.828516:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 25 pid: 1893 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066749.828523:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 25 pid: 1893 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066749.828539:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa5c4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0aa1 expref: 25 pid: 1893 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066749.828553:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066749.828565:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983013504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 62us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066749.828571:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6899 00000100:00100000:0.0:1746066749.830559:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.831877:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983013632 00000100:00100000:3.0:1746066749.831897:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983013632 00010000:00010000:3.0:1746066749.831929:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 41 pid: 1893 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.832159:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6900 00000100:00100000:3.0:1746066749.832168:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983013632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.832182:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.832197:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 41 pid: 1893 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.832208:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 41 pid: 1893 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.832230:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa5c48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a9a expref: 41 pid: 1893 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.832248:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.832250:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.832257:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.832266:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.832299:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.832312:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984367872:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.833519:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066749.834242:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983013376:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6040us (7114us total) trans 21474841779 rc 0/0 00000100:00100000:2.0:1746066749.834255:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 859 00002000:00100000:2.0:1746066749.834265:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2916352->2936831) req@ffff880098fbf480 x1830882983013376/t21474841779(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/448 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.834275:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882983013376 ext(2916352->2936831) 00010000:00010000:2.0:1746066749.834284:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 39 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066749.834296:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 39 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066749.834303:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbf480 00000100:00100000:0.0:1746066749.836218:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.836418:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984367872:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.836440:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.836477:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983013632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4311us (5925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.836486:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6900 00000100:00100000:2.0:1746066749.836543:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983013888 00000100:00100000:2.0:1746066749.836549:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983013888 00002000:00100000:2.0:1746066749.836581:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1781760->1785855) req@ffff880098fbdc00 x1830882983013888/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.836590:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdc00 with x1830882983013888 ext(1781760->1785855) 00002000:00010000:2.0:1746066749.836594:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbdc00 00000100:00100000:2.0:1746066749.836621:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3984 00000100:00100000:2.0:1746066749.836627:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983013888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066749.836745:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983013888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 119us (533us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066749.836751:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3984 00002000:00100000:2.0:1746066749.836755:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1781760->1785855) req@ffff880098fbdc00 x1830882983013888/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066749.836768:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbdc00 with x1830882983013888 ext(1781760->1785855) 00002000:00010000:2.0:1746066749.836771:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbdc00 00000100:00100000:0.0:1746066749.840867:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.841054:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983014016 00000100:00100000:3.0:1746066749.841064:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983014016 00010000:00010000:3.0:1746066749.841104:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 38 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.841140:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6901 00000100:00100000:3.0:1746066749.841148:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983014016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.841162:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.841182:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 38 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.841193:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 38 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.841215:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009718c200/0xf1867c21abfa5d7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2916352->2936831) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b42 expref: 38 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.841250:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.841252:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.841260:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.841274:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.841308:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.841321:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984368000:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.841403:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.845622:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.845679:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983014144 00000100:00100000:2.0:1746066749.845688:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983014144 00000100:00100000:2.0:1746066749.845736:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15467 00000100:00100000:2.0:1746066749.845744:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:334:x1830882983014144:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066749.845762:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.845781:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b73 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.845810:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.845816:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.845818:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066749.845820:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->2805759] (req 2097152->2805759) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.845848:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.845859:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066749.845872:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984368128:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066749.846053:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.846136:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984368000:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.846155:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.846179:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983014016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5031us (5323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.846187:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6901 00000100:00100000:2.0:1746066749.849320:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984368128:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066749.849350:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->2805759] (req 2097152->2805759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.849367:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3000, rc 0) 00000100:00100000:2.0:1746066749.849405:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:334:x1830882983014144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3662us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066749.849414:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15467 00000100:00100000:0.0:1746066749.851195:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.851381:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983014400 00000100:00100000:3.0:1746066749.851389:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983014400 00002000:00100000:3.0:1746066749.851433:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800958ac700 x1830882983014400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.851444:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac700 with x1830882983014400 ext(2097152->4194303) 00010000:00010000:3.0:1746066749.851452:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.851465:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066749.851477:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958ac700 00000100:00100000:3.0:1746066749.851508:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 860 00000100:00100000:3.0:1746066749.851516:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983014400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.868626:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983014400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17087us (17414us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066749.868639:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 860 00002000:00100000:3.0:1746066749.868654:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800958ac700 x1830882983014400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.868664:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ac700 with x1830882983014400 ext(2097152->4194303) 00010000:00010000:3.0:1746066749.868675:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.868690:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066749.868697:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958ac700 00000100:00100000:0.0:1746066749.873753:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.875158:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983014656 00000100:00100000:3.0:1746066749.875168:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983014656 00002000:00100000:3.0:1746066749.875216:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958afb80 x1830882983014656/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.875226:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882983014656 ext(4194304->5033983) 00010000:00010000:3.0:1746066749.875234:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.875255:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066749.875262:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958afb80 00000100:00100000:3.0:1746066749.875295:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 861 00000100:00100000:3.0:1746066749.875303:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983014656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066749.876168:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.878124:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983014784 00000100:00100000:3.0:1746066749.878136:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983014784 00000100:00100000:3.0:1746066749.878192:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15468 00000100:00100000:3.0:1746066749.878199:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:349:x1830882983014784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.878218:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.878235:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b7a expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.878258:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.878260:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.878268:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.878283:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.878293:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76e00, rc 0) 00000100:00100000:3.0:1746066749.878346:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:349:x1830882983014784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 147us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.878356:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15468 00000100:00100000:1.0:1746066749.885210:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.885762:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882983014656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10457us (12017us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066749.885773:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 861 00002000:00100000:3.0:1746066749.885786:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958afb80 x1830882983014656/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.885796:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882983014656 ext(4194304->5033983) 00010000:00010000:3.0:1746066749.885806:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.885823:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066749.885830:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958afb80 00000100:00100000:3.0:1746066749.885855:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983015040 00000100:00100000:3.0:1746066749.885861:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983015040 00002000:00100000:3.0:1746066749.886237:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012e420e00 x1830882983015040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.886245:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420e00 with x1830882983015040 ext(3145728->4194303) 00010000:00010000:3.0:1746066749.886250:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.886259:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066749.886270:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e420e00 00000100:00100000:3.0:1746066749.886871:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 862 00000100:00100000:3.0:1746066749.886905:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983015040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066749.889087:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.891476:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983015168 00000100:00100000:3.0:1746066749.891490:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983015168 00010000:00010000:3.0:1746066749.891534:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 28 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.891584:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6902 00000100:00100000:3.0:1746066749.891592:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983015168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.891614:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.891633:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 28 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.891645:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 28 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.891668:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2800/0xf1867c21abfa5db4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b6c expref: 28 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.891699:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.891701:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.891708:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.891722:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.891755:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.891766:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984368256:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.891871:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.896129:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983015040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9238us (10917us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066749.896141:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 862 00002000:00100000:3.0:1746066749.896154:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012e420e00 x1830882983015040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.896164:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420e00 with x1830882983015040 ext(3145728->4194303) 00002000:00010000:3.0:1746066749.896177:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e420e00 00000100:00100000:3.0:1746066749.896996:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984368256:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066749.897016:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.897051:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882983015168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5458us (7971us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.897058:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6902 00000100:00100000:0.0:1746066749.901178:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.901275:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.901445:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983015296 00000100:00100000:2.0:1746066749.901455:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983015296 00000100:00100000:2.0:1746066749.901506:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15469 00000100:00100000:2.0:1746066749.901513:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983015296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.901532:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.901550:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa5dc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b81 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.901580:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa5dc9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b81 expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.901589:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa5dc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b81 expref: 26 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.901625:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2a00, rc 0) 00000100:00100000:2.0:1746066749.901669:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983015296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 156us (502us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066749.901674:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15469 00000100:00100000:3.0:1746066749.901833:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983015552 00000100:00100000:3.0:1746066749.901838:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983015552 00002000:00100000:3.0:1746066749.901865:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2801664->2805759) req@ffff8800958aea00 x1830882983015552/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.901880:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aea00 with x1830882983015552 ext(2801664->2805759) 00002000:00010000:3.0:1746066749.901998:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958aea00 00000100:00100000:3.0:1746066749.902012:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3985 00000100:00100000:3.0:1746066749.902018:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983015552:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066749.902127:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983015552:12345-192.168.204.16@tcp:3:cat.0 Request processed in 109us (853us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066749.902133:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3985 00002000:00100000:3.0:1746066749.902138:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2801664->2805759) req@ffff8800958aea00 x1830882983015552/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066749.902144:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aea00 with x1830882983015552 ext(2801664->2805759) 00002000:00010000:3.0:1746066749.902147:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958aea00 00000100:00100000:2.0:1746066749.907514:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066749.907818:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983015808 00000100:00100000:0.0:1746066749.907827:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983015808 00002000:00100000:0.0:1746066749.907870:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800945d5c00 x1830882983015808/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066749.907881:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5c00 with x1830882983015808 ext(4194304->5033983) 00002000:00010000:0.0:1746066749.907908:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5c00 00000100:00100000:0.0:1746066749.907935:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3986 00000100:00100000:0.0:1746066749.907942:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983015808:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066749.914942:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.915189:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983016064 00000100:00100000:3.0:1746066749.915200:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983016064 00000100:00100000:3.0:1746066749.915252:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5882 00000100:00100000:3.0:1746066749.915260:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:334:x1830882983016064:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066749.915471:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:334:x1830882983016064:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 211us (541us total) trans 8589936495 rc 0/0 00000100:00100000:3.0:1746066749.915478:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5882 00000100:00100000:0.0:1746066749.924635:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983015808:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16681us (17120us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066749.924646:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3986 00002000:00100000:0.0:1746066749.924659:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800945d5c00 x1830882983015808/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:155/0 lens 488/440 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066749.924669:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5c00 with x1830882983015808 ext(4194304->5033983) 00002000:00010000:0.0:1746066749.924676:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5c00 00000100:00100000:0.0:1746066749.929278:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.929357:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983016192 00000100:00100000:2.0:1746066749.929367:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983016192 00000100:00100000:2.0:1746066749.929472:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15470 00000100:00100000:2.0:1746066749.929482:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983016192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066749.929502:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066749.929520:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5dd0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b88 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066749.929553:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5dd0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b88 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.929563:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa5dd0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b88 expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066749.929774:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575be00, rc 0) 00000100:00100000:2.0:1746066749.930670:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983016192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1187us (1400us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066749.930677:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15470 00000100:00100000:0.0:1746066749.938822:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.938985:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066749.939019:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983016576 00000100:00100000:2.0:1746066749.939027:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983016576 00000100:00100000:3.0:1746066749.939284:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983016320 00000100:00100000:3.0:1746066749.939288:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983016320 00000100:00100000:3.0:1746066749.939313:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15471 00000100:00100000:3.0:1746066749.939320:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983016320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066749.939480:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.939498:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5dd7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b8f expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.939529:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5dd7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b8f expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.939539:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5dd7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b8f expref: 26 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066749.939558:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77a00, rc 0) 00000100:00100000:3.0:1746066749.939612:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983016320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 283us (792us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066749.939618:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15471 00000100:00100000:1.0:1746066749.940317:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16191 00000100:00100000:1.0:1746066749.940326:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:354:x1830882983016576:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066749.940340:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066749.940352:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096deb800/0xf1867c21abfa5dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b96 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.940439:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.940452:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.940458:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 38 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.940464:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.940489:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 38 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.940498:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 38 pid: 17253 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066749.940508:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984368384:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066749.940585:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.940591:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 14 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066749.940598:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984368512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066749.940622:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.944078:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.944083:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984368384:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066749.944093:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984368512:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066749.944122:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066749.944141:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.944159:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983016832 00000100:00100000:1.0:1746066749.944165:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983016832 00010000:00010000:1.0:1746066749.944195:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 15 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.944202:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983016704 00000100:00100000:3.0:1746066749.944206:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983016704 00000100:00100000:1.0:1746066749.944219:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6903 00010000:00010000:3.0:1746066749.944220:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 39 pid: 17253 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066749.944225:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983016832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066749.944236:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6904 00010000:00010000:1.0:1746066749.944237:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066749.944240:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882983016704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066749.944242:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 15 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.944245:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.944248:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 39 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066749.944250:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 15 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.944262:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 39 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066749.944360:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575a000/0xf1867c21abfa5d28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b1f expref: 15 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.944364:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017c00/0xf1867c21abfa5d6e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b3b expref: 39 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066749.944387:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.944391:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.944399:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.944405:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066749.944411:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066749.944414:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066749.944420:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066749.944617:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983016704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 374us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.944617:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983016832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 390us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066749.944624:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6903 00000100:00100000:3.0:1746066749.944628:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6904 00010000:00010000:1.0:1746066749.944642:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066749.944648:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066749.944666:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066749.944796:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096deb800/0xf1867c21abfa5dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 39 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.944807:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 38 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066749.944817:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066749.944819:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066749.944821:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096debe00, rc 0) 00000100:00100000:1.0:1746066749.944901:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:354:x1830882983016576:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4558us (5897us total) trans 8589936496 rc 0/0 00000100:00100000:1.0:1746066749.944908:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16191 00000100:00100000:0.0:1746066749.956171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.956276:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983016960 00000100:00100000:3.0:1746066749.956286:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983016960 00000100:00100000:3.0:1746066749.956334:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15472 00000100:00100000:3.0:1746066749.956342:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:354:x1830882983016960:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066749.956362:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066749.956379:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0b9d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.956412:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.956419:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.956421:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066749.956424:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->4186111] (req 3887104->4186111) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.956455:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.956467:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 24 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.956487:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984368640:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066749.956976:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066749.958125:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984368640:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066749.958150:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->4186111] (req 3887104->4186111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.958166:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77000, rc 0) 00000100:00100000:3.0:1746066749.958195:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:354:x1830882983016960:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1854us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.958203:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15472 00000100:00100000:0.0:1746066749.960005:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066749.960065:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983017088 00000100:00100000:3.0:1746066749.960074:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983017088 00010000:00010000:3.0:1746066749.960107:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066749.960144:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6905 00000100:00100000:3.0:1746066749.960152:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983017088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066749.960166:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066749.960190:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.960200:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.960229:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5dc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b7a expref: 25 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066749.960258:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.960260:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066749.960267:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.960276:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066749.960308:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066749.960320:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984368768:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066749.960438:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066749.962405:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.962460:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983017344 00000100:00100000:1.0:1746066749.962467:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983017344 00002000:00100000:1.0:1746066749.962503:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3887104->3891199) req@ffff880094304000 x1830882983017344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.962512:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304000 with x1830882983017344 ext(3887104->3891199) 00002000:00010000:1.0:1746066749.962517:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304000 00000100:00100000:1.0:1746066749.962547:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3987 00000100:00100000:1.0:1746066749.962553:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983017344:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066749.962924:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984368768:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066749.962929:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983017344:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 376us (530us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066749.962935:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3987 00002000:00100000:1.0:1746066749.962941:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3887104->3891199) req@ffff880094304000 x1830882983017344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746066749.962943:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746066749.962946:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304000 with x1830882983017344 ext(3887104->3891199) 00002000:00010000:1.0:1746066749.962949:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304000 00000100:00100000:3.0:1746066749.963726:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983017088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3572us (3726us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066749.963734:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6905 00000100:00100000:0.0:1746066749.967297:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066749.967409:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983017600 00000100:00100000:1.0:1746066749.967419:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983017600 00002000:00100000:1.0:1746066749.967467:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4182016->4186111) req@ffff880094307b80 x1830882983017600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/0 e 0 to 0 dl 1746066760 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.967477:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830882983017600 ext(4182016->4186111) 00002000:00010000:1.0:1746066749.967482:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:1.0:1746066749.967611:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3988 00000100:00100000:1.0:1746066749.967619:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882983017600:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066749.967777:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882983017600:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 157us (489us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066749.967784:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3988 00002000:00100000:1.0:1746066749.967789:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4182016->4186111) req@ffff880094307b80 x1830882983017600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:155/0 lens 488/4536 e 0 to 0 dl 1746066760 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066749.967796:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094307b80 with x1830882983017600 ext(4182016->4186111) 00002000:00010000:1.0:1746066749.967798:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094307b80 00000100:00100000:0.0:1746066750.044028:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.044069:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983017856 00000100:00100000:1.0:1746066750.044079:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983017856 00000100:00100000:1.0:1746066750.044160:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16192 00000100:00100000:1.0:1746066750.044170:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:358:x1830882983017856:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066750.044198:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.044216:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ba4 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.044296:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044309:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044323:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044336:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044341:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044346:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044441:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044449:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044454:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066750.044462:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066750.044528:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044534:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044539:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044544:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044548:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb8000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066750.044552:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044558:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044568:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066750.044570:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066750.044574:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044578:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044597:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044610:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044614:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044618:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb9000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066750.044619:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044623:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044627:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9800) 00010000:00010000:1.0:1746066750.044629:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066750.044631:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044638:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066750.044669:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.044678:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.044684:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.044686:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066750.044688:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9400, rc 0) 00000100:00100000:1.0:1746066750.044749:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:358:x1830882983017856:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 580us (734us total) trans 8589936497 rc 0/0 00000100:00100000:1.0:1746066750.044755:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16192 00000100:00080000:2.0:1746066750.044924:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066750.048242:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.048336:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983017984 00000100:00100000:3.0:1746066750.048347:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983017984 00000100:00100000:3.0:1746066750.048408:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15473 00000100:00100000:3.0:1746066750.048416:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:358:x1830882983017984:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066750.048437:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.048456:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bab expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.048487:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.048495:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.048501:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.048502:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.048505:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [757760->868351] (req 757760->868351) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.048534:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 37 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.048544:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 37 pid: 3528 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746066750.048555:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984368896:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.052305:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.052323:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 25 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.052342:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984369024:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.052985:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.053422:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.053488:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.053530:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983018112 00000100:00100000:1.0:1746066750.053538:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983018112 00000100:00100000:1.0:1746066750.053583:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983018240 00000100:00100000:1.0:1746066750.053586:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983018240 00000100:00100000:1.0:1746066750.053612:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15474 00000100:00100000:1.0:1746066750.053619:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983018112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.053636:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.053652:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e24 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bb2 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.053666:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15475 00000100:00100000:3.0:1746066750.053673:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983018240:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.053681:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.053690:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5e2b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bb9 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.053693:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984369152:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066750.053739:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.053834:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984368896:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.054994:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984369280:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066750.055067:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800962080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.055623:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984369024:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.055650:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [757760->868351] (req 757760->868351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.055669:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77a00, rc 0) 00000100:00100000:2.0:1746066750.055706:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:358:x1830882983017984:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7291us (7474us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.055713:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15473 00002000:00010000:1.0:1746066750.055816:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066749 -> 1746066750 00002000:00010000:1.0:1746066750.055819:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066749 -> 1746066750 00000100:00100000:1.0:1746066750.055836:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984369152:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066750.055859:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e24 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bb2 expref: 41 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.055869:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8000/0xf1867c21abfa5e24 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bb2 expref: 41 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.055898:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8000, rc 0) 00000100:00100000:1.0:1746066750.055930:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882983018112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2310us (2510us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.055935:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15474 00000100:00100000:0.0:1746066750.056852:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.056909:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983018368 00000100:00100000:2.0:1746066750.056916:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983018368 00010000:00010000:2.0:1746066750.056946:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 40 pid: 3528 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746066750.056958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.056988:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983018496 00000100:00100000:2.0:1746066750.056990:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983018496 00010000:00010000:2.0:1746066750.056999:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 25 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.057010:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6906 00000100:00100000:2.0:1746066750.057015:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6907 00000100:00100000:2.0:1746066750.057020:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983018496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066750.057020:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882983018368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066750.057030:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.057030:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.057043:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 25 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.057044:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 40 pid: 3528 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746066750.057051:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 25 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.057106:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 40 pid: 3528 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746066750.057126:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb4400/0xf1867c21abfa5d52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b34 expref: 25 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.057131:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5d98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b50 expref: 40 pid: 3528 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746066750.057142:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.057145:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.057152:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.057160:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.057169:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066750.057187:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.057195:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983018496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 174us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.057198:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984369408:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066750.057201:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6907 00000100:00100000:1.0:1746066750.057235:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.058410:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.058569:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983018752 00000100:00100000:0.0:1746066750.058574:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983018752 00000100:00100000:0.0:1746066750.058637:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16193 00000100:00100000:0.0:1746066750.058643:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:364:x1830882983018752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066750.058666:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.058682:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5e32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bc0 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.058751:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058762:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058771:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058783:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058788:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058793:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058941:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa5e47 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058950:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa5e47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.058956:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa5e47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066750.058964:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066750.059036:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.059046:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.059051:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.063046:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.063063:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc1e00 already unused, calling callback (ffffffffa0f1c690) 00000100:00100000:3.0:1746066750.063408:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984369280:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066750.063544:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5e2b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bb9 expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.063557:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa5e2b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bb9 expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.063572:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76e00, rc 0) 00000100:00100000:3.0:1746066750.063626:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983018240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9953us (10136us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066750.063635:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15475 00000100:00100000:1.0:1746066750.063998:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984369408:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066750.064017:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.064034:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983018368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7017us (7185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.064042:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6906 00010000:00010000:0.0:1746066750.064326:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064336:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064349:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066750.064352:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066750.064355:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064359:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064373:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064378:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064383:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064387:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066750.064390:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064394:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064399:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096476e00) 00010000:00010000:0.0:1746066750.064400:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066750.064402:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.064405:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5e40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.064561:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc1600/0xf1867c21abfa5e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc0 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.064573:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa5e47 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc0 expref: 18 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.064579:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.064580:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066750.064582:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0000, rc 0) 00000100:00100000:1.0:1746066750.064612:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:364:x1830882983018752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5969us (6204us total) trans 8589936498 rc 0/0 00000100:00100000:1.0:1746066750.064621:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16193 00000100:00100000:0.0:1746066750.067611:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.068296:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983019008 00000100:00100000:2.0:1746066750.068307:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983019008 00002000:00100000:2.0:1746066750.068366:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (757760->761855) req@ffff880094305180 x1830882983019008/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.068376:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830882983019008 ext(757760->761855) 00002000:00010000:2.0:1746066750.068384:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:2.0:1746066750.068415:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3989 00000100:00100000:2.0:1746066750.068426:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983019008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066750.068612:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983019008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 188us (1020us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066750.068621:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3989 00002000:00100000:2.0:1746066750.068626:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (757760->761855) req@ffff880094305180 x1830882983019008/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.068633:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305180 with x1830882983019008 ext(757760->761855) 00002000:00010000:2.0:1746066750.068636:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305180 00000100:00100000:0.0:1746066750.071538:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.073309:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.073346:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.073413:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983019264 00000100:00100000:2.0:1746066750.073483:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983019264 00000100:00100000:1.0:1746066750.073895:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983019392 00000100:00100000:1.0:1746066750.073900:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983019392 00000100:00100000:1.0:1746066750.073931:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 776 00000100:00100000:1.0:1746066750.073940:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983019392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.073957:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.073984:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0000/0xf1867c21abfa5e47 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc0 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.074000:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.074004:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.074047:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983019392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.074054:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 776 00000100:00100000:3.0:1746066750.075157:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983019520 00000100:00100000:3.0:1746066750.075166:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983019520 00000100:00100000:3.0:1746066750.075207:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15476 00000100:00100000:3.0:1746066750.075214:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:361:x1830882983019520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.075232:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.075249:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bc7 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.075281:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.075288:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.075290:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.075293:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.075323:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 23 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.075334:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 23 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.075344:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984369536:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.075565:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800962080c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066750.076053:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.076077:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983019776 00000100:00100000:1.0:1746066750.076080:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983019776 00002000:00100000:1.0:1746066750.076110:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (864256->868351) req@ffff88012e422680 x1830882983019776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.076120:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422680 with x1830882983019776 ext(864256->868351) 00010000:00010000:1.0:1746066750.076126:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.076136:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.076147:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e422680 00000100:00100000:1.0:1746066750.076450:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 863 00000100:00100000:1.0:1746066750.076458:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983019776:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066750.076585:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983019776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 128us (537us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066750.076591:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 863 00002000:00100000:1.0:1746066750.076597:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (864256->868351) req@ffff88012e422680 x1830882983019776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.076617:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422680 with x1830882983019776 ext(864256->868351) 00010000:00010000:1.0:1746066750.076622:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.076630:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.076636:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e422680 00000100:00100000:3.0:1746066750.078959:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5883 00000100:00100000:3.0:1746066750.078977:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:364:x1830882983019264:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066750.079584:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:364:x1830882983019264:12345-192.168.204.16@tcp:35:cat.0 Request processed in 612us (8054us total) trans 8589936499 rc 0/0 00000100:00100000:3.0:1746066750.079595:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5883 00000100:00100000:3.0:1746066750.081460:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984369536:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.081871:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.081916:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357aa00, rc 0) 00000100:00100000:3.0:1746066750.081974:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:361:x1830882983019520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6759us (8624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.081982:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15476 00000100:00100000:0.0:1746066750.082216:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.083356:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.083419:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983020288 00000100:00100000:3.0:1746066750.083427:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983020288 00000100:00100000:3.0:1746066750.083458:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5884 00000100:00100000:3.0:1746066750.083465:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:358:x1830882983020288:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066750.083681:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:358:x1830882983020288:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 215us (324us total) trans 8589936500 rc 0/0 00000100:00100000:3.0:1746066750.083687:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5884 00000100:00100000:0.0:1746066750.084212:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.084467:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983020032 00000100:00100000:2.0:1746066750.084472:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983020032 00002000:00100000:2.0:1746066750.084501:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (757760->868351) req@ffff880094306d80 x1830882983020032/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.084511:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830882983020032 ext(757760->868351) 00010000:00010000:2.0:1746066750.084518:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.084530:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 24 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.084536:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306d80 00000100:00100000:2.0:1746066750.084548:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 864 00000100:00100000:2.0:1746066750.084553:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983020032:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066750.086458:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983020416 00000100:00100000:3.0:1746066750.086469:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983020416 00000100:00100000:3.0:1746066750.086530:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15477 00000100:00100000:3.0:1746066750.086538:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983020416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.086554:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.086572:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa5e5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bce expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.086642:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984369664:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066750.086722:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.087366:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.088237:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983020544 00000100:00100000:2.0:1746066750.088243:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983020544 00000100:00100000:2.0:1746066750.088284:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15478 00000100:00100000:2.0:1746066750.088291:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983020544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.088303:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.088315:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa5e63 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bd5 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.088347:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984369792:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066750.088416:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.097083:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983020032:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 12515us (14854us total) trans 21474841780 rc 0/0 00000100:00100000:3.0:1746066750.097098:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 864 00002000:00100000:3.0:1746066750.097110:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (757760->868351) req@ffff880094306d80 x1830882983020032/t21474841780(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.097121:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306d80 with x1830882983020032 ext(757760->868351) 00010000:00010000:3.0:1746066750.097132:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.097147:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066750.097153:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094306d80 00002000:00010000:3.0:1746066750.098465:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066750 -> 1746066751 00002000:00010000:3.0:1746066750.098471:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746066750 -> 1746066751 00000100:00100000:3.0:1746066750.098490:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984369664:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066750.098523:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa5e5c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bce expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.098535:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6200/0xf1867c21abfa5e5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bce expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.098545:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6200, rc 0) 00000100:00100000:3.0:1746066750.098580:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983020416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 12043us (14368us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066750.098591:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15477 00002000:00010000:3.0:1746066750.101763:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066750 -> 1746066751 00000100:00100000:3.0:1746066750.101790:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984369792:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066750.101820:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa5e63 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bd5 expref: 27 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.101832:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa5e63 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bd5 expref: 27 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.101842:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b600, rc 0) 00000100:00100000:3.0:1746066750.103659:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983020544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 15361us (16288us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066750.103669:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15478 00000100:00100000:1.0:1746066750.104490:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.104553:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983020672 00000100:00100000:2.0:1746066750.104560:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983020672 00010000:00010000:2.0:1746066750.104590:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.104632:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6908 00000100:00100000:2.0:1746066750.104637:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882983020672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066750.104649:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.104665:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.104675:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.104694:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db77a00/0xf1867c21abfa5e1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 757760->868351) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bab expref: 26 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.104714:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.104716:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.104724:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.104731:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.104758:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 37 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.104769:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984369920:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066750.105573:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.107726:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984369920:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066750.107752:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.107797:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983020672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3158us (3307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.107806:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6908 00000100:00100000:0.0:1746066750.109087:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.109337:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983020928 00000100:00100000:3.0:1746066750.109344:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983020928 00000100:00100000:3.0:1746066750.109396:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15479 00000100:00100000:3.0:1746066750.109403:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:364:x1830882983020928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.109422:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.109442:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bdc expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.109467:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.109470:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.109478:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.109498:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 26 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.109508:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6a00, rc 0) 00000100:00100000:3.0:1746066750.109551:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:364:x1830882983020928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 148us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.109556:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15479 00000100:00100000:2.0:1746066750.110404:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.110465:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983021184 00000100:00100000:3.0:1746066750.110470:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983021184 00002000:00100000:3.0:1746066750.110498:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d7480 x1830882983021184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.110508:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7480 with x1830882983021184 ext(0->1048575) 00002000:00010000:3.0:1746066750.110512:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d7480 00000100:00100000:3.0:1746066750.110536:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3990 00000100:00100000:3.0:1746066750.110542:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983021184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.119160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.119199:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.119231:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983021440 00000100:00100000:0.0:1746066750.119236:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.119241:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983021440 00002000:00100000:2.0:1746066750.119291:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009d8cad80 x1830882983021440/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.119300:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8cad80 with x1830882983021440 ext(0->1048575) 00002000:00010000:2.0:1746066750.119305:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8cad80 00000100:00100000:1.0:1746066750.119311:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983021824 00000100:00100000:1.0:1746066750.119314:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983021824 00000100:00100000:2.0:1746066750.119325:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3991 00000100:00100000:2.0:1746066750.119335:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983021568 00000100:00100000:2.0:1746066750.119336:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983021568 00002000:00100000:2.0:1746066750.119347:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1781759) req@ffff88009d8c9500 x1830882983021568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066750.119348:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16194 00002000:00100000:2.0:1746066750.119354:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9500 with x1830882983021568 ext(1048576->1781759) 00000100:00100000:1.0:1746066750.119354:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:368:x1830882983021824:12345-192.168.204.16@tcp:101:lfs.0 00002000:00010000:2.0:1746066750.119357:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9500 00000100:00100000:2.0:1746066750.119366:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3992 00000100:00100000:2.0:1746066750.119370:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983021568:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066750.119376:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.119392:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5e71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0be3 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.119446:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119458:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119467:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119480:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119484:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119488:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119556:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119566:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 37 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.119572:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.119614:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 37 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.119629:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 37 pid: 17253 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.119645:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984370048:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066750.119721:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000100:00080000:0.0:1746066750.119897:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066750.119935:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983021440:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066750.124590:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983021184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14034us (14174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066750.124613:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3990 00002000:00100000:2.0:1746066750.124626:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d7480 x1830882983021184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.124635:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7480 with x1830882983021184 ext(0->1048575) 00002000:00010000:2.0:1746066750.124641:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d7480 00000100:00100000:1.0:1746066750.124900:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984370048:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066750.124928:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:2.0:1746066750.127464:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.127548:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983021952 00000100:00100000:0.0:1746066750.127557:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983021952 00010000:00010000:0.0:1746066750.127614:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 38 pid: 17253 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066750.127655:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6909 00000100:00100000:0.0:1746066750.127663:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983021952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066750.127677:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066750.127682:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 38 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.127693:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 38 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.127716:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa5de5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b96 expref: 38 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.127736:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066750.127742:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.127751:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.127758:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.127778:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066750.127833:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882983021952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 170us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.127840:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6909 00010000:00010000:1.0:1746066750.127923:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.127931:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066750.127985:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066750.127989:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066750.128007:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128016:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128027:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128033:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128038:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128044:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128052:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb9000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066750.128056:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128062:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128070:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066750.128073:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066750.128076:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128080:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9000/0xf1867c21abfa5e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128093:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128097:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128102:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128105:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb9e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066750.128107:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128112:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128117:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9000) 00010000:00010000:1.0:1746066750.128119:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066750.128122:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128126:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5e7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.128159:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5e71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.128170:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 10 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.128176:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.128178:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00080000:2.0:1746066750.128451:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746066750.128526:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8800, rc 0) 00000100:00100000:1.0:1746066750.130812:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:368:x1830882983021824:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 11445us (11562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.130824:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16194 00000100:00100000:3.0:1746066750.131788:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983021568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12414us (12585us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746066750.131798:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3992 00002000:00100000:3.0:1746066750.131809:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1781759) req@ffff88009d8c9500 x1830882983021568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.131818:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9500 with x1830882983021568 ext(1048576->1781759) 00002000:00010000:3.0:1746066750.131824:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9500 00000100:00100000:3.0:1746066750.131912:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983021440:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12579us (12763us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066750.131919:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3991 00002000:00100000:3.0:1746066750.131924:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009d8cad80 x1830882983021440/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.131931:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8cad80 with x1830882983021440 ext(0->1048575) 00002000:00010000:3.0:1746066750.131934:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8cad80 00000100:00100000:0.0:1746066750.140233:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.140520:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.140566:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.140697:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983022208 00000100:00100000:1.0:1746066750.140707:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983022208 00000100:00100000:1.0:1746066750.140758:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983022080 00000100:00100000:1.0:1746066750.140760:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983022080 00000100:00100000:1.0:1746066750.140770:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983022336 00000100:00100000:1.0:1746066750.140772:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983022336 00000100:00100000:1.0:1746066750.140786:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15480 00000100:00100000:1.0:1746066750.140794:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983022208:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066750.140816:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.140836:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa5e8d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bf1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746066750.140854:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066750.140932:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15481 00000100:00100000:1.0:1746066750.142375:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984370176:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066750.142739:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15482 00000100:00100000:3.0:1746066750.142753:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2014:x1830882983022336:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066750.142770:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.142787:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5e94 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bf8 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.142799:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.142828:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984370304:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066750.142870:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882983022080:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066750.142907:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.142919:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bea expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.142933:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.142936:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.142947:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.142964:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.142976:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc1e00, rc 0) 00000100:00100000:0.0:1746066750.143041:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2014:x1830882983022080:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 175us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.143047:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15481 00000100:00100000:0.0:1746066750.143071:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983022464 00000100:00100000:0.0:1746066750.143078:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983022464 00000100:00100000:0.0:1746066750.143118:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15483 00000100:00100000:0.0:1746066750.143124:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:361:x1830882983022464:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066750.143248:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00010000:00010000:0.0:1746066750.143337:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.143345:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0bff expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.143361:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00010000:00010000:0.0:1746066750.143363:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.143371:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066750.143372:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066750.143376:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.143398:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.143411:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 25 pid: 3528 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066750.143421:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984370432:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066750.143459:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.147146:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984370432:192.168.204.16@tcp:104: 00002000:00010000:1.0:1746066750.147297:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066750 -> 1746066751 00002000:00010000:1.0:1746066750.147302:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066750 -> 1746066751 00002000:00010000:1.0:1746066750.147304:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066750 -> 1746066751 00000100:00100000:1.0:1746066750.147327:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984370176:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066750.147354:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa5e8d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bf1 expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.147369:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa5e8d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bf1 expref: 21 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.147416:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8200, rc 0) 00000100:00100000:1.0:1746066750.147479:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2014:x1830882983022208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6681us (7252us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.147488:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15480 00000100:00100000:2.0:1746066750.147562:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.147916:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984370304:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066750.147940:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5e94 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bf8 expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.147950:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7c00/0xf1867c21abfa5e94 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bf8 expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.147974:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7c00, rc 0) 00000100:00100000:3.0:1746066750.148013:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882983022336:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5263us (7444us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066750.148019:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15482 00010000:00010000:0.0:1746066750.148128:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.148145:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0200, rc 0) 00000100:00100000:0.0:1746066750.148180:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:361:x1830882983022464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5045us (5370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.148185:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15483 00000100:00100000:3.0:1746066750.148792:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983022592 00000100:00100000:3.0:1746066750.148800:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983022592 00002000:00100000:3.0:1746066750.148848:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1781760->2097151) req@ffff8800945d7100 x1830882983022592/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.148858:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7100 with x1830882983022592 ext(1781760->2097151) 00010000:00010000:3.0:1746066750.148865:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 26 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.148878:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 26 pid: 3528 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066750.148910:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800945d7100 00000100:00100000:3.0:1746066750.148954:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 865 00000100:00100000:3.0:1746066750.148964:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882983022592:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066750.150143:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.150664:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983022848 00000100:00100000:1.0:1746066750.150673:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983022848 00000100:00100000:1.0:1746066750.150742:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16195 00000100:00100000:1.0:1746066750.150752:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:368:x1830882983022848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066750.150771:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.150792:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9c00/0xf1867c21abfa5ea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c06 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.151042:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.151061:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.151069:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.151106:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.151118:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 11 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.151131:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984370560:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066750.151255:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.151579:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.151637:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983023104 00000100:00100000:3.0:1746066750.151642:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983023104 00002000:00100000:3.0:1746066750.151668:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2805760->3145727) req@ffff8800945d7800 x1830882983023104/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.151676:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7800 with x1830882983023104 ext(2805760->3145727) 00002000:00010000:3.0:1746066750.151681:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d7800 00000100:00100000:3.0:1746066750.151703:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3993 00000100:00100000:3.0:1746066750.151709:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983023104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066750.152940:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984370560:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066750.152962:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066750.154235:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983022592:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5264us (6666us total) trans 21474841781 rc 0/0 00000100:00100000:0.0:1746066750.154245:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 865 00002000:00100000:0.0:1746066750.154259:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1781760->2097151) req@ffff8800945d7100 x1830882983022592/t21474841781(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.154267:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7100 with x1830882983022592 ext(1781760->2097151) 00010000:00010000:0.0:1746066750.154278:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 30 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.154290:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 30 pid: 3528 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746066750.154296:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800945d7100 00000100:00100000:1.0:1746066750.154427:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.155367:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983023232 00000100:00100000:0.0:1746066750.155376:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983023232 00010000:00010000:0.0:1746066750.155411:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066750.155461:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6910 00000100:00100000:0.0:1746066750.155470:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983023232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066750.155487:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066750.155496:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.155506:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.155532:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5e86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0be3 expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.155557:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066750.155563:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.155575:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.155582:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.155615:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066750.155651:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983023232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 180us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.155657:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6910 00010000:00010000:1.0:1746066750.155937:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.155945:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066750.155966:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066750.156110:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9c00/0xf1867c21abfa5ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.156138:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.156145:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.156148:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066750.156150:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9a00, rc 0) 00000100:00100000:1.0:1746066750.156192:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:368:x1830882983022848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5440us (6049us total) trans 8589936501 rc 0/0 00000100:00100000:1.0:1746066750.156198:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16195 00000100:00100000:3.0:1746066750.156376:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983023104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4664us (4793us total) trans 0 rc 339968/339968 00000100:00100000:3.0:1746066750.156384:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3993 00002000:00100000:3.0:1746066750.156395:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2805760->3145727) req@ffff8800945d7800 x1830882983023104/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 339968/339968 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.156403:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d7800 with x1830882983023104 ext(2805760->3145727) 00002000:00010000:3.0:1746066750.156408:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d7800 00000100:00100000:0.0:1746066750.158627:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.158749:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.158810:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983023488 00000100:00100000:2.0:1746066750.158819:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983023488 00000100:00100000:2.0:1746066750.158873:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16196 00000100:00100000:2.0:1746066750.158881:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:368:x1830882983023488:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066750.158933:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983023360 00010000:00010000:2.0:1746066750.158934:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066750.158938:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983023360 00010000:00010000:2.0:1746066750.158951:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575aa00/0xf1867c21abfa5ebe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c0d expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.158956:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 28 pid: 3528 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.158976:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6911 00000100:00100000:1.0:1746066750.158981:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983023360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.158992:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.159011:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 28 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.159022:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 28 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.159040:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5dad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1781760->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b65 expref: 28 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.159042:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.159057:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.159060:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.159062:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.159063:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.159069:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.159076:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.159091:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.159097:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 38 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.159106:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.159109:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984370816:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066750.159114:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984370688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066750.159181:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.159185:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.160856:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.162039:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983023616 00000100:00100000:2.0:1746066750.162048:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983023616 00000100:00100000:2.0:1746066750.162101:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15484 00000100:00100000:2.0:1746066750.162108:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:364:x1830882983023616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.162126:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.162145:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c14 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.162171:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.162178:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066750.162180:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066750.162183:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.162207:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.162216:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 38 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.162231:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984370944:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.162310:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.165322:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.165350:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983023744 00000100:00100000:0.0:1746066750.165358:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983023744 00010000:00010000:0.0:1746066750.165391:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 13 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066750.165435:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6912 00000100:00100000:0.0:1746066750.165443:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983023744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066750.165456:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066750.165463:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 13 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.165473:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 13 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.165503:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066750.165508:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.165517:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.165524:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.165540:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066750.165578:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983023744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 136us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.165584:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6912 00000100:00100000:0.0:1746066750.165676:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.165706:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.165722:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983023872 00000100:00100000:0.0:1746066750.165725:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983023872 00002000:00100000:0.0:1746066750.165759:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3887104->4186111) req@ffff88009d8c8000 x1830882983023872/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.165768:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8000 with x1830882983023872 ext(3887104->4186111) 00010000:00010000:0.0:1746066750.165775:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 39 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.165786:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 39 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746066750.165791:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d8c8000 00000100:00100000:0.0:1746066750.165802:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983024128 00000100:00100000:0.0:1746066750.165805:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983024128 00002000:00100000:0.0:1746066750.165814:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d8caa00 x1830882983024128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.165820:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8caa00 with x1830882983024128 ext(1048576->2097151) 00002000:00010000:0.0:1746066750.165823:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8caa00 00000100:00100000:0.0:1746066750.165834:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 866 00000100:00100000:0.0:1746066750.165839:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983023872:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066750.166186:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3994 00000100:00100000:3.0:1746066750.166194:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882983024128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066750.167007:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984370944:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.167035:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.167048:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8a00, rc 0) 00000100:00100000:2.0:1746066750.167070:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+29:364:x1830882983023616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4963us (6219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.167076:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15484 00010000:00010000:2.0:1746066750.167117:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5eb0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c06 expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.167132:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984370688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.167143:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.167149:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.167154:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066750.167201:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066750.167204:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066750.167218:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.167246:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575aa00/0xf1867c21abfa5ebe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.167253:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.167259:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066750.167262:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066750.167264:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575a800, rc 0) 00000100:00100000:2.0:1746066750.167278:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:368:x1830882983023488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 8399us (8530us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.167283:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16196 00000100:00100000:1.0:1746066750.167445:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984370816:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066750.167456:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.167475:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983023360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8494us (8886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.167481:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6911 00000100:00100000:2.0:1746066750.174116:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983023872:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7659us (7822us total) trans 21474841782 rc 0/0 00000100:00100000:2.0:1746066750.174131:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 866 00002000:00100000:2.0:1746066750.174146:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3887104->4186111) req@ffff88009d8c8000 x1830882983023872/t21474841782(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.174155:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8000 with x1830882983023872 ext(3887104->4186111) 00010000:00010000:2.0:1746066750.174166:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 43 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.174180:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 43 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.174187:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d8c8000 00000100:00100000:0.0:1746066750.176993:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.177821:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882983024128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11621us (12105us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066750.177834:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3994 00002000:00100000:3.0:1746066750.177848:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d8caa00 x1830882983024128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.177858:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8caa00 with x1830882983024128 ext(1048576->2097151) 00002000:00010000:3.0:1746066750.177866:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8caa00 00000100:00100000:1.0:1746066750.178045:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983024256 00000100:00100000:1.0:1746066750.178060:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983024256 00010000:00010000:1.0:1746066750.178106:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 41 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.178151:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6913 00000100:00100000:1.0:1746066750.178160:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983024256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.178179:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.178201:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 41 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.178215:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 41 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.178243:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db77000/0xf1867c21abfa5df3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3887104->18446744073709551615] (req 3887104->4186111) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b9d expref: 41 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.178264:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.178267:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.178277:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.178288:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.178339:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.178357:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984371072:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.178441:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009e0e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.178786:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.178860:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.179156:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983024384 00000100:00100000:2.0:1746066750.179162:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983024384 00000100:00100000:2.0:1746066750.179203:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983024512 00000100:00100000:2.0:1746066750.179205:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983024512 00000100:00100000:2.0:1746066750.179218:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15485 00000100:00100000:2.0:1746066750.179224:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882983024384:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066750.179242:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.179256:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c1b expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.179274:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.179276:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.179281:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.179294:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.179305:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9e00, rc 0) 00000100:00100000:2.0:1746066750.179336:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882983024384:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 112us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.179341:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15485 00000100:00100000:2.0:1746066750.179358:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15486 00000100:00100000:2.0:1746066750.179362:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983024512:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066750.179367:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.179374:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa5eda lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c22 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.179390:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa5eda lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c22 expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.179398:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa5eda lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c22 expref: 20 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.179408:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8200, rc 0) 00000100:00100000:2.0:1746066750.179424:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983024512:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 62us (565us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.179428:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15486 00000100:00100000:1.0:1746066750.182962:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984371072:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066750.182987:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.183041:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882983024256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4881us (6054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.183052:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6913 00000100:00100000:0.0:1746066750.183629:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.183758:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983024640 00000100:00100000:3.0:1746066750.183766:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983024640 00000100:00100000:3.0:1746066750.183805:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15487 00000100:00100000:3.0:1746066750.183811:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:361:x1830882983024640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.183830:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.183848:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c29 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066750.184111:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.184152:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983024896 00000100:00100000:2.0:1746066750.184157:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983024896 00002000:00100000:2.0:1746066750.184185:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009c7fdc00 x1830882983024896/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.184195:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fdc00 with x1830882983024896 ext(3145728->4194303) 00002000:00010000:2.0:1746066750.184199:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fdc00 00000100:00100000:2.0:1746066750.184212:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3995 00000100:00100000:2.0:1746066750.184216:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983024896:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066750.185765:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.185773:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.185775:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.185779:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.185815:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.185827:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 29 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.185840:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984371200:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.185926:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.185977:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.186059:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983025152 00000100:00100000:3.0:1746066750.186065:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983025152 00000100:00100000:3.0:1746066750.186102:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16197 00000100:00100000:3.0:1746066750.186107:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:368:x1830882983025152:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066750.186121:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.186136:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa5ee8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c30 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.186236:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186249:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186260:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186271:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186277:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186283:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186288:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f9d400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066750.186291:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186297:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186308:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066750.186310:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066750.186314:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186318:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9d400/0xf1867c21abfa5eef lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.186348:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa5ee8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c30 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.186354:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa5ee8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c30 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.186360:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9ca00, rc 0) 00000100:00100000:3.0:1746066750.186385:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:368:x1830882983025152:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 278us (409us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066750.186391:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16197 00000100:00100000:2.0:1746066750.190839:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983024896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6608us (6714us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066750.190852:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3995 00002000:00100000:2.0:1746066750.190864:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009c7fdc00 x1830882983024896/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.190874:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fdc00 with x1830882983024896 ext(3145728->4194303) 00002000:00010000:2.0:1746066750.190880:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fdc00 00000100:00100000:0.0:1746066750.191560:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.191632:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983025536 00000100:00100000:1.0:1746066750.191641:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983025536 00000100:00100000:1.0:1746066750.191690:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5885 00000100:00100000:1.0:1746066750.191698:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:368:x1830882983025536:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066750.191727:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984371200:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.191755:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.191770:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a7e00, rc 0) 00000100:00100000:3.0:1746066750.191796:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:361:x1830882983024640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7985us (8168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.191803:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15487 00000100:00100000:0.0:1746066750.191860:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.191967:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983025280 00000100:00100000:3.0:1746066750.191970:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983025280 00002000:00100000:3.0:1746066750.191989:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2805759) req@ffff88009c7fd880 x1830882983025280/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.191996:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fd880 with x1830882983025280 ext(2097152->2805759) 00010000:00010000:3.0:1746066750.192002:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 28 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.192013:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 28 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066750.192019:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7fd880 00000100:00100000:3.0:1746066750.192355:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 867 00000100:00100000:3.0:1746066750.192361:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983025280:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066750.192539:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:368:x1830882983025536:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 840us (979us total) trans 8589936502 rc 0/0 00000100:00100000:1.0:1746066750.192545:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5885 00000100:00100000:0.0:1746066750.197090:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.197184:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983025664 00000100:00100000:3.0:1746066750.197194:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983025664 00000100:00100000:3.0:1746066750.197237:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15488 00000100:00100000:3.0:1746066750.197245:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983025664:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.197265:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.197285:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c37 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.197309:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.197311:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.197320:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.197336:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.197347:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9c200, rc 0) 00000100:00100000:3.0:1746066750.197406:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882983025664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 161us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.197413:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15488 00000100:00100000:0.0:1746066750.197962:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.197980:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983025792 00000100:00100000:0.0:1746066750.197982:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983025792 00000100:00100000:0.0:1746066750.198011:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15489 00000100:00100000:0.0:1746066750.198016:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882983025792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066750.198023:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.198031:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5efd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c3e expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.198050:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5efd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c3e expref: 32 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.198059:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0c00/0xf1867c21abfa5efd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c3e expref: 32 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.198076:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0c00, rc 0) 00000100:00100000:0.0:1746066750.198092:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882983025792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (131us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066750.198097:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15489 00000100:00100000:0.0:1746066750.201344:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983025280:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8974us (9475us total) trans 21474841783 rc 0/0 00000100:00100000:0.0:1746066750.201358:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 867 00002000:00100000:0.0:1746066750.201370:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2805759) req@ffff88009c7fd880 x1830882983025280/t21474841783(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.201378:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fd880 with x1830882983025280 ext(2097152->2805759) 00010000:00010000:0.0:1746066750.201387:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 31 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.201402:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 31 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746066750.201409:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c7fd880 00000100:00100000:0.0:1746066750.204955:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.205095:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983026048 00000100:00100000:2.0:1746066750.205103:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983026048 00002000:00100000:2.0:1746066750.205137:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009c7fc000 x1830882983026048/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.205146:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc000 with x1830882983026048 ext(4194304->5033983) 00002000:00010000:2.0:1746066750.205150:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc000 00000100:00100000:2.0:1746066750.205166:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3996 00000100:00100000:2.0:1746066750.205173:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983026048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.205736:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.206118:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983026176 00000100:00100000:1.0:1746066750.206122:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983026176 00010000:00010000:1.0:1746066750.206143:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 33 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.206184:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6914 00000100:00100000:1.0:1746066750.206191:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+33:2014:x1830882983026176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.206203:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066750.206213:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066750 -> 1746066751 00010000:00010000:1.0:1746066750.206218:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 33 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.206229:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 33 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.206253:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3000/0xf1867c21abfa5dbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2805759) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b73 expref: 33 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.206298:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.206300:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.206309:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.206317:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.206416:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066750.206433:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984371328:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066750.206486:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.212281:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984371328:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066750.212299:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.212547:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882983026176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6354us (6810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.212556:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6914 00000100:00100000:3.0:1746066750.212723:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983026048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7548us (7771us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066750.212730:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3996 00002000:00100000:3.0:1746066750.212738:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009c7fc000 x1830882983026048/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.212747:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc000 with x1830882983026048 ext(4194304->5033983) 00002000:00010000:3.0:1746066750.212752:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc000 00000100:00100000:0.0:1746066750.218112:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.218418:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983026304 00000100:00100000:2.0:1746066750.218426:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983026304 00000100:00100000:2.0:1746066750.218467:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15490 00000100:00100000:2.0:1746066750.218474:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983026304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.218489:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.218503:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c45 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.218523:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.218524:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.218531:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.218543:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.218553:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70c00, rc 0) 00000100:00100000:2.0:1746066750.218606:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882983026304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 123us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.218612:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15490 00000100:00100000:0.0:1746066750.220058:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.220267:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983026560 00000100:00100000:3.0:1746066750.220273:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983026560 00002000:00100000:3.0:1746066750.220305:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009d9b3480 x1830882983026560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.220318:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882983026560 ext(2097152->4194303) 00002000:00010000:3.0:1746066750.220323:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b3480 00000100:00100000:3.0:1746066750.220341:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3997 00000100:00100000:3.0:1746066750.220347:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983026560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.220669:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.220732:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983026816 00000100:00100000:2.0:1746066750.220737:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983026816 00000100:00100000:2.0:1746066750.220774:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16198 00000100:00100000:2.0:1746066750.220780:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+19:371:x1830882983026816:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066750.220794:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.220807:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70400/0xf1867c21abfa5f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c4c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.220863:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.220874:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.220913:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.220926:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.220931:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.220936:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221023:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221032:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221038:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066750.221045:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066750.221100:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221105:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221110:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221115:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221121:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d70000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066750.221124:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221130:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221138:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066750.221141:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066750.221144:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221152:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70000/0xf1867c21abfa5f12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221171:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221175:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221179:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221183:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d71a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066750.221185:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221189:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221195:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5e80f00) 00010000:00010000:2.0:1746066750.221196:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066750.221198:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221202:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71a00/0xf1867c21abfa5f19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.221229:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70400/0xf1867c21abfa5f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 22 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.221238:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 21 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.221247:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066750.221249:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066750.221251:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71800, rc 0) 00000100:00100000:2.0:1746066750.221293:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+21:371:x1830882983026816:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 513us (624us total) trans 8589936503 rc 0/0 00000100:00100000:2.0:1746066750.221299:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16198 00000100:00100000:0.0:1746066750.235813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.236309:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983026944 00000100:00100000:2.0:1746066750.236316:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983026944 00000100:00100000:2.0:1746066750.236363:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15491 00000100:00100000:2.0:1746066750.236373:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:371:x1830882983026944:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066750.236388:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.236403:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c53 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.236432:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.236439:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.236445:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 15 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.236451:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.236452:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.236455:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2424832->2547711] (req 2424832->2547711) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.236478:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 15 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.236487:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 15 pid: 3528 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746066750.236496:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371456:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.237224:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 17 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.237232:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 17 pid: 9591 timeout: 818 lvb_type: 1 00000100:00100000:2.0:1746066750.237240:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371584:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.238257:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.238267:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 28 pid: 3528 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.238276:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371712:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.238320:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.242666:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371456:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.242678:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371584:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.243773:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983026560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23423us (23719us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066750.243782:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3997 00002000:00100000:2.0:1746066750.243792:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009d9b3480 x1830882983026560/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.243800:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3480 with x1830882983026560 ext(2097152->4194303) 00002000:00010000:2.0:1746066750.243805:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b3480 00000100:00100000:1.0:1746066750.243897:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.243932:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.244167:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983027200 00000100:00100000:2.0:1746066750.244167:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983027072 00000100:00100000:3.0:1746066750.244172:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983027200 00000100:00100000:2.0:1746066750.244172:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983027072 00010000:00010000:3.0:1746066750.244201:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746066750.244201:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 16 pid: 3528 timeout: 818 lvb_type: 1 00000100:00080000:0.0:1746066750.244215:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066750.244229:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6915 00000100:00100000:3.0:1746066750.244232:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6916 00000100:00100000:2.0:1746066750.244235:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983027072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066750.244236:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983027200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.244245:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.244245:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.244257:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746066750.244257:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 16 pid: 3528 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.244266:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746066750.244333:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 16 pid: 3528 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.244351:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1800/0xf1867c21abfa5cbf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0afc expref: 18 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:2.0:1746066750.244355:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa5c79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0acb expref: 16 pid: 3528 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.244408:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066750.244408:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.244428:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983027200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 191us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.244428:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983027072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 193us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.244433:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6915 00000100:00100000:3.0:1746066750.244436:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6916 00000100:00100000:0.0:1746066750.247555:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.247634:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371712:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.247667:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2424832->2547711] (req 2424832->2547711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.247681:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70400, rc 0) 00000100:00100000:3.0:1746066750.247710:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:371:x1830882983026944:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11338us (11905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.247717:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15491 00000100:00100000:1.0:1746066750.247917:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983027328 00000100:00100000:1.0:1746066750.247923:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983027328 00010000:00010000:1.0:1746066750.247945:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 29 pid: 3528 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.247976:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6917 00000100:00100000:1.0:1746066750.247982:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983027328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.247993:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.248008:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 29 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.248018:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 29 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.248036:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14000/0xf1867c21abfa5c72 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ac4 expref: 29 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.248064:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.248066:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.248072:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 13 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.248078:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 13 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.248102:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 13 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.248112:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984371840:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.248178:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.248844:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.248918:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983027456 00000100:00100000:3.0:1746066750.248922:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983027456 00000100:00100000:3.0:1746066750.248943:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15492 00000100:00100000:3.0:1746066750.248949:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:361:x1830882983027456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.248959:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.248970:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c5a expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.248987:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 13 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.248994:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.248995:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.248997:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.249014:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 13 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.249023:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 13 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.249032:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371968:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.249169:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.249801:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.250385:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983027584 00000100:00100000:0.0:1746066750.250394:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983027584 00000100:00100000:0.0:1746066750.250432:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15493 00000100:00100000:0.0:1746066750.250524:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:366:x1830882983027584:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066750.250533:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.250543:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c61 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.250559:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.250566:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 30 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.250571:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.250581:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066750.250582:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066750.250585:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3645440->4194303] (req 3645440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.250593:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066750.250611:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.250619:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 30 pid: 11630 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.250621:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983027840 00000100:00100000:2.0:1746066750.250624:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983027840 00000100:00100000:0.0:1746066750.250628:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984372096:192.168.204.16@tcp:104: 00002000:00100000:2.0:1746066750.250647:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2424832->2428927) req@ffff8800945d4e00 x1830882983027840/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.250656:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4e00 with x1830882983027840 ext(2424832->2428927) 00010000:00010000:2.0:1746066750.250666:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.250674:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984371840:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066750.250676:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.250682:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800945d4e00 00010000:00010000:1.0:1746066750.250689:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.250696:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 868 00000100:00100000:2.0:1746066750.250701:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983027840:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066750.250753:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984371968:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.250765:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.250774:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b39200, rc 0) 00010000:00010000:0.0:1746066750.250822:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 30 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.250829:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 30 pid: 9592 timeout: 818 lvb_type: 1 00000100:00100000:0.0:1746066750.250837:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984372224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066750.251188:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983027328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3205us (3637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.251190:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:361:x1830882983027456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2240us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.251193:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983027840:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 491us (600us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066750.251196:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15492 00000100:00100000:1.0:1746066750.251196:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6917 00000100:00100000:2.0:1746066750.251200:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 868 00002000:00100000:2.0:1746066750.251205:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2424832->2428927) req@ffff8800945d4e00 x1830882983027840/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.251211:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4e00 with x1830882983027840 ext(2424832->2428927) 00010000:00010000:2.0:1746066750.251216:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.251224:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.251229:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800945d4e00 00010000:00010000:0.0:1746066750.251265:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.251273:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 42 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066750.251285:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984372352:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066750.251644:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.256076:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.256106:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.256253:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983028224 00000100:00100000:1.0:1746066750.256261:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983028224 00010000:00010000:1.0:1746066750.256288:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.256328:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6918 00000100:00100000:1.0:1746066750.256334:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983028224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.256348:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.256365:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.256375:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.256394:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.256425:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983028224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 91us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.256431:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6918 00010000:00010000:2.0:1746066750.256444:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa5ecc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c14 expref: 30 pid: 11630 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.256451:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983028096 00000100:00100000:1.0:1746066750.256453:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983028096 00000100:00100000:2.0:1746066750.256462:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984372096:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.256473:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984372224:192.168.204.16@tcp:104: 00002000:00100000:1.0:1746066750.256474:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2543616->2547711) req@ffff88009d9b2300 x1830882983028096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066750.256479:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984372352:192.168.204.16@tcp:104: 00002000:00100000:1.0:1746066750.256482:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2300 with x1830882983028096 ext(2543616->2547711) 00010000:00010000:1.0:1746066750.256487:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.256496:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.256500:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b2300 00010000:00010000:2.0:1746066750.256504:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3645440->4194303] (req 3645440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.256512:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0e00, rc 0) 00000100:00100000:1.0:1746066750.256514:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 869 00000100:00100000:1.0:1746066750.256519:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983028096:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066750.256531:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:366:x1830882983027584:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6094us (6731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.256538:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15493 00000100:00100000:0.0:1746066750.257337:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.257437:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983028352 00000100:00100000:3.0:1746066750.257441:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983028352 00010000:00010000:3.0:1746066750.257455:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 42 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.257472:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6919 00000100:00100000:3.0:1746066750.257476:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983028352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.257483:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.257491:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 42 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.257498:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 42 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.257512:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a7e00/0xf1867c21abfa5ee1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c29 expref: 42 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.257830:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983028096:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1310us (1760us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066750.257837:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 869 00002000:00100000:1.0:1746066750.257842:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2543616->2547711) req@ffff88009d9b2300 x1830882983028096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.257850:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2300 with x1830882983028096 ext(2543616->2547711) 00010000:00010000:1.0:1746066750.257855:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.257864:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.257870:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b2300 00010000:00010000:3.0:1746066750.258255:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.258276:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882983028352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 798us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.258282:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6919 00000100:00100000:0.0:1746066750.260093:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.260172:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983028480 00000100:00100000:3.0:1746066750.260177:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983028480 00010000:00010000:3.0:1746066750.260196:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 30 pid: 9592 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746066750.260229:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6920 00000100:00100000:3.0:1746066750.260235:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983028480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.260246:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.260258:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 30 pid: 9592 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.260268:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 30 pid: 9592 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.260729:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70c00/0xf1867c21abfa5f04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c45 expref: 30 pid: 9592 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.260741:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.260743:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.260749:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.260756:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.260782:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.260793:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984372480:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.261203:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.261246:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.261262:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983028992 00000100:00100000:1.0:1746066750.261265:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983028992 00002000:00100000:1.0:1746066750.261288:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2424832->2547711) req@ffff88012e420700 x1830882983028992/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.261297:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420700 with x1830882983028992 ext(2424832->2547711) 00010000:00010000:1.0:1746066750.261303:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.261314:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 14 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.261321:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e420700 00000100:00100000:1.0:1746066750.261334:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 870 00000100:00100000:1.0:1746066750.261339:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983028992:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066750.261461:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983028864 00000100:00100000:0.0:1746066750.261465:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983028864 00000100:00100000:0.0:1746066750.261486:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5886 00000100:00100000:0.0:1746066750.261490:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:371:x1830882983028864:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066750.262465:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.262714:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:371:x1830882983028864:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1222us (1511us total) trans 8589936504 rc 0/0 00000100:00100000:0.0:1746066750.262721:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5886 00000100:00100000:3.0:1746066750.263669:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984372480:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066750.263684:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.263707:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983028480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3472us (3617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.263715:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6920 00000100:00100000:0.0:1746066750.264311:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.264349:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983029248 00000100:00100000:3.0:1746066750.264354:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983029248 00002000:00100000:3.0:1746066750.264377:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3645440->3649535) req@ffff88009d9b0000 x1830882983029248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.264387:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0000 with x1830882983029248 ext(3645440->3649535) 00002000:00010000:3.0:1746066750.264391:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0000 00000100:00100000:3.0:1746066750.264402:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3998 00000100:00100000:3.0:1746066750.264407:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983029248:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066750.264495:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983029248:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 87us (184us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066750.264500:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3998 00002000:00100000:3.0:1746066750.264509:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3645440->3649535) req@ffff88009d9b0000 x1830882983029248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.264516:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0000 with x1830882983029248 ext(3645440->3649535) 00002000:00010000:3.0:1746066750.264519:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0000 00000100:00100000:1.0:1746066750.269130:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983028992:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7781us (7873us total) trans 17179874338 rc 0/0 00000100:00100000:1.0:1746066750.269143:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 870 00002000:00100000:1.0:1746066750.269161:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2424832->2547711) req@ffff88012e420700 x1830882983028992/t17179874338(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.269170:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e420700 with x1830882983028992 ext(2424832->2547711) 00010000:00010000:1.0:1746066750.269179:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.269192:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.269200:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e420700 00000100:00100000:2.0:1746066750.273547:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.273590:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.273686:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983029504 00000100:00100000:3.0:1746066750.273694:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983029504 00010000:00010000:3.0:1746066750.273725:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.273763:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6921 00000100:00100000:3.0:1746066750.273770:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882983029504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.273782:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746066750.273796:0:7231:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066750 -> 1746066751 00002000:00010000:3.0:1746066750.273798:0:7231:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066750 -> 1746066751 00010000:00010000:3.0:1746066750.273803:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.273814:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.273832:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa5f2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2424832->2547711) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c53 expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.273846:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.273848:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.273854:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.273862:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.273915:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.273926:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984372608:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066750.273992:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.274445:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983029376 00000100:00100000:0.0:1746066750.274454:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983029376 00000100:00100000:0.0:1746066750.274503:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15494 00000100:00100000:0.0:1746066750.274511:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:366:x1830882983029376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066750.274528:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.274543:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c68 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.274567:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.274580:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.274582:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.274585:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->3493887] (req 3145728->3493887) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.274621:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.274634:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066750.274648:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984372736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066750.274695:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.280990:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.281036:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984372736:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066750.282316:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->3493887] (req 3145728->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.282333:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006ee2fc00, rc 0) 00000100:00100000:1.0:1746066750.282404:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:366:x1830882983029376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7892us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.282412:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15494 00000100:00100000:1.0:1746066750.282451:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983029760 00000100:00100000:1.0:1746066750.282456:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983029760 00002000:00100000:1.0:1746066750.282484:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d9b3b80 x1830882983029760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.282491:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3b80 with x1830882983029760 ext(2097152->4194303) 00010000:00010000:1.0:1746066750.282497:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.282506:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.282511:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b3b80 00000100:00100000:1.0:1746066750.282524:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 871 00000100:00100000:1.0:1746066750.282529:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983029760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066750.283027:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984372608:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066750.283039:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.283058:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882983029504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9289us (9467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.283065:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6921 00000100:00100000:0.0:1746066750.291651:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.293563:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983030016 00000100:00100000:2.0:1746066750.293571:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983030016 00002000:00100000:2.0:1746066750.293613:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3645439) req@ffff88009d9b1180 x1830882983030016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.293623:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1180 with x1830882983030016 ext(3145728->3645439) 00002000:00010000:2.0:1746066750.293627:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1180 00000100:00100000:2.0:1746066750.293652:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 3999 00000100:00100000:2.0:1746066750.293658:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983030016:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066750.296169:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983029760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 13634us (15184us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066750.296179:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 871 00002000:00100000:1.0:1746066750.296188:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d9b3b80 x1830882983029760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.296196:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3b80 with x1830882983029760 ext(2097152->4194303) 00010000:00010000:1.0:1746066750.296204:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.296218:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:1.0:1746066750.296224:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b3b80 00000100:00100000:0.0:1746066750.302424:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983030016:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8758us (10773us total) trans 0 rc 499712/499712 00000100:00100000:0.0:1746066750.302434:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 3999 00002000:00100000:0.0:1746066750.302443:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3645439) req@ffff88009d9b1180 x1830882983030016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 499712/499712 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.302452:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1180 with x1830882983030016 ext(3145728->3645439) 00002000:00010000:0.0:1746066750.302457:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1180 00000100:00100000:0.0:1746066750.307512:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.307580:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983030144 00000100:00100000:3.0:1746066750.307588:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983030144 00000100:00100000:0.0:1746066750.307611:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066750.307626:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.307652:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6922 00000100:00100000:3.0:1746066750.307659:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983030144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.307671:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.307692:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.307703:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.307880:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b39200/0xf1867c21abfa5f35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c5a expref: 30 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.307956:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.307958:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.307967:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.307976:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.308013:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.308028:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984372864:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066750.308121:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066750.308284:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983030272 00000100:00100000:1.0:1746066750.308291:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983030272 00000100:00100000:1.0:1746066750.308341:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15495 00000100:00100000:1.0:1746066750.308349:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:361:x1830882983030272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.308363:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.308375:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c6f expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.308394:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.308401:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066750.308402:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066750.308405:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.308426:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.308438:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 31 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.308447:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984372992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066750.308479:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.311944:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984372864:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066750.311953:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984372992:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.311962:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066750.311972:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.311984:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:3.0:1746066750.312008:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983030144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4349us (4503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.312017:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6922 00000100:00100000:0.0:1746066750.312080:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:361:x1830882983030272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3731us (4468us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.312085:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15495 00000100:00100000:0.0:1746066750.313517:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.313751:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983030528 00000100:00100000:2.0:1746066750.313757:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983030528 00002000:00100000:2.0:1746066750.313791:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3489792->3493887) req@ffff88009d9b0a80 x1830882983030528/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.313800:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0a80 with x1830882983030528 ext(3489792->3493887) 00010000:00010000:2.0:1746066750.313808:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.313820:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.313826:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b0a80 00000100:00100000:2.0:1746066750.314450:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 872 00000100:00100000:2.0:1746066750.314457:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983030528:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066750.314562:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983030528:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 105us (1049us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066750.314568:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 872 00002000:00100000:2.0:1746066750.314573:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3489792->3493887) req@ffff88009d9b0a80 x1830882983030528/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.314581:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0a80 with x1830882983030528 ext(3489792->3493887) 00010000:00010000:2.0:1746066750.314585:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.314604:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.314611:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009d9b0a80 00000100:00100000:0.0:1746066750.318972:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.319288:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983031040 00000100:00100000:2.0:1746066750.319299:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983031040 00000100:00100000:2.0:1746066750.319354:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5887 00000100:00100000:2.0:1746066750.319361:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:366:x1830882983031040:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066750.319565:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:366:x1830882983031040:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 204us (604us total) trans 8589936505 rc 0/0 00000100:00100000:2.0:1746066750.319571:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5887 00000100:00100000:2.0:1746066750.320952:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.321414:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983030784 00000100:00100000:0.0:1746066750.321421:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983030784 00002000:00100000:0.0:1746066750.321460:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3493887) req@ffff8800945d5500 x1830882983030784/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.321470:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5500 with x1830882983030784 ext(3145728->3493887) 00010000:00010000:0.0:1746066750.321480:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.321494:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 30 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746066750.321506:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800945d5500 00000100:00100000:0.0:1746066750.321543:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 873 00000100:00100000:0.0:1746066750.321549:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983030784:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066750.328603:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983030784:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7033us (7633us total) trans 17179874339 rc 0/0 00000100:00100000:0.0:1746066750.328619:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 873 00002000:00100000:0.0:1746066750.328631:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3493887) req@ffff8800945d5500 x1830882983030784/t17179874339(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.328641:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5500 with x1830882983030784 ext(3145728->3493887) 00010000:00010000:0.0:1746066750.328651:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.328668:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:0.0:1746066750.328675:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800945d5500 00000100:00100000:0.0:1746066750.331082:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.331182:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983031168 00000100:00100000:3.0:1746066750.331191:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983031168 00010000:00010000:3.0:1746066750.331227:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.331253:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6923 00000100:00100000:3.0:1746066750.331260:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983031168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.331274:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.331293:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.331305:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.331327:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88006ee2fc00/0xf1867c21abfa5f43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3493887) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c68 expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.331362:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.331365:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.331372:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.331379:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.331412:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.331425:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984373120:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066750.331512:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.335520:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984373120:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066750.335543:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.336215:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983031168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4951us (5138us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.336225:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6923 00000100:00100000:0.0:1746066750.339135:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.339771:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983031424 00000100:00100000:2.0:1746066750.339781:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983031424 00002000:00100000:2.0:1746066750.339832:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880097a8bb80 x1830882983031424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.339842:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8bb80 with x1830882983031424 ext(3145728->4194303) 00002000:00010000:2.0:1746066750.339847:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8bb80 00000100:00100000:2.0:1746066750.339880:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4000 00000100:00100000:2.0:1746066750.340007:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983031424:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066750.348856:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983031424:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8840us (9718us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066750.348869:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4000 00002000:00100000:2.0:1746066750.348913:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880097a8bb80 x1830882983031424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.348923:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8bb80 with x1830882983031424 ext(3145728->4194303) 00002000:00010000:2.0:1746066750.348929:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8bb80 00000100:00100000:0.0:1746066750.354643:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.354756:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983031680 00000100:00100000:2.0:1746066750.354767:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983031680 00002000:00100000:2.0:1746066750.354818:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a8a680 x1830882983031680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.354829:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a680 with x1830882983031680 ext(4194304->5033983) 00002000:00010000:2.0:1746066750.354836:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8a680 00000100:00100000:2.0:1746066750.354869:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4001 00000100:00100000:2.0:1746066750.354877:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983031680:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.364899:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983031680:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9921us (10167us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066750.364912:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4001 00002000:00100000:3.0:1746066750.364924:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a8a680 x1830882983031680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.364934:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8a680 with x1830882983031680 ext(4194304->5033983) 00002000:00010000:3.0:1746066750.364941:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8a680 00000100:00100000:0.0:1746066750.385050:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.385476:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983031936 00000100:00100000:2.0:1746066750.385485:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983031936 00000100:00100000:2.0:1746066750.385537:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16199 00000100:00100000:2.0:1746066750.385545:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:376:x1830882983031936:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066750.385573:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.385726:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5f51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c76 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.385828:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.385843:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.385849:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.385856:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066750.385901:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.385911:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 23 pid: 17253 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.385927:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984373248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.386146:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 11 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.386154:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 11 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.386161:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984373376:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.386177:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.389235:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984373248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.389246:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984373376:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.389275:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066750.389669:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.389752:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.389837:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983032064 00000100:00100000:3.0:1746066750.389844:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983032064 00010000:00010000:3.0:1746066750.389878:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.389942:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983032192 00000100:00100000:3.0:1746066750.389945:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983032192 00010000:00010000:3.0:1746066750.389958:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 24 pid: 17253 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.389972:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6924 00000100:00100000:3.0:1746066750.389978:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983032064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.389991:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.389996:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.390004:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.390027:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575a800/0xf1867c21abfa5ec5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c0d expref: 12 pid: 7243 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.390043:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066750.390048:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066750.390055:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066750.390063:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.390099:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983032064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.390106:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6924 00000100:00100000:3.0:1746066750.390121:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6925 00000100:00100000:3.0:1746066750.390125:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983032192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.390134:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.390138:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 24 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.390145:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 24 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.390155:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71800/0xf1867c21abfa5f20 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c4c expref: 24 pid: 17253 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.390163:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066750.390166:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066750.390172:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066750.390178:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066750.390195:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066750.390204:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066750.390211:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:3.0:1746066750.390228:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066750.390353:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa5f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 25 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.390365:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 24 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.390371:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066750.390373:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066750.390375:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8800, rc 0) 00000100:00100000:3.0:1746066750.390400:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:376:x1830882983031936:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4856us (5363us total) trans 8589936506 rc 0/0 00000100:00100000:3.0:1746066750.390406:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16199 00000100:00100000:3.0:1746066750.390434:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983032192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 308us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.390439:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6925 00000100:00100000:0.0:1746066750.395454:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.395791:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983032320 00000100:00100000:1.0:1746066750.395802:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983032320 00000100:00100000:3.0:1746066750.395959:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15496 00000100:00100000:3.0:1746066750.395969:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:376:x1830882983032320:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066750.395990:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.396008:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c7d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.396037:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.396050:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.396057:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.396063:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.396064:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.396067:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1150976->1253375] (req 1150976->1253375) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.396096:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.396107:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 30 pid: 12233 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.396119:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984373504:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.397185:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 16 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.397197:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 16 pid: 9591 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746066750.397207:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984373632:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.397248:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.397255:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 16 pid: 3528 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.397263:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984373760:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.397278:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.400880:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.401037:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984373504:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.401048:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984373632:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.401055:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984373760:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.401088:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1150976->1253375] (req 1150976->1253375) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 16 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.401107:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71a00, rc 0) 00000100:00100000:3.0:1746066750.401158:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:376:x1830882983032320:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5189us (5715us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.401166:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15496 00000100:00100000:2.0:1746066750.402053:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983032576 00000100:00100000:2.0:1746066750.402063:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983032576 00010000:00010000:2.0:1746066750.402098:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 31 pid: 12233 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.402121:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6926 00000100:00100000:2.0:1746066750.402127:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983032576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066750.402142:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.402161:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 31 pid: 12233 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.402177:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 31 pid: 12233 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.402199:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa5c10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a62 expref: 31 pid: 12233 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.402223:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.402245:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983032576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 118us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.402251:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6926 00000100:00100000:0.0:1746066750.402751:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.402781:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.402914:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983032448 00000100:00100000:1.0:1746066750.402919:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983032448 00010000:00010000:1.0:1746066750.402937:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 17 pid: 9591 timeout: 818 lvb_type: 1 00000100:00100000:1.0:1746066750.402954:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983032704 00000100:00100000:1.0:1746066750.402956:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983032704 00010000:00010000:1.0:1746066750.402966:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 16 pid: 3528 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.402980:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6927 00000100:00100000:1.0:1746066750.402985:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983032448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.402993:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.403003:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 17 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746066750.403012:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 17 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746066750.403025:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa5cb1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae0 expref: 17 pid: 9591 timeout: 818 lvb_type: 1 00010000:00010000:1.0:1746066750.403041:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.403064:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983032448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.403070:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6927 00000100:00100000:1.0:1746066750.403083:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6928 00000100:00100000:1.0:1746066750.403088:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983032704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.403094:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.403101:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 16 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.403110:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 16 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.403122:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894800/0xf1867c21abfa5c09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a5b expref: 16 pid: 3528 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.403131:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.403132:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.403138:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.403147:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.403177:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.403190:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984373888:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.403242:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066750.407322:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984373888:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066750.407348:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.407397:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983032704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4307us (4613us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.407410:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6928 00000100:00100000:0.0:1746066750.407813:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.407962:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983032960 00000100:00100000:3.0:1746066750.407970:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983032960 00002000:00100000:3.0:1746066750.408014:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1150976->1155071) req@ffff880097a89180 x1830882983032960/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.408024:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89180 with x1830882983032960 ext(1150976->1155071) 00002000:00010000:3.0:1746066750.408028:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a89180 00000100:00100000:3.0:1746066750.408048:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4002 00000100:00100000:3.0:1746066750.408055:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882983032960:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066750.408172:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882983032960:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 117us (360us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066750.408178:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4002 00002000:00100000:3.0:1746066750.408182:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1150976->1155071) req@ffff880097a89180 x1830882983032960/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.408189:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89180 with x1830882983032960 ext(1150976->1155071) 00002000:00010000:3.0:1746066750.408192:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a89180 00000100:00100000:0.0:1746066750.410961:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.411103:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983033216 00000100:00100000:2.0:1746066750.411113:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983033216 00002000:00100000:2.0:1746066750.411159:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1249280->1253375) req@ffff880097a89500 x1830882983033216/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.411170:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89500 with x1830882983033216 ext(1249280->1253375) 00002000:00010000:2.0:1746066750.411175:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a89500 00000100:00100000:2.0:1746066750.411208:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4003 00000100:00100000:2.0:1746066750.411215:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882983033216:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066750.411372:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882983033216:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 156us (420us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066750.411378:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4003 00002000:00100000:2.0:1746066750.411384:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1249280->1253375) req@ffff880097a89500 x1830882983033216/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.411396:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89500 with x1830882983033216 ext(1249280->1253375) 00002000:00010000:2.0:1746066750.411399:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a89500 00000100:00100000:0.0:1746066750.444542:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.444609:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.444645:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983033472 00000100:00100000:3.0:1746066750.444656:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983033472 00000100:00100000:1.0:1746066750.444693:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983033344 00000100:00100000:1.0:1746066750.444697:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983033344 00000100:00100000:3.0:1746066750.444698:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15497 00000100:00100000:3.0:1746066750.444706:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882983033472:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066750.444721:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15498 00010000:00010000:3.0:1746066750.444725:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066750.444726:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983033344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.444735:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.444742:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c8b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.444745:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c84 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.444765:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.444767:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.444775:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.444788:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 16 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066750.444794:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984374016:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066750.444798:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4b38400, rc 0) 00000100:00100000:3.0:1746066750.444842:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983033472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 137us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.444848:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15497 00000100:00100000:1.0:1746066750.444869:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00002000:00010000:1.0:1746066750.446384:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066750 -> 1746066751 00000100:00100000:1.0:1746066750.446412:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984374016:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066750.446443:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f74 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c84 expref: 30 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.446455:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c84 expref: 30 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.446481:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:1.0:1746066750.446518:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983033344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1790us (1908us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.446524:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15498 00000100:00100000:0.0:1746066750.457778:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.457913:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983033728 00000100:00100000:3.0:1746066750.457924:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983033728 00002000:00100000:3.0:1746066750.457979:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097a8b800 x1830882983033728/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 504/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.457989:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882983033728 ext(1048576->2097151) 00002000:00010000:3.0:1746066750.457995:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8b800 00000100:00100000:3.0:1746066750.458030:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4004 00000100:00100000:3.0:1746066750.458038:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983033728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.464087:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.464526:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983033984 00000100:00100000:2.0:1746066750.464537:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983033984 00002000:00100000:2.0:1746066750.464584:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880097a88e00 x1830882983033984/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.464633:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88e00 with x1830882983033984 ext(1048576->2097151) 00002000:00010000:2.0:1746066750.464639:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a88e00 00000100:00100000:2.0:1746066750.464674:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4005 00000100:00100000:2.0:1746066750.464682:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983033984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.473262:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983033728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15211us (15481us total) trans 0 rc 946176/946176 00000100:00100000:3.0:1746066750.473275:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4004 00002000:00100000:3.0:1746066750.473289:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097a8b800 x1830882983033728/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 504/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.473298:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882983033728 ext(1048576->2097151) 00002000:00010000:3.0:1746066750.473304:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8b800 00000100:00100000:2.0:1746066750.479848:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983033984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15153us (15759us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066750.479861:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4005 00002000:00100000:2.0:1746066750.479874:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880097a88e00 x1830882983033984/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.479899:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88e00 with x1830882983033984 ext(1048576->2097151) 00002000:00010000:2.0:1746066750.479905:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a88e00 00000100:00100000:0.0:1746066750.493474:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.494060:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.494461:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983034112 00000100:00100000:1.0:1746066750.494472:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983034112 00000100:00100000:1.0:1746066750.494524:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983034240 00000100:00100000:1.0:1746066750.494526:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983034240 00000100:00100000:1.0:1746066750.494546:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15499 00000100:00100000:1.0:1746066750.494554:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983034112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.494571:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.494590:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5f7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c92 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.494663:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984374144:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066750.494746:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066750.494865:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15500 00000100:00100000:1.0:1746066750.494871:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+29:381:x1830882983034240:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.494896:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.494907:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0c99 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.494925:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.494932:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066750.494933:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066750.494937:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.494957:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.494969:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 40 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.494982:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984374272:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066750.495004:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066750.497211:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1746066750.499878:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066749 -> 1746066751 00002000:00010000:1.0:1746066750.499902:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066749 -> 1746066751 00002000:00010000:1.0:1746066750.499905:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066750 -> 1746066751 00000100:00100000:1.0:1746066750.499929:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984374144:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066750.499965:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5f7b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c92 expref: 31 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.499980:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa5f7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c92 expref: 31 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.500004:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155ce00, rc 0) 00000100:00100000:1.0:1746066750.500060:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983034112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5505us (6595us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.500068:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15499 00000100:00100000:0.0:1746066750.500530:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.500627:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984374272:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.500647:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.500660:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:2.0:1746066750.500682:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:381:x1830882983034240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5811us (6622us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.500687:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15500 00000100:00100000:3.0:1746066750.500748:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983034368 00000100:00100000:3.0:1746066750.500756:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983034368 00002000:00100000:3.0:1746066750.500800:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3645440->4194303) req@ffff88012faf1180 x1830882983034368/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.500808:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1180 with x1830882983034368 ext(3645440->4194303) 00010000:00010000:3.0:1746066750.500815:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 41 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.500831:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 41 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:3.0:1746066750.500837:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf1180 00000100:00100000:3.0:1746066750.500855:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 874 00000100:00100000:3.0:1746066750.500861:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983034368:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066750.506977:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.508589:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983034496 00000100:00100000:3.0:1746066750.508610:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983034496 00000100:00100000:3.0:1746066750.508669:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15501 00000100:00100000:3.0:1746066750.508678:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:384:x1830882983034496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.508696:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.508715:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ca0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.508747:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.508755:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.508757:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.508760:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.508795:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 15 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.508812:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 15 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.508825:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984374400:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.508931:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.509792:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983034368:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8929us (9261us total) trans 21474841784 rc 0/0 00000100:00100000:2.0:1746066750.509803:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 874 00002000:00100000:2.0:1746066750.509814:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3645440->4194303) req@ffff88012faf1180 x1830882983034368/t21474841784(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.509823:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1180 with x1830882983034368 ext(3645440->4194303) 00010000:00010000:2.0:1746066750.509830:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 43 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.509841:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 43 pid: 20361 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.509846:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf1180 00000100:00100000:0.0:1746066750.513812:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.514103:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983034624 00000100:00100000:2.0:1746066750.514113:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983034624 00002000:00100000:2.0:1746066750.514162:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1150976->1253375) req@ffff88012faf1f80 x1830882983034624/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.514171:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1f80 with x1830882983034624 ext(1150976->1253375) 00010000:00010000:2.0:1746066750.514181:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.514193:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 16 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.514205:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012faf1f80 00000100:00100000:2.0:1746066750.514228:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 875 00000100:00100000:2.0:1746066750.514237:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983034624:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066750.515016:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.515181:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983034752 00000100:00100000:1.0:1746066750.515187:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983034752 00010000:00010000:1.0:1746066750.515215:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 43 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:1.0:1746066750.515245:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6929 00000100:00100000:1.0:1746066750.515251:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983034752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.515261:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.515282:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 43 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.515292:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 43 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.515315:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0e00/0xf1867c21abfa5f3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c61 expref: 43 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.515332:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.515334:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.515341:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.515349:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.515382:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.515395:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984374528:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.515456:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.515877:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984374400:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.515917:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.515929:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8d3a00, rc 0) 00000100:00100000:3.0:1746066750.515970:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:384:x1830882983034496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7292us (9002us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.515977:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15501 00000100:00100000:1.0:1746066750.519370:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984374528:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066750.519392:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.519433:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983034752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4180us (4417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.519443:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6929 00000100:00100000:2.0:1746066750.521299:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983034624:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7056us (7489us total) trans 17179874340 rc 0/0 00000100:00100000:2.0:1746066750.521309:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 875 00002000:00100000:2.0:1746066750.521321:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1150976->1253375) req@ffff88012faf1f80 x1830882983034624/t17179874340(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.521341:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1f80 with x1830882983034624 ext(1150976->1253375) 00010000:00010000:2.0:1746066750.521351:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 18 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.521367:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 18 pid: 9592 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.521374:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012faf1f80 00000100:00100000:0.0:1746066750.527125:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.528484:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.529712:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.529772:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983035392 00000100:00100000:0.0:1746066750.529781:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983035392 00010000:00010000:0.0:1746066750.529821:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 18 pid: 9592 timeout: 818 lvb_type: 0 00000100:00100000:0.0:1746066750.529863:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6930 00000100:00100000:0.0:1746066750.529871:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983035392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066750.529899:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066750.529920:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 18 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.529934:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 18 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.529958:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa5f66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1150976->1253375) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c7d expref: 18 pid: 9592 timeout: 818 lvb_type: 0 00010000:00010000:0.0:1746066750.529978:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.529981:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.529989:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.529997:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.530032:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 30 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066750.530045:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984374656:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066750.530120:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.536917:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983035008 00000100:00100000:2.0:1746066750.536934:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983035008 00002000:00100000:2.0:1746066750.536995:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012faf1500 x1830882983035008/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.537006:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1500 with x1830882983035008 ext(2097152->4194303) 00002000:00010000:2.0:1746066750.537013:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf1500 00000100:00100000:2.0:1746066750.537044:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983035264 00000100:00100000:2.0:1746066750.537048:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983035264 00002000:00100000:2.0:1746066750.537064:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012faf3800 x1830882983035264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.537071:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3800 with x1830882983035264 ext(2097152->4194303) 00002000:00010000:2.0:1746066750.537075:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf3800 00000100:00100000:2.0:1746066750.537096:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4006 00000100:00100000:2.0:1746066750.537105:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983035008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066750.538518:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4007 00000100:00100000:2.0:1746066750.538527:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983035264:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.542095:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984374656:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066750.542117:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066750.542156:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882983035392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12283us (12445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.542167:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6930 00000100:00100000:0.0:1746066750.550415:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.550508:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983035648 00000100:00100000:3.0:1746066750.550520:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983035648 00002000:00100000:3.0:1746066750.550569:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf2d80 x1830882983035648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.550581:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2d80 with x1830882983035648 ext(1048576->2097151) 00002000:00010000:3.0:1746066750.550587:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf2d80 00000100:00100000:3.0:1746066750.550629:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4008 00000100:00100000:3.0:1746066750.550638:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983035648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.563136:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.563182:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983035904 00000100:00100000:0.0:1746066750.563191:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983035904 00000100:00100000:0.0:1746066750.563232:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16200 00000100:00100000:0.0:1746066750.563240:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:388:x1830882983035904:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066750.563263:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.563280:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa5f90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ca7 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.563381:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066750.563395:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066750.563405:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066750.563414:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066750.563502:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa5f90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 41 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.563517:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 40 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.563525:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066750.563527:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066750.563530:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2a00, rc 0) 00000100:00100000:0.0:1746066750.563569:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:388:x1830882983035904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 330us (444us total) trans 8589936507 rc 0/0 00000100:00100000:0.0:1746066750.563574:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16200 00000100:00100000:2.0:1746066750.563773:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983035008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26668us (36659us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066750.563783:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4006 00002000:00100000:2.0:1746066750.563792:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012faf1500 x1830882983035008/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.563800:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1500 with x1830882983035008 ext(2097152->4194303) 00002000:00010000:2.0:1746066750.563805:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf1500 00000100:00100000:2.0:1746066750.574700:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983035264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 36162us (46206us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066750.574714:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4007 00002000:00100000:2.0:1746066750.574727:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012faf3800 x1830882983035264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.574737:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3800 with x1830882983035264 ext(2097152->4194303) 00002000:00010000:2.0:1746066750.574743:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf3800 00000100:00100000:3.0:1746066750.579808:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983035648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29157us (29397us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066750.579825:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4008 00002000:00100000:3.0:1746066750.579838:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf2d80 x1830882983035648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.579847:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2d80 with x1830882983035648 ext(1048576->2097151) 00002000:00010000:3.0:1746066750.579855:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf2d80 00000100:00100000:0.0:1746066750.584787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.585936:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983036032 00000100:00100000:3.0:1746066750.585947:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983036032 00000100:00100000:3.0:1746066750.586073:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15502 00000100:00100000:3.0:1746066750.586082:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983036032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.586104:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.586123:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cae expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.586149:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.586151:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.586160:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.586176:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.586187:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496a00, rc 0) 00000100:00100000:3.0:1746066750.586879:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983036032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 795us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.586922:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15502 00000100:00100000:0.0:1746066750.591152:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.591265:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983036160 00000100:00100000:3.0:1746066750.591277:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983036160 00000100:00100000:3.0:1746066750.591334:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15503 00000100:00100000:3.0:1746066750.591342:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:384:x1830882983036160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.591363:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.591381:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cb5 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.591408:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.591410:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.591418:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.591431:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.591442:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496e00, rc 0) 00000100:00100000:3.0:1746066750.593495:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:384:x1830882983036160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2144us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.593506:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15503 00000100:00100000:0.0:1746066750.594764:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.597500:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983036416 00000100:00100000:3.0:1746066750.597515:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983036416 00002000:00100000:3.0:1746066750.597574:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf2300 x1830882983036416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.597584:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2300 with x1830882983036416 ext(4194304->5033983) 00002000:00010000:3.0:1746066750.597603:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf2300 00000100:00100000:3.0:1746066750.597651:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4009 00000100:00100000:3.0:1746066750.597658:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983036416:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.600064:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.600168:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.600411:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983036672 00000100:00100000:2.0:1746066750.600421:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983036672 00002000:00100000:2.0:1746066750.600461:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012faf2a00 x1830882983036672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.600472:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2a00 with x1830882983036672 ext(2097152->4194303) 00002000:00010000:2.0:1746066750.600478:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf2a00 00000100:00100000:2.0:1746066750.600493:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983036928 00000100:00100000:2.0:1746066750.600495:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983036928 00002000:00100000:2.0:1746066750.600507:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012faf1880 x1830882983036928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.600515:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1880 with x1830882983036928 ext(2097152->3145727) 00002000:00010000:2.0:1746066750.600518:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1880 00000100:00100000:2.0:1746066750.600542:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4010 00000100:00100000:2.0:1746066750.600550:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983036672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066750.603688:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4011 00000100:00100000:1.0:1746066750.603706:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983036928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.606129:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983036416:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8455us (11352us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066750.606141:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4009 00002000:00100000:3.0:1746066750.606155:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf2300 x1830882983036416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.606164:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2300 with x1830882983036416 ext(4194304->5033983) 00002000:00010000:3.0:1746066750.606172:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf2300 00000100:00100000:0.0:1746066750.618928:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.619095:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983037056 00000100:00100000:3.0:1746066750.619105:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983037056 00000100:00100000:3.0:1746066750.619156:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15504 00000100:00100000:3.0:1746066750.619305:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:386:x1830882983037056:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066750.619325:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.619364:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cbc expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.619398:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.619406:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.619412:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.619414:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.619417:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.619453:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.619464:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 43 pid: 11630 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.619476:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984374784:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.619575:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.619583:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.619604:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984374912:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.619633:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983036672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19083us (19577us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066750.619642:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4010 00002000:00100000:2.0:1746066750.619650:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012faf2a00 x1830882983036672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066750.619653:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00002000:00100000:2.0:1746066750.619658:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf2a00 with x1830882983036672 ext(2097152->4194303) 00010000:00010000:2.0:1746066750.619664:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 43 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.619673:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 43 pid: 11630 timeout: 818 lvb_type: 0 00002000:00010000:2.0:1746066750.619715:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf2a00 00000100:00100000:1.0:1746066750.624931:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983036928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21220us (24751us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066750.624943:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4011 00002000:00100000:1.0:1746066750.624954:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012faf1880 x1830882983036928/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.624963:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1880 with x1830882983036928 ext(2097152->3145727) 00002000:00010000:1.0:1746066750.624968:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1880 00000100:00100000:3.0:1746066750.626207:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984374784:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.626218:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984374912:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.626247:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.626266:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497400, rc 0) 00000100:00100000:3.0:1746066750.626304:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:386:x1830882983037056:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7140us (7433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.626314:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15504 00000100:00100000:0.0:1746066750.631366:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.631480:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983037184 00000100:00100000:2.0:1746066750.631490:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983037184 00010000:00010000:2.0:1746066750.631530:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00000100:00100000:2.0:1746066750.631572:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6931 00000100:00100000:2.0:1746066750.631579:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983037184:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066750.631610:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.631634:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.631645:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.631668:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d400/0xf1867c21abfa5f82 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c99 expref: 31 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:2.0:1746066750.631700:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.631754:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983037184:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 174us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.631760:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6931 00000100:00100000:0.0:1746066750.636085:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.636136:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983037312 00000100:00100000:3.0:1746066750.636146:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983037312 00000100:00100000:0.0:1746066750.636331:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.636631:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15505 00000100:00100000:1.0:1746066750.636634:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983037440 00000100:00100000:1.0:1746066750.636637:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983037440 00000100:00100000:3.0:1746066750.636640:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:384:x1830882983037312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.636659:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.636659:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 44 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.636673:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cc3 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.636696:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.636699:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.636706:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 45 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.636720:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 45 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.636722:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6932 00000100:00100000:1.0:1746066750.636727:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983037440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.636731:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497200, rc 0) 00010000:00010000:1.0:1746066750.636735:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.636753:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 45 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.636762:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 45 pid: 11630 timeout: 818 lvb_type: 0 00010000:00010000:1.0:1746066750.636777:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa5fac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cb5 expref: 45 pid: 11630 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.636786:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:384:x1830882983037312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 148us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.636792:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15505 00010000:00010000:1.0:1746066750.636872:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.636873:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.636879:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.636907:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.636936:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.636948:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984375040:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.637010:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.639975:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.640119:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984375040:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066750.640137:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.640173:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983037440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3445us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.640185:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6932 00000100:00100000:1.0:1746066750.640251:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983037696 00000100:00100000:1.0:1746066750.640257:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983037696 00002000:00100000:1.0:1746066750.640297:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967ab480 x1830882983037696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.640307:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab480 with x1830882983037696 ext(3145728->4194303) 00002000:00010000:1.0:1746066750.640312:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967ab480 00000100:00100000:1.0:1746066750.640339:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4012 00000100:00100000:1.0:1746066750.640346:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983037696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.640698:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.640741:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983037952 00000100:00100000:3.0:1746066750.640745:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983037952 00002000:00100000:3.0:1746066750.640925:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2768896->2772991) req@ffff8800967aaa00 x1830882983037952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.640932:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882983037952 ext(2768896->2772991) 00002000:00010000:3.0:1746066750.640936:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aaa00 00000100:00100000:3.0:1746066750.640948:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4013 00000100:00100000:3.0:1746066750.640953:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983037952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.641424:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983037952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 468us (725us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066750.641430:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4013 00002000:00100000:3.0:1746066750.641435:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2768896->2772991) req@ffff8800967aaa00 x1830882983037952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.641441:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882983037952 ext(2768896->2772991) 00002000:00010000:3.0:1746066750.641444:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aaa00 00000100:00100000:0.0:1746066750.647569:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.648789:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983038080 00000100:00100000:3.0:1746066750.648799:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983038080 00000100:00100000:3.0:1746066750.649191:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15506 00000100:00100000:3.0:1746066750.649200:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:386:x1830882983038080:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066750.649225:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.649243:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cca expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.649275:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.649283:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.649289:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.649291:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.649294:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->2363391] (req 2097152->2363391) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.649329:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.649341:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 19 pid: 9592 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746066750.649353:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984375168:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.649530:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.649540:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 30 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.649549:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984375296:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.649571:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.651500:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.652356:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983038208 00000100:00100000:2.0:1746066750.652366:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983038208 00000100:00100000:2.0:1746066750.652416:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15507 00000100:00100000:2.0:1746066750.652424:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:388:x1830882983038208:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066750.652442:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.652458:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cd1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.652487:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.652489:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.652493:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3010559] (req 2392064->3010559) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.652505:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3010559] (req 2392064->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.652515:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d400, rc 0) 00000100:00100000:2.0:1746066750.652570:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:388:x1830882983038208:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 146us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.652576:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15507 00000100:00100000:1.0:1746066750.655643:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983037696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15289us (15667us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066750.655653:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4012 00002000:00100000:1.0:1746066750.655664:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967ab480 x1830882983037696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.655672:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab480 with x1830882983037696 ext(3145728->4194303) 00002000:00010000:1.0:1746066750.655677:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967ab480 00000100:00100000:3.0:1746066750.658246:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984375168:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.658261:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984375296:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.658294:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2363391] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.658313:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497e00, rc 0) 00000100:00100000:3.0:1746066750.658376:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+19:386:x1830882983038080:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9176us (10818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.658385:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15506 00000100:00100000:0.0:1746066750.660455:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.660499:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.660519:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983038336 00000100:00100000:3.0:1746066750.660530:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983038336 00010000:00010000:3.0:1746066750.660566:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00000100:00100000:3.0:1746066750.660607:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6933 00000100:00100000:3.0:1746066750.660614:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983038336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.660631:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.660652:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.660663:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.660687:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d200/0xf1867c21abfa5f4a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c6f expref: 32 pid: 20361 timeout: 818 lvb_type: 0 00010000:00010000:3.0:1746066750.660726:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.661560:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983038592 00000100:00100000:3.0:1746066750.661561:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983038336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 945us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.661565:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983038592 00000100:00100000:0.0:1746066750.661566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.661569:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6933 00000100:00100000:2.0:1746066750.661600:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15508 00000100:00100000:2.0:1746066750.661606:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:384:x1830882983038592:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.661622:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.661634:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cd8 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.661651:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.661653:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.661660:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.661672:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.661682:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d000, rc 0) 00000100:00100000:2.0:1746066750.661703:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:384:x1830882983038592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.661709:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15508 00000100:00100000:3.0:1746066750.662104:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983038464 00000100:00100000:3.0:1746066750.662107:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983038464 00010000:00010000:3.0:1746066750.662120:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 19 pid: 9592 timeout: 818 lvb_type: 1 00000100:00100000:3.0:1746066750.662146:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6934 00000100:00100000:3.0:1746066750.662151:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983038464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.662158:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.662170:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 19 pid: 9592 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.662179:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 19 pid: 9592 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.662192:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4b38400/0xf1867c21abfa5f6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c8b expref: 19 pid: 9592 timeout: 818 lvb_type: 1 00010000:00010000:3.0:1746066750.662201:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.662203:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.662208:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.662215:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.662222:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.662223:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.662226:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.662233:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.662260:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.662272:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984375424:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066750.662342:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.662351:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984375552:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066750.662369:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.664176:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984375424:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066750.664187:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984375552:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066750.664203:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.664251:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983038464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2098us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.664261:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6934 00000100:00100000:2.0:1746066750.664344:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.664412:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983038848 00000100:00100000:0.0:1746066750.664418:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983038848 00002000:00100000:0.0:1746066750.664454:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2392064->2396159) req@ffff8800945d5f80 x1830882983038848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.664463:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5f80 with x1830882983038848 ext(2392064->2396159) 00002000:00010000:0.0:1746066750.664466:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d5f80 00000100:00100000:0.0:1746066750.664539:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4014 00000100:00100000:0.0:1746066750.664547:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983038848:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066750.664693:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983038848:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 145us (352us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066750.664701:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4014 00002000:00100000:2.0:1746066750.664709:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2392064->2396159) req@ffff8800945d5f80 x1830882983038848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.664717:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5f80 with x1830882983038848 ext(2392064->2396159) 00002000:00010000:2.0:1746066750.664722:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d5f80 00000100:00100000:0.0:1746066750.666581:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.666806:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983039104 00000100:00100000:2.0:1746066750.666813:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983039104 00002000:00100000:2.0:1746066750.666846:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800967aad80 x1830882983039104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.666860:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882983039104 ext(3145728->4194303) 00002000:00010000:2.0:1746066750.666865:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:2.0:1746066750.666908:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4015 00000100:00100000:2.0:1746066750.666915:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983039104:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066750.667778:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.667832:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983039360 00000100:00100000:3.0:1746066750.667842:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983039360 00002000:00100000:3.0:1746066750.667876:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2359296->2363391) req@ffff8800967a9500 x1830882983039360/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.667900:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9500 with x1830882983039360 ext(2359296->2363391) 00002000:00010000:3.0:1746066750.667905:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9500 00000100:00100000:3.0:1746066750.667924:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4016 00000100:00100000:3.0:1746066750.667930:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983039360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.668040:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983039360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 110us (263us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066750.668046:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4016 00002000:00100000:3.0:1746066750.668051:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2359296->2363391) req@ffff8800967a9500 x1830882983039360/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.668057:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9500 with x1830882983039360 ext(2359296->2363391) 00002000:00010000:3.0:1746066750.668059:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9500 00000100:00100000:0.0:1746066750.673638:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.673813:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983039616 00000100:00100000:2.0:1746066750.673824:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983039616 00002000:00100000:2.0:1746066750.673870:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3006464->3010559) req@ffff8800967a8380 x1830882983039616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.674006:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882983039616 ext(3006464->3010559) 00002000:00010000:2.0:1746066750.674012:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8380 00000100:00100000:2.0:1746066750.674047:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4017 00000100:00100000:2.0:1746066750.674055:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983039616:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066750.674776:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983039616:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 720us (1147us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066750.674783:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4017 00002000:00100000:2.0:1746066750.674789:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3006464->3010559) req@ffff8800967a8380 x1830882983039616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.674797:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882983039616 ext(3006464->3010559) 00002000:00010000:2.0:1746066750.674800:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8380 00000100:00100000:3.0:1746066750.675657:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983039104:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8741us (9078us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066750.675664:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4015 00002000:00100000:3.0:1746066750.675670:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800967aad80 x1830882983039104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.675677:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882983039104 ext(3145728->4194303) 00002000:00010000:3.0:1746066750.675680:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:2.0:1746066750.691240:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.691293:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.691316:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983039872 00000100:00100000:2.0:1746066750.691325:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983039872 00000100:00100000:2.0:1746066750.691364:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983039744 00000100:00100000:2.0:1746066750.691366:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983039744 00000100:00100000:2.0:1746066750.691384:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15509 00000100:00100000:2.0:1746066750.691392:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983039872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.691411:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.691429:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa5fd6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ce6 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.691463:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa5fd6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ce6 expref: 33 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.691473:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa5fd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ce6 expref: 33 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.691487:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993000, rc 0) 00000100:00100000:2.0:1746066750.691532:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983039872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 141us (303us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.691539:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15509 00000100:00100000:2.0:1746066750.691553:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15510 00000100:00100000:2.0:1746066750.691557:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983039744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.691565:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.691573:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5993200/0xf1867c21abfa5fdd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cdf expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.691601:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5993200/0xf1867c21abfa5fdd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cdf expref: 44 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.691614:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993200/0xf1867c21abfa5fdd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cdf expref: 44 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.691621:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993200, rc 0) 00000100:00100000:2.0:1746066750.691637:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983039744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (344us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.691641:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15510 00000100:00100000:2.0:1746066750.695667:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.697010:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983040128 00000100:00100000:3.0:1746066750.697019:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983040128 00002000:00100000:3.0:1746066750.697066:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009d9b2680 x1830882983040128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.697076:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2680 with x1830882983040128 ext(4194304->5033983) 00002000:00010000:3.0:1746066750.697081:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b2680 00000100:00100000:3.0:1746066750.697101:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4018 00000100:00100000:3.0:1746066750.697107:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983040128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.704948:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983040128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7826us (9276us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066750.704962:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4018 00002000:00100000:3.0:1746066750.704976:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009d9b2680 x1830882983040128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.704986:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2680 with x1830882983040128 ext(4194304->5033983) 00002000:00010000:3.0:1746066750.704993:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b2680 00000100:00100000:0.0:1746066750.709191:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.709368:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.709389:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983040256 00000100:00100000:3.0:1746066750.709399:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983040256 00000100:00100000:3.0:1746066750.709474:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983040384 00000100:00100000:3.0:1746066750.709477:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983040384 00000100:00100000:2.0:1746066750.709574:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15511 00000100:00100000:2.0:1746066750.709584:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983040256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.709616:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.709636:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa5fe4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ced expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.709666:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa5fe4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ced expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.709676:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa5fe4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ced expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.709702:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00000100:00100000:2.0:1746066750.709743:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983040256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 161us (563us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.709748:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15511 00000100:00100000:2.0:1746066750.709766:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15512 00000100:00100000:2.0:1746066750.709770:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983040384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.709776:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.709785:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7400/0xf1867c21abfa5feb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cf4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.709797:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7400/0xf1867c21abfa5feb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cf4 expref: 33 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.709804:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7400/0xf1867c21abfa5feb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cf4 expref: 33 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.709810:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7400, rc 0) 00000100:00100000:2.0:1746066750.709820:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983040384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 50us (454us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.709824:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15512 00000100:00100000:0.0:1746066750.712985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.713099:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983040512 00000100:00100000:2.0:1746066750.713110:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983040512 00000100:00100000:2.0:1746066750.713149:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15513 00000100:00100000:2.0:1746066750.713157:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983040512:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066750.713161:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066750.713174:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.713192:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa5ff2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0cfb expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.713192:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983040640 00000100:00100000:1.0:1746066750.713195:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983040640 00000100:00100000:1.0:1746066750.713222:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15514 00010000:00010000:2.0:1746066750.713225:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa5ff2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cfb expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066750.713227:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983040640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.713236:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.713240:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa5ff2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cfb expref: 44 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.713247:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5ff9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d02 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.713254:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6a00, rc 0) 00010000:00010000:1.0:1746066750.713263:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5ff9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d02 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.713272:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c400/0xf1867c21abfa5ff9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d02 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.713294:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c400, rc 0) 00000100:00100000:2.0:1746066750.713299:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983040512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 142us (419us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.713304:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15513 00000100:00100000:1.0:1746066750.713312:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983040640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 84us (151us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.713317:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15514 00000100:00100000:0.0:1746066750.842783:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.842843:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.842947:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983040896 00000100:00100000:2.0:1746066750.842957:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983040896 00000100:00100000:2.0:1746066750.843191:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983040768 00000100:00100000:2.0:1746066750.843195:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983040768 00000100:00100000:2.0:1746066750.843307:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15515 00000100:00100000:2.0:1746066750.843315:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983040896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.843348:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.843366:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa6000 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d10 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.843392:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15516 00000100:00100000:1.0:1746066750.843399:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983040768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.843400:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa6000 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d10 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.843407:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.843411:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa6000 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d10 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.843416:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155cc00/0xf1867c21abfa6007 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d09 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.843428:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155cc00/0xf1867c21abfa6007 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d09 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.843436:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6600, rc 0) 00000100:00100000:2.0:1746066750.843485:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983040896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 171us (712us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.843491:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15515 00010000:00010000:1.0:1746066750.843777:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155cc00/0xf1867c21abfa6007 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d09 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.843789:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155cc00, rc 0) 00000100:00100000:1.0:1746066750.843806:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983040768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 408us (964us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.843811:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15516 00000100:00100000:0.0:1746066750.856239:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.856763:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983041152 00000100:00100000:3.0:1746066750.856773:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983041152 00002000:00100000:3.0:1746066750.856823:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800967a8700 x1830882983041152/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.856833:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8700 with x1830882983041152 ext(1048576->2097151) 00002000:00010000:3.0:1746066750.856838:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8700 00000100:00100000:3.0:1746066750.856875:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4019 00000100:00100000:3.0:1746066750.856918:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983041152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.863795:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983041152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6901us (7557us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066750.863805:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4019 00002000:00100000:3.0:1746066750.863815:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800967a8700 x1830882983041152/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.863823:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8700 with x1830882983041152 ext(1048576->2097151) 00002000:00010000:3.0:1746066750.863828:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8700 00000100:00100000:0.0:1746066750.872477:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.872571:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.872675:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983041280 00000100:00100000:1.0:1746066750.872685:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983041280 00000100:00100000:1.0:1746066750.872739:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983041408 00000100:00100000:1.0:1746066750.872742:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983041408 00000100:00100000:1.0:1746066750.872761:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15517 00000100:00100000:1.0:1746066750.872768:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983041280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.872788:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.872805:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa600e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d17 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.872839:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa600e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d17 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.872847:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa600e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d17 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.872866:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c000, rc 0) 00000100:00100000:1.0:1746066750.872941:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983041280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 173us (483us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.872947:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15517 00000100:00100000:1.0:1746066750.872961:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15518 00000100:00100000:1.0:1746066750.872964:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983041408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066750.872970:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.872978:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa6015 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d1e expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.872991:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa6015 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d1e expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.872998:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa6015 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d1e expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.873003:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155cc00, rc 0) 00000100:00100000:1.0:1746066750.873014:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983041408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 50us (444us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.873018:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15518 00000100:00100000:0.0:1746066750.875810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.876382:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983041536 00000100:00100000:3.0:1746066750.876392:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983041536 00000100:00100000:3.0:1746066750.876770:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15519 00000100:00100000:3.0:1746066750.876778:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:395:x1830882983041536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.876794:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.876810:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d25 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.876836:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.876843:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.876845:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.876848:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.876874:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.876898:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 31 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.876908:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984375680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.876996:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800962080c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.881526:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984375680:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.881558:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.881580:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496600, rc 0) 00000100:00100000:3.0:1746066750.882234:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:395:x1830882983041536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5454us (6429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.882243:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15519 00000100:00100000:0.0:1746066750.883432:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.884198:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983041664 00000100:00100000:3.0:1746066750.884207:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983041664 00002000:00100000:3.0:1746066750.884251:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2768896->3145727) req@ffff88012faf4380 x1830882983041664/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.884260:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4380 with x1830882983041664 ext(2768896->3145727) 00010000:00010000:3.0:1746066750.884269:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 31 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.884281:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 31 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066750.884286:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf4380 00000100:00100000:3.0:1746066750.884520:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 876 00000100:00100000:3.0:1746066750.884528:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882983041664:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066750.895657:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983041664:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11118us (12216us total) trans 21474841785 rc 0/0 00000100:00100000:3.0:1746066750.895670:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 876 00002000:00100000:3.0:1746066750.895682:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2768896->3145727) req@ffff88012faf4380 x1830882983041664/t21474841785(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.895698:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4380 with x1830882983041664 ext(2768896->3145727) 00010000:00010000:3.0:1746066750.895708:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 33 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.895724:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 33 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066750.895731:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf4380 00000100:00100000:0.0:1746066750.900874:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.901092:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983041792 00000100:00100000:3.0:1746066750.901102:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983041792 00010000:00010000:3.0:1746066750.901542:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 33 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.901593:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6935 00000100:00100000:3.0:1746066750.901602:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983041792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.901726:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.901751:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 33 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.901765:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 33 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.901791:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa5fb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2768896->3145727] (req 2768896->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cbc expref: 33 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.901940:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.901942:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066750.901950:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.901957:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.902504:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.902519:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984375808:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.904401:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.904447:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983042048 00000100:00100000:3.0:1746066750.904455:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983042048 00002000:00100000:3.0:1746066750.904501:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3051520->3055615) req@ffff88012e421500 x1830882983042048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.904510:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421500 with x1830882983042048 ext(3051520->3055615) 00002000:00010000:3.0:1746066750.904516:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421500 00000100:00100000:3.0:1746066750.904544:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4020 00000100:00100000:3.0:1746066750.904552:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983042048:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066750.904720:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800962080c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.905010:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983042048:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 457us (611us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066750.905017:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4020 00002000:00100000:3.0:1746066750.905024:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3051520->3055615) req@ffff88012e421500 x1830882983042048/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.905030:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421500 with x1830882983042048 ext(3051520->3055615) 00002000:00010000:3.0:1746066750.905034:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421500 00000100:00100000:0.0:1746066750.909336:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.909438:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.909663:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984375808:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066750.909685:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.909731:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983041792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 8128us (8866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.909743:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6935 00000100:00100000:3.0:1746066750.909957:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983042304 00000100:00100000:3.0:1746066750.909964:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983042304 00000100:00100000:3.0:1746066750.909998:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15520 00000100:00100000:3.0:1746066750.910005:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:399:x1830882983042304:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066750.910023:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066750.910035:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983042176 00010000:00010000:3.0:1746066750.910040:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d33 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.910041:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983042176 00000100:00100000:2.0:1746066750.910068:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16201 00000100:00100000:2.0:1746066750.910074:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:401:x1830882983042176:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066750.910075:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.910083:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.910088:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.910090:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.910091:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.910095:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3166207] (req 3145728->3166207) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.910100:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6000/0xf1867c21abfa602a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d2c expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.910122:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.910134:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.910147:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984375936:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.910152:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910163:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910175:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910188:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910193:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910198:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910270:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910280:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 22 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.910286:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 39 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.910291:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.910309:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 39 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.910317:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 39 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066750.910324:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984376064:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.910410:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 22 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.910418:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 22 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066750.910425:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984376192:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.910444:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db000 going to sleep for 11 seconds 00010000:00010000:3.0:1746066750.910508:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.910517:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 31 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.910524:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984376320:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.910539:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.912387:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.912437:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983042688 00000100:00100000:3.0:1746066750.912443:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983042688 00000100:00100000:0.0:1746066750.912443:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066750.912480:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2363392->2392063) req@ffff88012faf4e00 x1830882983042688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066750.912487:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066750.912488:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4e00 with x1830882983042688 ext(2363392->2392063) 00002000:00010000:3.0:1746066750.912492:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf4e00 00000100:00100000:0.0:1746066750.912513:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.912529:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984375936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.912543:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983042816 00000100:00100000:3.0:1746066750.912547:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983042816 00000100:00100000:3.0:1746066750.912558:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984376320:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.912578:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3166207] (req 3145728->3166207) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.912603:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9000, rc 0) 00000100:00100000:1.0:1746066750.912612:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983042944 00000100:00100000:1.0:1746066750.912616:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983042944 00000100:00100000:3.0:1746066750.912636:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:399:x1830882983042304:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2631us (3198us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066750.912636:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 40 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.912642:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15520 00000100:00100000:1.0:1746066750.912654:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983043072 00000100:00100000:1.0:1746066750.912656:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983043072 00010000:00010000:1.0:1746066750.912666:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 23 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066750.912679:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6936 00000100:00100000:1.0:1746066750.912684:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983042944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.912693:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.912698:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 40 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.912707:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 40 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.912723:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.912728:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.912735:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.912740:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.912747:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.912761:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983042944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.912767:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6936 00000100:00100000:1.0:1746066750.912776:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6937 00000100:00100000:1.0:1746066750.912780:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983043072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.912785:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.912788:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 23 pid: 17253 timeout: 819 lvb_type: 0 00002000:00100000:3.0:1746066750.912793:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012faf7800 x1830882983042816/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066750.912795:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 23 pid: 17253 timeout: 819 lvb_type: 0 00002000:00100000:3.0:1746066750.912801:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7800 with x1830882983042816 ext(2097152->3145727) 00010000:00010000:1.0:1746066750.912804:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.912806:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.912807:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.912812:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.912816:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.912818:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 15 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.912819:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2a00/0xf1867c21abfa5f97 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca7 expref: 39 pid: 17253 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066750.912821:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf7800 00010000:00010000:1.0:1746066750.912829:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.912833:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 877 00000100:00100000:2.0:1746066750.912837:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984376064:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.912838:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983042816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066750.912842:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983043072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (328us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066750.912847:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa5f58 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c76 expref: 23 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066750.912847:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6937 00000100:00100000:2.0:1746066750.912858:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984376192:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066750.912871:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.912879:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746066750.912879:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4021 00010000:00010000:2.0:1746066750.912907:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746066750.912907:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983042688:12345-192.168.204.16@tcp:3:cat.0 00000004:00200000:2.0:1746066750.912953:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066750.912958:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066750.912974:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.912984:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.912994:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.912998:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913003:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913009:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913014:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c6e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066750.913018:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913024:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913032:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066750.913034:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066750.913037:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913041:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6e00/0xf1867c21abfa6031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913050:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913055:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913060:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913063:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c7a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066750.913065:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913070:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913076:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5feb800) 00010000:00010000:2.0:1746066750.913077:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066750.913079:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913083:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7a00/0xf1867c21abfa6038 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066750.913112:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6000/0xf1867c21abfa602a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.913122:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.913331:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066750.913333:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066750.913335:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6200, rc 0) 00000100:00100000:2.0:1746066750.913372:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:401:x1830882983042176:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3297us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.913378:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16201 00000100:00100000:2.0:1746066750.914275:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.914352:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983043200 00000100:00100000:3.0:1746066750.914357:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983043200 00000100:00100000:3.0:1746066750.914670:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15521 00000100:00100000:3.0:1746066750.914676:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+20:400:x1830882983043200:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066750.914686:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.914699:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d3a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.914719:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.914726:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.914728:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.914731:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3604480->3833855] (req 3604480->3833855) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.914753:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.914763:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 31 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.914772:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984376448:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.915088:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066750.915258:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.915273:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983043328 00000100:00100000:1.0:1746066750.915276:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983043328 00010000:00010000:1.0:1746066750.915289:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066750.915312:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6938 00000100:00100000:1.0:1746066750.915316:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983043328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.915323:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.915336:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.915342:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.915355:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497200/0xf1867c21abfa5fba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cc3 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.915365:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.915377:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882983043328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.915381:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6938 00000100:00100000:2.0:1746066750.915438:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983042688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2530us (3054us total) trans 0 rc 28672/28672 00000100:00100000:2.0:1746066750.915445:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4021 00002000:00100000:2.0:1746066750.915452:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2363392->2392063) req@ffff88012faf4e00 x1830882983042688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 28672/28672 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.915461:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4e00 with x1830882983042688 ext(2363392->2392063) 00002000:00010000:2.0:1746066750.915466:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf4e00 00000100:00100000:0.0:1746066750.918791:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.918825:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.918849:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.919050:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983043456 00000100:00100000:1.0:1746066750.919058:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983043456 00000100:00100000:2.0:1746066750.919120:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983043584 00000100:00100000:2.0:1746066750.919124:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983043584 00000100:00100000:1.0:1746066750.919170:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983043712 00000100:00100000:1.0:1746066750.919173:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983043712 00000100:00100000:3.0:1746066750.919330:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984376448:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066750.919361:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15522 00000100:00100000:0.0:1746066750.919369:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983043456:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746066750.919380:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15523 00000100:00100000:1.0:1746066750.919385:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15524 00000100:00100000:2.0:1746066750.919387:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983043584:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066750.919388:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066750.919390:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983043712:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066750.919394:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.919396:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.919404:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7400/0xf1867c21abfa605b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d48 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.919404:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa6054 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d4f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.919404:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d41 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.919423:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.919423:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066750.919424:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.919429:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7400/0xf1867c21abfa605b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d48 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.919429:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa6054 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d4f expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.919432:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066750.919438:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7400/0xf1867c21abfa605b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d48 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.919438:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa6054 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d4f expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066750.919446:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066750.919447:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c000, rc 0) 00010000:00010000:2.0:1746066750.919450:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7400, rc 0) 00000100:00100000:1.0:1746066750.919486:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882983043712:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 96us (636us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066750.919492:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15524 00010000:00010000:3.0:1746066750.919563:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3604480->3833855] (req 3604480->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.919575:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9600, rc 0) 00000100:00100000:2.0:1746066750.919743:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983043584:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 355us (915us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066750.919749:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15523 00000100:00100000:3.0:1746066750.919770:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+19:400:x1830882983043200:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5093us (5495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.919775:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15521 00010000:00010000:0.0:1746066750.919829:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992600, rc 0) 00000100:00100000:2.0:1746066750.919859:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983042816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7019us (7415us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066750.919859:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983043456:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 491us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.919864:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15522 00000100:00100000:2.0:1746066750.919867:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 877 00002000:00100000:2.0:1746066750.919875:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012faf7800 x1830882983042816/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.919902:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7800 with x1830882983042816 ext(2097152->3145727) 00010000:00010000:2.0:1746066750.919908:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.919918:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066750.919924:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf7800 00000100:00100000:0.0:1746066750.921349:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.921440:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983043840 00000100:00100000:2.0:1746066750.921445:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983043840 00010000:00010000:2.0:1746066750.921469:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066750.921502:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6939 00000100:00100000:2.0:1746066750.921508:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983043840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066750.921519:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.921537:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.921545:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.921561:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa5fcf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd8 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.921572:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.921574:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.921579:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.921599:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.921628:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.921643:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984376576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066750.921809:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.925675:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984376576:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066750.925700:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.925752:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983043840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4242us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066750.925847:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.925864:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6939 00000100:00100000:0.0:1746066750.925932:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.925957:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.926169:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983044096 00000100:00100000:2.0:1746066750.926176:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983044096 00002000:00100000:2.0:1746066750.926218:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3604480->3608575) req@ffff88012faf6680 x1830882983044096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.926228:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf6680 with x1830882983044096 ext(3604480->3608575) 00000100:00100000:1.0:1746066750.926228:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983044480 00002000:00010000:2.0:1746066750.926232:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf6680 00000100:00100000:1.0:1746066750.926232:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983044480 00000100:00100000:2.0:1746066750.926254:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4022 00000100:00100000:1.0:1746066750.926254:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15525 00000100:00100000:2.0:1746066750.926259:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983044096:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066750.926259:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:395:x1830882983044480:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066750.926311:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983044352 00000100:00100000:3.0:1746066750.926314:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983044352 00000100:00100000:3.0:1746066750.926341:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16202 00000100:00100000:3.0:1746066750.926345:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:401:x1830882983044352:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066750.926356:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.926371:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa6062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d56 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.926633:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.926635:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066750.926646:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d5d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.926650:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.926657:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066750.926664:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.926670:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.926675:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066750.926677:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746066750.926679:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.926686:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.926692:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.926696:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 13 pid: 7243 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746066750.926698:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 30 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.926707:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984376704:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066750.926710:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984376832:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066750.926758:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066750.926764:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 21 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746066750.926771:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984376960:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.927024:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.927200:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882983044096:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 939us (1266us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066750.927201:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.927206:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4022 00002000:00100000:2.0:1746066750.927211:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3604480->3608575) req@ffff88012faf6680 x1830882983044096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.927218:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf6680 with x1830882983044096 ext(3604480->3608575) 00002000:00010000:2.0:1746066750.927221:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf6680 00000100:00100000:0.0:1746066750.927236:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.927938:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983044608 00000100:00100000:2.0:1746066750.927943:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983044608 00010000:00010000:2.0:1746066750.927962:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066750.927998:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6940 00000100:00100000:2.0:1746066750.928004:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983044608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066750.928020:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.928036:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.928046:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.928065:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098496600/0xf1867c21abfa601c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d25 expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.928077:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.928078:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.928085:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.928093:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.928115:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.928128:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984377088:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066750.928191:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.930137:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.930175:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.930226:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983044736 00000100:00100000:2.0:1746066750.930231:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984376832:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066750.930231:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983044736 00000100:00100000:2.0:1746066750.930241:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984376960:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066750.930257:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 14 pid: 7243 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.930269:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.930282:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992000, rc 0) 00000100:00100000:1.0:1746066750.930283:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6941 00000100:00100000:1.0:1746066750.930288:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983044736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.930298:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.930303:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 14 pid: 7243 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.930311:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 14 pid: 7243 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066750.930314:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:395:x1830882983044480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4053us (4355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.930321:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15525 00010000:00010000:1.0:1746066750.930328:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066750.930332:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.930341:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.930346:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066750.930358:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.930373:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983044736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.930378:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6941 00000100:00100000:0.0:1746066750.930476:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066750.930542:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c6200/0xf1867c21abfa603f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d2c expref: 13 pid: 7243 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.930566:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984376704:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066750.930580:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.930598:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.930602:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066750.930627:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000100:00100000:2.0:1746066750.930652:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983044864 00000100:00100000:2.0:1746066750.930655:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983044864 00002000:00100000:2.0:1746066750.930682:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2392064->3145727) req@ffff880095803480 x1830882983044864/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 504/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.930691:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803480 with x1830882983044864 ext(2392064->3145727) 00010000:00010000:2.0:1746066750.930696:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 31 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.930706:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 31 pid: 20361 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066750.930711:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095803480 00000100:00100000:2.0:1746066750.930723:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983044992 00000100:00100000:2.0:1746066750.930726:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983044992 00002000:00100000:2.0:1746066750.930735:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2363391) req@ffff880095800380 x1830882983044992/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.930741:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800380 with x1830882983044992 ext(2097152->2363391) 00010000:00010000:2.0:1746066750.930744:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 20 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.930748:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7cc00/0xf1867c21abfa6062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d56 expref: 14 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.930750:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 20 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066750.930755:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095800380 00010000:00010000:3.0:1746066750.930760:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d56 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.930765:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 878 00010000:00010000:3.0:1746066750.930767:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066750.930769:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:2.0:1746066750.930770:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983044864:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:3.0:1746066750.930771:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c400, rc 0) 00000100:00100000:3.0:1746066750.930793:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:401:x1830882983044352:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4447us (4947us total) trans 8589936508 rc 0/0 00000100:00100000:3.0:1746066750.930799:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16202 00000100:00100000:2.0:1746066750.930950:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984377088:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066750.930962:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066750.930976:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983044608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2972us (3739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.930983:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6940 00000100:00100000:2.0:1746066750.931025:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 879 00000100:00100000:2.0:1746066750.931030:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882983044992:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066750.931309:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.931348:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983045248 00000100:00100000:0.0:1746066750.931352:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983045248 00002000:00100000:0.0:1746066750.931371:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3162112->3166207) req@ffff88012e421c00 x1830882983045248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.931378:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421c00 with x1830882983045248 ext(3162112->3166207) 00002000:00010000:0.0:1746066750.931382:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421c00 00000100:00100000:0.0:1746066750.931405:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4023 00000100:00100000:0.0:1746066750.931411:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983045248:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066750.931515:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983045248:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 104us (205us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066750.931524:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4023 00002000:00100000:0.0:1746066750.931529:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3162112->3166207) req@ffff88012e421c00 x1830882983045248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.931536:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421c00 with x1830882983045248 ext(3162112->3166207) 00002000:00010000:0.0:1746066750.931538:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421c00 00000100:00100000:0.0:1746066750.936171:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.936593:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.936632:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.936933:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983045504 00000100:00100000:3.0:1746066750.936943:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983045504 00000100:00100000:3.0:1746066750.936990:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16203 00000100:00100000:3.0:1746066750.936998:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:401:x1830882983045504:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066750.937025:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.937028:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066750.937057:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c400/0xf1867c21abfa6069 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d56 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.937076:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066750.937080:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066750.937092:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa607e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d64 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.937198:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937211:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937220:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937231:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937237:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937243:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937249:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066750.937253:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937258:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937265:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066750.937268:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066750.937270:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937274:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c800/0xf1867c21abfa6085 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066750.937300:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa607e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d64 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.937307:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa607e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d64 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.937314:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7ce00, rc 0) 00000100:00100000:3.0:1746066750.937358:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:401:x1830882983045504:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 361us (725us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066750.937364:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16203 00000100:00100000:1.0:1746066750.937513:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983046016 00000100:00100000:1.0:1746066750.937517:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983046016 00000100:00100000:1.0:1746066750.937557:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5888 00000100:00100000:1.0:1746066750.937562:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:399:x1830882983046016:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066750.937709:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:399:x1830882983046016:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 146us (1127us total) trans 8589936509 rc 0/0 00000100:00100000:1.0:1746066750.937714:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5888 00000100:00100000:3.0:1746066750.937955:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983045760 00000100:00100000:3.0:1746066750.937960:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983045760 00002000:00100000:3.0:1746066750.937984:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3829760->3833855) req@ffff880095801500 x1830882983045760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.937993:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801500 with x1830882983045760 ext(3829760->3833855) 00002000:00010000:3.0:1746066750.937997:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801500 00000100:00100000:3.0:1746066750.938011:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4024 00000100:00100000:3.0:1746066750.938015:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983045760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066750.938096:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983045760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 80us (1937us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066750.938101:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4024 00002000:00100000:3.0:1746066750.938106:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3829760->3833855) req@ffff880095801500 x1830882983045760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/4536 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.938113:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801500 with x1830882983045760 ext(3829760->3833855) 00002000:00010000:3.0:1746066750.938117:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095801500 00000100:00100000:2.0:1746066750.939570:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983044864:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8793us (9388us total) trans 17179874341 rc 0/0 00000100:00100000:2.0:1746066750.939579:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 878 00002000:00100000:2.0:1746066750.939600:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2392064->3145727) req@ffff880095803480 x1830882983044864/t17179874341(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 504/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066750.939613:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803480 with x1830882983044864 ext(2392064->3145727) 00010000:00010000:2.0:1746066750.939622:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 33 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.939633:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 33 pid: 20361 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066750.939644:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095803480 00000100:00100000:0.0:1746066750.941055:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.941463:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983046144 00000100:00100000:2.0:1746066750.941470:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983046144 00000100:00100000:2.0:1746066750.941510:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15526 00000100:00100000:2.0:1746066750.941517:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882983046144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066750.941533:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.941549:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfa608c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d6b expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.941608:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984377216:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066750.942232:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066750.942342:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882983044992:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 11310us (11864us total) trans 17179874342 rc 0/0 00000100:00100000:3.0:1746066750.942351:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 879 00002000:00100000:3.0:1746066750.942360:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2363391) req@ffff880095800380 x1830882983044992/t17179874342(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.942368:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800380 with x1830882983044992 ext(2097152->2363391) 00010000:00010000:3.0:1746066750.942375:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.942385:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066750.942391:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095800380 00000100:00100000:0.0:1746066750.942537:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.942646:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983046272 00000100:00100000:3.0:1746066750.942651:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983046272 00010000:00010000:3.0:1746066750.942669:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 35 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.942695:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6942 00000100:00100000:3.0:1746066750.942701:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983046272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066750.942710:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066750.942723:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 35 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.942732:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 35 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.942752:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa5fc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2392064->3145727] (req 2392064->3010559) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cd1 expref: 35 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.942766:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066750.942783:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983046272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.942789:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6942 00000100:00100000:0.0:1746066750.944800:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.945025:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983046528 00000100:00100000:2.0:1746066750.945032:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983046528 00000100:00100000:2.0:1746066750.945206:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5889 00000100:00100000:2.0:1746066750.945214:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:400:x1830882983046528:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066750.945403:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.945419:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:400:x1830882983046528:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 205us (624us total) trans 8589936510 rc 0/0 00000100:00100000:2.0:1746066750.945425:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5889 00002000:00010000:3.0:1746066750.945468:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066750 -> 1746066751 00000100:00100000:3.0:1746066750.945482:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984377216:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066750.945508:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfa608c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d6b expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.945519:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfa608c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d6b expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066750.945527:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6a00, rc 0) 00000100:00100000:3.0:1746066750.945549:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983046144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4033us (4498us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066750.945555:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15526 00000100:00100000:1.0:1746066750.946086:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983046656 00000100:00100000:1.0:1746066750.946091:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983046656 00010000:00010000:1.0:1746066750.946111:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066750.946140:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6943 00000100:00100000:1.0:1746066750.946145:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983046656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066750.946160:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066750.946175:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.946186:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.946204:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa5fc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->2392063] (req 2097152->2363391) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cca expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.946217:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.946219:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066750.946226:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.946235:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.946270:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066750.946281:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984377344:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.946345:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.946434:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.946720:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983046912 00000100:00100000:1.0:1746066750.946724:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983046912 00000100:00100000:1.0:1746066750.946757:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5890 00000100:00100000:1.0:1746066750.946764:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:401:x1830882983046912:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066750.946860:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:401:x1830882983046912:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 95us (426us total) trans 8589936511 rc 0/0 00000100:00100000:1.0:1746066750.946866:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5890 00000100:00100000:1.0:1746066750.960968:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984377344:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066750.960993:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066750.961052:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882983046656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 14904us (15647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.961063:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6943 00000100:00100000:3.0:1746066750.961333:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.961416:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983047168 00000100:00100000:0.0:1746066750.961423:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983047168 00002000:00100000:0.0:1746066750.961462:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800a4d80700 x1830882983047168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.961471:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80700 with x1830882983047168 ext(2097152->3145727) 00002000:00010000:0.0:1746066750.961476:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d80700 00000100:00100000:0.0:1746066750.961668:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4025 00000100:00100000:0.0:1746066750.961676:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882983047168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066750.968442:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.968975:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983047424 00000100:00100000:3.0:1746066750.969020:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983047424 00002000:00100000:3.0:1746066750.969065:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095800000 x1830882983047424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.969075:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800000 with x1830882983047424 ext(2097152->3145727) 00002000:00010000:3.0:1746066750.969080:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095800000 00000100:00100000:3.0:1746066750.969111:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4026 00000100:00100000:3.0:1746066750.969118:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983047424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066750.970631:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882983047168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8951us (9294us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066750.970644:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4025 00002000:00100000:0.0:1746066750.970653:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800a4d80700 x1830882983047168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066750.970662:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80700 with x1830882983047168 ext(2097152->3145727) 00002000:00010000:0.0:1746066750.970667:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d80700 00000100:00100000:3.0:1746066750.974707:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983047424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5575us (6261us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066750.974720:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4026 00002000:00100000:3.0:1746066750.974733:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095800000 x1830882983047424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.974742:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800000 with x1830882983047424 ext(2097152->3145727) 00002000:00010000:3.0:1746066750.974749:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095800000 00000100:00100000:0.0:1746066750.978939:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.979015:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983047552 00000100:00100000:3.0:1746066750.979025:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983047552 00000100:00100000:3.0:1746066750.979085:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15527 00000100:00100000:3.0:1746066750.979093:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+31:395:x1830882983047552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.979113:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066750.979131:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d72 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.979164:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.979171:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.979173:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066750.979176:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 32 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.979210:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 42 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066750.979222:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 42 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066750.979234:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984377472:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066750.979786:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800962089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066750.981577:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066750.981909:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983047680 00000100:00100000:2.0:1746066750.981915:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983047680 00000100:00100000:3.0:1746066750.981928:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984377472:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066750.981952:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15528 00010000:00010000:3.0:1746066750.981957:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 32 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.981959:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:405:x1830882983047680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066750.981973:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c000, rc 0) 00010000:00010000:2.0:1746066750.981973:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066750.981987:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d79 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.982004:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.982005:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.982012:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066750.982015:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:395:x1830882983047552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2923us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066750.982021:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15527 00010000:00010000:2.0:1746066750.982030:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.982037:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:2.0:1746066750.982054:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:405:x1830882983047680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.982059:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15528 00000100:00100000:0.0:1746066750.984872:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066750.984999:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983047808 00000100:00100000:3.0:1746066750.985009:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983047808 00002000:00100000:3.0:1746066750.985052:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3166207) req@ffff880095800700 x1830882983047808/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.985062:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800700 with x1830882983047808 ext(3145728->3166207) 00010000:00010000:3.0:1746066750.985070:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 43 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.985089:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 43 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066750.985095:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800700 00000100:00100000:3.0:1746066750.985121:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 880 00000100:00100000:3.0:1746066750.985128:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983047808:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066750.986457:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.987141:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983048064 00000100:00100000:1.0:1746066750.987149:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983048064 00002000:00100000:1.0:1746066750.987189:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012de5dc00 x1830882983048064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/0 e 0 to 0 dl 1746066761 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.987198:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5dc00 with x1830882983048064 ext(2097152->3145727) 00002000:00010000:1.0:1746066750.987203:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5dc00 00000100:00100000:1.0:1746066750.987233:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4027 00000100:00100000:1.0:1746066750.987240:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983048064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066750.988503:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983047808:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3372us (3637us total) trans 21474841786 rc 0/0 00000100:00100000:3.0:1746066750.988512:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 880 00002000:00100000:3.0:1746066750.988519:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3166207) req@ffff880095800700 x1830882983047808/t21474841786(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/448 e 0 to 0 dl 1746066761 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066750.988527:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800700 with x1830882983047808 ext(3145728->3166207) 00010000:00010000:3.0:1746066750.988535:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 45 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066750.988548:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 45 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066750.988555:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800700 00000100:00100000:1.0:1746066750.993799:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983048064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6547us (7334us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066750.993811:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4027 00002000:00100000:1.0:1746066750.993822:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012de5dc00 x1830882983048064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:156/0 lens 488/440 e 0 to 0 dl 1746066761 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066750.993832:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5dc00 with x1830882983048064 ext(2097152->3145727) 00002000:00010000:1.0:1746066750.993838:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5dc00 00000100:00100000:0.0:1746066750.996721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066750.996776:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066750.996786:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983048192 00000100:00100000:1.0:1746066750.996796:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983048192 00000100:00100000:2.0:1746066750.996832:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983048320 00010000:00010000:1.0:1746066750.996833:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 45 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066750.996836:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983048320 00000100:00100000:2.0:1746066750.996863:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15529 00000100:00100000:2.0:1746066750.996870:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:405:x1830882983048320:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066750.996871:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6944 00000100:00100000:1.0:1746066750.996877:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983048192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066750.996909:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066750.996910:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066750.996927:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d80 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066750.996927:0:7232:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066751 -> 1746066752 00010000:00010000:1.0:1746066750.996934:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 46 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066750.996945:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 47 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.996962:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066750.996968:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.996986:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9000/0xf1867c21abfa6023 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3166207) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d33 expref: 47 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066750.996989:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.996997:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.996999:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.997005:0:11630:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.997012:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.997019:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.997020:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066750.997023:0:11630:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066750.997029:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066750.997036:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066750.997056:0:11630:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.997068:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984377600:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066750.997075:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983048192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 197us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066750.997081:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6944 00010000:00010000:2.0:1746066750.997148:0:11630:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066750.997156:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984377728:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066750.997175:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066750.999771:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984377600:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066750.999784:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984377728:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066750.999808:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0e00, rc 0) 00000100:00100000:2.0:1746066750.999937:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:405:x1830882983048320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3065us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066750.999945:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15529 00000100:00100000:0.0:1746066751.001704:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.001756:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983048576 00000100:00100000:1.0:1746066751.001764:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983048576 00002000:00100000:1.0:1746066751.002389:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012de5ce00 x1830882983048576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066751.002400:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ce00 with x1830882983048576 ext(3145728->4194303) 00002000:00010000:1.0:1746066751.002406:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ce00 00000100:00080000:0.0:1746066751.002705:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066751.002763:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4028 00000100:00100000:1.0:1746066751.002773:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983048576:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066751.005469:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.005535:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983048832 00000100:00100000:3.0:1746066751.005544:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983048832 00002000:00100000:3.0:1746066751.005600:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012de5c380 x1830882983048832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.005610:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5c380 with x1830882983048832 ext(3145728->4194303) 00002000:00010000:3.0:1746066751.005619:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5c380 00000100:00080000:0.0:1746066751.005634:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066751.005649:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4029 00000100:00100000:3.0:1746066751.005657:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983048832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.013515:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983048832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7846us (8041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.013526:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4029 00002000:00100000:3.0:1746066751.013536:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012de5c380 x1830882983048832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.013543:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5c380 with x1830882983048832 ext(3145728->4194303) 00000100:00100000:1.0:1746066751.013543:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983048576:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10771us (11842us total) trans 0 rc 1048576/1048576 00002000:00010000:3.0:1746066751.013548:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5c380 00000100:00100000:1.0:1746066751.013550:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4028 00002000:00100000:1.0:1746066751.013555:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012de5ce00 x1830882983048576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066751.013563:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ce00 with x1830882983048576 ext(3145728->4194303) 00002000:00010000:1.0:1746066751.013566:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ce00 00000100:00100000:0.0:1746066751.018120:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.018173:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.018325:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983048960 00000100:00100000:1.0:1746066751.018335:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983048960 00000100:00100000:2.0:1746066751.018460:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983049088 00000100:00100000:2.0:1746066751.018465:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983049088 00000100:00100000:2.0:1746066751.018516:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15530 00000100:00080000:0.0:1746066751.018521:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066751.018525:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:405:x1830882983049088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066751.018548:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066751.018554:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15531 00000100:00100000:1.0:1746066751.018561:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+21:395:x1830882983048960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066751.018565:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d8e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.018570:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.018577:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d87 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.018742:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.018754:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066751.018756:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066751.018760:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.018775:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.018780:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.018852:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.018862:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155de00, rc 0) 00010000:00010000:2.0:1746066751.018866:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.018879:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.018919:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984377856:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.018939:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:395:x1830882983048960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 378us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.018945:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15531 00000100:00100000:2.0:1746066751.018981:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.020498:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984377856:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.020521:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.020534:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0a00, rc 0) 00000100:00100000:2.0:1746066751.020575:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:405:x1830882983049088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2051us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.020594:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15530 00000100:00100000:0.0:1746066751.021092:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.021168:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983049216 00000100:00100000:1.0:1746066751.021174:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983049216 00002000:00100000:1.0:1746066751.021209:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3604480->3833855) req@ffff88012de5d500 x1830882983049216/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066751.021217:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d500 with x1830882983049216 ext(3604480->3833855) 00010000:00010000:1.0:1746066751.021224:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.021235:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:1.0:1746066751.021242:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012de5d500 00000100:00100000:1.0:1746066751.021273:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 881 00000100:00100000:1.0:1746066751.021279:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983049216:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066751.025358:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983049216:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4067us (4255us total) trans 17179874343 rc 0/0 00000100:00100000:1.0:1746066751.025372:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 881 00002000:00100000:1.0:1746066751.025384:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3604480->3833855) req@ffff88012de5d500 x1830882983049216/t17179874343(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066751.025394:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d500 with x1830882983049216 ext(3604480->3833855) 00010000:00010000:1.0:1746066751.025405:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 24 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.025419:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 24 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:1.0:1746066751.025426:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012de5d500 00000100:00100000:0.0:1746066751.027351:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.027406:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983049344 00000100:00100000:1.0:1746066751.027413:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983049344 00010000:00010000:1.0:1746066751.027441:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 24 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.027474:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6945 00000100:00100000:1.0:1746066751.027483:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983049344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066751.027496:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066751.027512:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 24 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.027527:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 24 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.027549:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f9600/0xf1867c21abfa6046 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [3604480->18446744073709551615] (req 3604480->3833855) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d3a expref: 24 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.027573:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.027575:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.027591:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.027600:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.027608:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.027610:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.027613:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.027619:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.027651:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066751.027661:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984377984:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066751.027749:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066751.027757:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984378112:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066751.027775:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.029755:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984377984:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066751.029765:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e422300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984378112:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066751.029782:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.029808:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983049344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2326us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.029817:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6945 00000100:00100000:0.0:1746066751.031422:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.031475:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983049600 00000100:00100000:1.0:1746066751.031480:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983049600 00002000:00100000:1.0:1746066751.031522:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012de5f480 x1830882983049600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066751.031531:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5f480 with x1830882983049600 ext(3145728->4194303) 00002000:00010000:1.0:1746066751.031537:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5f480 00000100:00100000:1.0:1746066751.031566:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4030 00000100:00100000:1.0:1746066751.031573:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983049600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066751.036689:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.037309:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983049856 00000100:00100000:3.0:1746066751.037319:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983049856 00002000:00100000:3.0:1746066751.037364:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012e422300 x1830882983049856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.037374:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422300 with x1830882983049856 ext(3145728->4194303) 00002000:00010000:3.0:1746066751.037379:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e422300 00000100:00100000:3.0:1746066751.037413:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4031 00000100:00100000:3.0:1746066751.037420:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983049856:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066751.039070:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983049600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7490us (7642us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066751.039080:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4030 00002000:00100000:0.0:1746066751.039089:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012de5f480 x1830882983049600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066751.039103:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5f480 with x1830882983049600 ext(3145728->4194303) 00002000:00010000:0.0:1746066751.039107:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5f480 00000100:00100000:0.0:1746066751.045082:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.045133:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983050112 00000100:00100000:1.0:1746066751.045141:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983050112 00000100:00100000:3.0:1746066751.045209:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983049856:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7786us (8530us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.045220:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4031 00002000:00100000:3.0:1746066751.045231:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012e422300 x1830882983049856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066751.045243:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012de5ca80 x1830882983050112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.045247:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422300 with x1830882983049856 ext(3145728->4194303) 00002000:00010000:3.0:1746066751.045252:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e422300 00002000:00100000:1.0:1746066751.045258:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ca80 with x1830882983050112 ext(4194304->5033983) 00002000:00010000:1.0:1746066751.045261:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ca80 00000100:00100000:3.0:1746066751.045275:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4032 00000100:00100000:3.0:1746066751.045283:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983050112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.051086:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983050112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5790us (5999us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066751.051099:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4032 00002000:00100000:3.0:1746066751.051113:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012de5ca80 x1830882983050112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.051124:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ca80 with x1830882983050112 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.051130:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ca80 00000100:00100000:0.0:1746066751.060030:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.060134:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983050368 00000100:00100000:3.0:1746066751.060145:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983050368 00002000:00100000:3.0:1746066751.060364:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012de5d880 x1830882983050368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.060375:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d880 with x1830882983050368 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.060380:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5d880 00000100:00100000:3.0:1746066751.062696:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4033 00000100:00100000:3.0:1746066751.062712:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983050368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.071602:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983050368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8871us (11559us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066751.071614:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4033 00002000:00100000:3.0:1746066751.071628:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012de5d880 x1830882983050368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.071636:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d880 with x1830882983050368 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.071642:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5d880 00000100:00100000:0.0:1746066751.077042:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.077409:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983050624 00000100:00100000:2.0:1746066751.077419:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983050624 00000100:00100000:2.0:1746066751.077482:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16204 00000100:00100000:2.0:1746066751.077491:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:411:x1830882983050624:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.077518:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.077719:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa60b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d95 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.077840:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.077855:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.077866:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066751.077876:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066751.080562:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa60b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.080614:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 25 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.080623:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066751.080626:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066751.080629:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1000, rc 0) 00000100:00100000:2.0:1746066751.080711:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:411:x1830882983050624:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3219us (3677us total) trans 8589936512 rc 0/0 00000100:00100000:2.0:1746066751.080720:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16204 00000100:00100000:2.0:1746066751.081421:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.081482:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983050880 00000100:00100000:0.0:1746066751.081489:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983050880 00000100:00100000:0.0:1746066751.081527:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16205 00000100:00100000:0.0:1746066751.081534:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:412:x1830882983050880:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066751.081554:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.081566:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa60cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0d9c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.081667:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.081680:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.081691:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066751.081702:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066751.081846:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa60cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 43 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.081874:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 42 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.081908:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066751.081910:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066751.081912:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93de00, rc 0) 00000100:00100000:0.0:1746066751.081935:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:412:x1830882983050880:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 402us (515us total) trans 8589936513 rc 0/0 00000100:00100000:0.0:1746066751.081940:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16205 00000100:00100000:0.0:1746066751.151069:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.151923:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983051008 00000100:00100000:2.0:1746066751.151935:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983051008 00000100:00100000:2.0:1746066751.152716:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15532 00000100:00100000:2.0:1746066751.152725:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:411:x1830882983051008:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.152749:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.152771:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0da3 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.152806:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.152815:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 33 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.152822:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.152828:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.152829:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.152833:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1642496->2097151] (req 1642496->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.152872:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.152912:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 18 pid: 11630 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.152928:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378240:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.153504:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 33 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.153514:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 33 pid: 9592 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.153524:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378368:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.153565:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.153574:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.153595:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378496:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.153624:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.158658:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.158717:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.158753:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983051264 00000100:00100000:3.0:1746066751.158764:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983051264 00010000:00010000:3.0:1746066751.158805:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 34 pid: 9592 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746066751.158838:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983051136 00000100:00100000:3.0:1746066751.158841:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983051136 00010000:00010000:3.0:1746066751.158854:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 19 pid: 11630 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746066751.158876:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6946 00000100:00100000:3.0:1746066751.158913:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882983051264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.158929:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.158954:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 34 pid: 9592 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.158965:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 34 pid: 9592 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.158995:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.159045:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882983051264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.159053:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6946 00000100:00100000:3.0:1746066751.159074:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6947 00000100:00100000:3.0:1746066751.159081:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882983051136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.159091:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.159100:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 19 pid: 11630 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.159109:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 19 pid: 11630 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.159122:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.159141:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882983051136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.159147:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6947 00000100:00100000:3.0:1746066751.159240:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.159262:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983051392 00000100:00100000:3.0:1746066751.159267:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983051392 00010000:00010000:3.0:1746066751.159282:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 45 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.159304:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6948 00000100:00100000:3.0:1746066751.159310:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882983051392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.159318:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.159327:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 45 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.159339:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 45 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.159352:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.159354:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.159366:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.159375:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.159405:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.159418:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984378624:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.159475:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746066751.160425:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa5ed3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c1b expref: 18 pid: 11630 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.161211:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378240:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.161237:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f9c200/0xf1867c21abfa5ef6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0c37 expref: 33 pid: 9592 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.161248:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378368:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.161263:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc0200/0xf1867c21abfa5ea2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bff expref: 45 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.161272:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378496:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.161313:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.161332:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0000, rc 0) 00000100:00100000:2.0:1746066751.161393:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:411:x1830882983051008:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8668us (10522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.161401:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15532 00000100:00100000:3.0:1746066751.166038:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984378624:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.166060:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.166104:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983051392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6793us (6864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.166115:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6948 00000100:00100000:0.0:1746066751.167986:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.168124:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983051648 00000100:00100000:3.0:1746066751.168132:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983051648 00002000:00100000:3.0:1746066751.168236:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1642496->1646591) req@ffff88012de5ea00 x1830882983051648/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.168251:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ea00 with x1830882983051648 ext(1642496->1646591) 00002000:00010000:3.0:1746066751.168256:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ea00 00000100:00100000:3.0:1746066751.168282:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4034 00000100:00100000:3.0:1746066751.168289:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983051648:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.168598:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983051648:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 308us (621us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066751.168606:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4034 00002000:00100000:3.0:1746066751.168611:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1642496->1646591) req@ffff88012de5ea00 x1830882983051648/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.168618:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ea00 with x1830882983051648 ext(1642496->1646591) 00002000:00010000:3.0:1746066751.168621:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ea00 00000100:00100000:0.0:1746066751.178323:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.178461:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983051776 00000100:00100000:2.0:1746066751.178472:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983051776 00000100:00100000:2.0:1746066751.178603:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15533 00000100:00100000:2.0:1746066751.178612:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:411:x1830882983051776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.178631:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.178648:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0daa expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.178677:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.178686:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.178692:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.178694:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.178697:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.178726:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.178743:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 43 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.178754:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378752:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.178854:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.178862:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 33 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.178869:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378880:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.178914:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.181556:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378752:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.181567:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984378880:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.181608:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->2301951] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.181624:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f600, rc 0) 00000100:00100000:2.0:1746066751.181671:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+33:411:x1830882983051776:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3059us (3359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.181679:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15533 00000100:00100000:0.0:1746066751.188109:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.188210:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983051904 00000100:00100000:3.0:1746066751.188221:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983051904 00000100:00100000:0.0:1746066751.188420:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066751.188470:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.188512:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983052032 00000100:00100000:3.0:1746066751.188515:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983052032 00010000:00010000:3.0:1746066751.188525:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 33 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.188542:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6949 00000100:00100000:3.0:1746066751.188549:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983051904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.188562:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.188595:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.188606:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.188659:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0e00/0xf1867c21abfa60a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d80 expref: 44 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.188675:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6950 00010000:00010000:3.0:1746066751.188681:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.188682:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983052032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066751.188689:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066751.188697:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 33 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.188705:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 33 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.188717:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa6093 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d72 expref: 33 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.188721:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983051904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 172us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.188727:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6949 00010000:00010000:1.0:1746066751.188730:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.188732:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.188738:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.188746:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.188778:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 32 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066751.188791:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984379008:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066751.189019:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.189757:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984379008:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066751.189772:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.189791:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983052032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1111us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.189798:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6950 00000100:00100000:0.0:1746066751.193467:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.194323:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983052288 00000100:00100000:3.0:1746066751.194333:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983052288 00002000:00100000:3.0:1746066751.194381:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2297856->2301951) req@ffff88012de5e300 x1830882983052288/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.194391:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5e300 with x1830882983052288 ext(2297856->2301951) 00002000:00010000:3.0:1746066751.194397:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5e300 00000100:00100000:3.0:1746066751.194434:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4035 00000100:00100000:3.0:1746066751.194442:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983052288:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.194604:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983052288:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 162us (1146us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066751.194611:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4035 00002000:00100000:3.0:1746066751.194616:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2297856->2301951) req@ffff88012de5e300 x1830882983052288/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.194630:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5e300 with x1830882983052288 ext(2297856->2301951) 00002000:00010000:3.0:1746066751.194633:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5e300 00000100:00100000:0.0:1746066751.198987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.199612:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983052416 00000100:00100000:3.0:1746066751.199623:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983052416 00000100:00100000:1.0:1746066751.201383:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15534 00000100:00100000:1.0:1746066751.201551:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:412:x1830882983052416:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066751.201572:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.201598:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0db1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.201630:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.201638:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.201640:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.201644:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.201679:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 31 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.201692:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 31 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.201704:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984379136:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.203796:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.209102:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.209234:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984379136:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066751.209268:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3858432->4194303] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.209289:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097393400, rc 0) 00000100:00100000:1.0:1746066751.209334:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:412:x1830882983052416:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7941us (10355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.209343:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15534 00000100:00100000:2.0:1746066751.209437:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983052544 00000100:00100000:2.0:1746066751.209534:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983052544 00002000:00100000:2.0:1746066751.209576:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2301951) req@ffff880096fd4380 x1830882983052544/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.209593:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4380 with x1830882983052544 ext(2097152->2301951) 00010000:00010000:2.0:1746066751.209599:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.209611:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 32 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066751.209617:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd4380 00000100:00100000:3.0:1746066751.210001:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 882 00000100:00100000:3.0:1746066751.210010:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983052544:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066751.213262:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.213655:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983052800 00000100:00100000:2.0:1746066751.213664:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983052800 00002000:00100000:2.0:1746066751.213704:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1642495) req@ffff880096fd7100 x1830882983052800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.213713:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7100 with x1830882983052800 ext(1048576->1642495) 00002000:00010000:2.0:1746066751.213718:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd7100 00000100:00100000:2.0:1746066751.213783:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4036 00000100:00100000:2.0:1746066751.213791:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2013:x1830882983052800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.216337:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983052544:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6320us (7237us total) trans 21474841787 rc 0/0 00000100:00100000:3.0:1746066751.216348:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 882 00002000:00100000:3.0:1746066751.216844:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2301951) req@ffff880096fd4380 x1830882983052544/t21474841787(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.216855:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4380 with x1830882983052544 ext(2097152->2301951) 00010000:00010000:3.0:1746066751.216865:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.216918:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.216926:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd4380 00000100:00100000:2.0:1746066751.218095:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2013:x1830882983052800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4300us (4835us total) trans 0 rc 593920/593920 00000100:00100000:2.0:1746066751.218104:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4036 00002000:00100000:2.0:1746066751.218115:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1642495) req@ffff880096fd7100 x1830882983052800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 593920/593920 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.218124:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7100 with x1830882983052800 ext(1048576->1642495) 00002000:00010000:2.0:1746066751.218127:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd7100 00000100:00100000:0.0:1746066751.220236:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.220327:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983052928 00000100:00100000:1.0:1746066751.220336:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983052928 00010000:00010000:1.0:1746066751.220370:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 34 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.220410:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6951 00000100:00100000:1.0:1746066751.220418:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983052928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066751.220431:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066751.220445:0:7232:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066751 -> 1746066752 00002000:00010000:1.0:1746066751.220447:0:7232:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066751 -> 1746066752 00010000:00010000:1.0:1746066751.220450:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 34 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.220458:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 34 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.220475:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa60e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2301951) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0daa expref: 34 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.220498:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.220500:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.220507:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.220515:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.220548:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066751.220560:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984379264:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066751.220678:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.223055:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984379264:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066751.223077:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.223111:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983052928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2692us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.223120:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6951 00000100:00100000:0.0:1746066751.223676:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.223808:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983053184 00000100:00100000:2.0:1746066751.223815:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983053184 00002000:00100000:2.0:1746066751.223852:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3858432->3862527) req@ffff880096fd4000 x1830882983053184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.223862:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4000 with x1830882983053184 ext(3858432->3862527) 00002000:00010000:2.0:1746066751.223867:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd4000 00000100:00100000:2.0:1746066751.223917:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4037 00000100:00100000:2.0:1746066751.223925:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983053184:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066751.224046:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983053184:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 121us (369us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066751.224052:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4037 00002000:00100000:2.0:1746066751.224056:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3858432->3862527) req@ffff880096fd4000 x1830882983053184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.224064:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4000 with x1830882983053184 ext(3858432->3862527) 00002000:00010000:2.0:1746066751.224066:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd4000 00000100:00100000:0.0:1746066751.224351:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.224644:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983053312 00000100:00100000:1.0:1746066751.224648:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983053312 00000100:00100000:1.0:1746066751.224683:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15535 00000100:00100000:1.0:1746066751.224688:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:417:x1830882983053312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.224697:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.224713:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0db8 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.224741:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.224749:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.224750:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.224754:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.224779:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.224791:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 43 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.224802:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984379392:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.224879:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.229964:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984379392:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066751.229998:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.230016:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44e00, rc 0) 00000100:00100000:1.0:1746066751.230605:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:417:x1830882983053312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5914us (6251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.230616:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15535 00000100:00100000:0.0:1746066751.232014:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.232060:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.232321:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983053568 00000100:00100000:1.0:1746066751.232329:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983053568 00000100:00100000:1.0:1746066751.232418:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15536 00000100:00100000:1.0:1746066751.232427:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:412:x1830882983053568:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066751.232447:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.232464:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0dbf expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.232494:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 35 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.232497:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983053696 00000100:00100000:2.0:1746066751.232502:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983053696 00010000:00010000:1.0:1746066751.232503:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.232509:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.232511:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.232514:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->3604479] (req 3145728->3604479) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746066751.232533:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3858432->4194303) req@ffff880096fd6d80 x1830882983053696/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.232542:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd6d80 with x1830882983053696 ext(3858432->4194303) 00010000:00010000:1.0:1746066751.232545:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.232549:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 44 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.232556:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 22 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.232558:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 44 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.232568:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984379520:192.168.204.16@tcp:104: 00002000:00010000:2.0:1746066751.232569:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd6d80 00000100:00100000:2.0:1746066751.232604:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 883 00000100:00100000:2.0:1746066751.232610:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983053696:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:1.0:1746066751.232649:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 35 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.232661:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 35 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.232669:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984379648:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.232687:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.240062:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.240221:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983053824 00000100:00100000:2.0:1746066751.240229:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983053824 00010000:00010000:2.0:1746066751.240262:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 23 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.240296:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6952 00000100:00100000:2.0:1746066751.240304:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983053824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.240317:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.240333:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 23 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.240343:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 23 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.240363:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066751.240450:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155de00/0xf1867c21abfa60af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d87 expref: 23 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.240465:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984379520:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.240475:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984379648:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066751.240495:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->3604479] (req 3145728->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.240504:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44000, rc 0) 00000100:00100000:1.0:1746066751.240538:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:412:x1830882983053568:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8112us (8527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.240544:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15536 00000100:00100000:2.0:1746066751.241113:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983053824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 809us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.241119:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6952 00000100:00100000:2.0:1746066751.241642:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.241659:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983053952 00000100:00100000:2.0:1746066751.241662:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983053952 00010000:00010000:2.0:1746066751.241677:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 35 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.241728:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6953 00000100:00100000:3.0:1746066751.241743:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983053952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.241759:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.241779:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 35 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.241791:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 35 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.241812:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0a00/0xf1867c21abfa60a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d8e expref: 35 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.241837:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.241839:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.241847:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.241855:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.242458:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.242471:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984379776:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.242538:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.245784:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984379776:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.245808:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.246813:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983053952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5071us (5167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.246826:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6953 00000100:00100000:2.0:1746066751.246834:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983053696:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 14216us (14765us total) trans 21474841788 rc 0/0 00000100:00100000:2.0:1746066751.246845:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 883 00002000:00100000:2.0:1746066751.246855:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3858432->4194303) req@ffff880096fd6d80 x1830882983053696/t21474841788(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.246863:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd6d80 with x1830882983053696 ext(3858432->4194303) 00010000:00010000:2.0:1746066751.246872:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 46 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.246981:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 46 pid: 20361 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066751.246987:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096fd6d80 00000100:00100000:0.0:1746066751.252880:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.255189:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.255281:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983054208 00000100:00100000:2.0:1746066751.255288:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983054208 00000100:00100000:3.0:1746066751.255298:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983054336 00000100:00100000:3.0:1746066751.255309:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983054336 00002000:00100000:2.0:1746066751.255327:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3600384->3604479) req@ffff880096fd5180 x1830882983054208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.255336:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5180 with x1830882983054208 ext(3600384->3604479) 00002000:00010000:2.0:1746066751.255340:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd5180 00010000:00010000:3.0:1746066751.255343:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 46 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.255358:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4038 00000100:00100000:2.0:1746066751.255364:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983054208:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.255387:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6954 00000100:00100000:3.0:1746066751.255394:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882983054336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.255407:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.255428:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 46 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.255441:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 46 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.255462:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097393400/0xf1867c21abfa60ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3858432->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db1 expref: 46 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.255488:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.255491:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.255499:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.255507:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.255510:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983054208:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 146us (2637us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066751.255518:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4038 00002000:00100000:2.0:1746066751.255522:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3600384->3604479) req@ffff880096fd5180 x1830882983054208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.255529:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5180 with x1830882983054208 ext(3600384->3604479) 00002000:00010000:2.0:1746066751.255531:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd5180 00010000:00010000:3.0:1746066751.255540:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.255552:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984379904:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.255632:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.260354:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984379904:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.260384:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.260437:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882983054336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5040us (5249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.260448:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6954 00000100:00100000:0.0:1746066751.265067:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.265179:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983054592 00000100:00100000:2.0:1746066751.265190:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983054592 00002000:00100000:2.0:1746066751.265239:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096fd4700 x1830882983054592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.265250:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4700 with x1830882983054592 ext(2097152->4194303) 00002000:00010000:2.0:1746066751.265256:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd4700 00000100:00100000:2.0:1746066751.265277:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4039 00000100:00100000:2.0:1746066751.265286:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983054592:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.278436:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.279145:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983054720 00000100:00100000:2.0:1746066751.279156:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983054720 00000100:00100000:2.0:1746066751.279216:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16206 00000100:00100000:2.0:1746066751.279225:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:420:x1830882983054720:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066751.279253:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.279271:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f600/0xf1867c21abfa6103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0dc6 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.279333:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279346:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279358:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279370:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279375:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279381:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279449:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279460:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 24 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.279466:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 41 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.279472:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.279500:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 41 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.279510:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 41 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.279521:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984380032:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.279616:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 24 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.279622:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 24 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.279630:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984380160:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.279644:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.280164:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983054592:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14877us (15103us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066751.280174:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4039 00002000:00100000:3.0:1746066751.280184:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096fd4700 x1830882983054592/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.280193:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4700 with x1830882983054592 ext(2097152->4194303) 00002000:00010000:3.0:1746066751.280198:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd4700 00000100:00100000:0.0:1746066751.288803:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.288839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.288871:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.288924:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.288953:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.288990:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983055360 00000100:00100000:0.0:1746066751.288998:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983055360 00000100:00100000:0.0:1746066751.289043:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983055488 00000100:00100000:0.0:1746066751.289045:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983055488 00000100:00100000:0.0:1746066751.289058:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983055616 00000100:00100000:0.0:1746066751.289059:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983055616 00000100:00100000:0.0:1746066751.289075:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15537 00000100:00100000:0.0:1746066751.289083:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983055360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066751.289105:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.289123:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfa611f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0dcd expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066751.289181:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984380288:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.289261:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.289277:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15538 00000100:00100000:0.0:1746066751.289282:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983055488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066751.289288:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.289294:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0dd4 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.289306:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066751.289308:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066751.289317:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 48 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.289334:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 48 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.289345:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094540200, rc 0) 00000100:00100000:0.0:1746066751.289366:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983055488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.289371:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15538 00000100:00100000:0.0:1746066751.289385:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15539 00000100:00100000:0.0:1746066751.289389:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983055616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066751.289396:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.289404:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfa612d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ddb expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066751.289425:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984380416:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.289444:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800975583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.290834:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984380032:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.290845:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984380160:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.290869:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066751.290994:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983054976 00000100:00100000:3.0:1746066751.291000:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983054976 00000100:00100000:3.0:1746066751.291040:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983055232 00000100:00100000:3.0:1746066751.291043:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983055232 00000100:00100000:3.0:1746066751.291058:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5891 00000100:00100000:3.0:1746066751.291064:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+25:30847:x1830882983054976:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066751.291066:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5892 00000100:00100000:0.0:1746066751.291072:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:313:x1830882983055232:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746066751.291786:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:313:x1830882983055232:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 712us (2945us total) trans 8589936515 rc 0/0 00000100:00100000:0.0:1746066751.291791:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5892 00000100:00100000:3.0:1746066751.291930:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+26:30847:x1830882983054976:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 865us (3136us total) trans 8589936514 rc 0/0 00000100:00100000:3.0:1746066751.291936:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5891 00000100:00100000:0.0:1746066751.297027:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.297093:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983055744 00000100:00100000:1.0:1746066751.297102:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983055744 00000100:00100000:1.0:1746066751.297150:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15540 00000100:00100000:1.0:1746066751.297158:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:417:x1830882983055744:12345-192.168.204.16@tcp:101:cat.0 00002000:00010000:2.0:1746066751.297286:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066751 -> 1746066752 00002000:00010000:2.0:1746066751.297289:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066751 -> 1746066752 00002000:00010000:2.0:1746066751.297291:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066751 -> 1746066752 00000100:00100000:2.0:1746066751.297310:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984380288:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066751.297344:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfa611f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dcd expref: 47 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.297357:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d31c00/0xf1867c21abfa611f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dcd expref: 47 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.297383:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31c00, rc 0) 00000100:00100000:2.0:1746066751.297428:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983055360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8345us (8556us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.297439:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15537 00010000:00010000:1.0:1746066751.297742:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.297759:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0de2 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.297784:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.297791:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.297792:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.297795:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.297826:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.297836:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 35 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.297849:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984380544:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.297951:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.299981:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.300389:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983055872 00000100:00100000:3.0:1746066751.300397:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983055872 00010000:00010000:3.0:1746066751.300429:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 26 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.300458:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6955 00000100:00100000:3.0:1746066751.300463:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983055872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.300473:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.300478:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 26 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.300487:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 26 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.300505:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1000/0xf1867c21abfa60bd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d95 expref: 26 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.300521:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066751.300525:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.300532:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.300537:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.300541:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746066751.301318:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066751 -> 1746066752 00002000:00010000:1.0:1746066751.301322:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066751 -> 1746066752 00002000:00010000:1.0:1746066751.301324:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066751 -> 1746066752 00000100:00100000:1.0:1746066751.301340:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d89f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984380416:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066751.301365:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfa612d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ddb expref: 35 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.301374:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094540800/0xf1867c21abfa612d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ddb expref: 35 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066751.301638:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882983055872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1172us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.301645:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6955 00010000:00010000:1.0:1746066751.302373:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094540800, rc 0) 00000100:00100000:1.0:1746066751.302413:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983055616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 13022us (13458us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066751.302419:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15539 00000100:00100000:0.0:1746066751.304208:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.304361:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983056000 00000100:00100000:3.0:1746066751.304369:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983056000 00010000:00010000:3.0:1746066751.304402:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 43 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.304532:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6956 00000100:00100000:3.0:1746066751.304539:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983056000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.304550:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.304556:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 43 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.304566:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 43 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.304594:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93de00/0xf1867c21abfa60d2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d9c expref: 43 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.304608:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066751.304612:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.304621:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.304628:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.304648:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.304681:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983056000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.304686:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6956 00010000:00010000:0.0:1746066751.304769:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304776:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066751.304829:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:0.0:1746066751.304833:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746066751.304850:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304859:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304870:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304875:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304900:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304906:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304911:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80f000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066751.304915:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304920:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304928:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066751.304931:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066751.304934:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.304938:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f000/0xf1867c21abfa610a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306803:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306814:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306819:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306824:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80f800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066751.306827:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306833:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306845:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093a37f00) 00010000:00010000:0.0:1746066751.306848:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066751.306851:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306855:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa6111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.306921:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f600/0xf1867c21abfa6103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 15 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.306935:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.306947:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066751.306950:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066751.306952:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fc00, rc 0) 00000100:00100000:0.0:1746066751.307011:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:420:x1830882983054720:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 27786us (28583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.307018:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16206 00000100:00100000:2.0:1746066751.310764:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.310870:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983056128 00000100:00100000:1.0:1746066751.311245:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984380544:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066751.311279:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.311298:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45200, rc 0) 00000100:00100000:1.0:1746066751.311347:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:417:x1830882983055744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 14189us (14331us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.311357:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15540 00000100:00100000:3.0:1746066751.311644:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983056128 00002000:00100000:3.0:1746066751.311685:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3604479) req@ffff880098fbfb80 x1830882983056128/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.311694:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbfb80 with x1830882983056128 ext(3145728->3604479) 00010000:00010000:3.0:1746066751.311702:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 34 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.311714:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 34 pid: 20361 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.311720:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbfb80 00000100:00100000:3.0:1746066751.311792:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 884 00000100:00100000:3.0:1746066751.311799:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983056128:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066751.321072:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.321114:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.321126:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.322264:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.322345:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983056256 00000100:00100000:1.0:1746066751.322354:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983056256 00000100:00100000:1.0:1746066751.322402:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983056384 00000100:00100000:1.0:1746066751.322405:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983056384 00000100:00100000:1.0:1746066751.322416:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983056640 00000100:00100000:1.0:1746066751.322418:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983056640 00000100:00100000:1.0:1746066751.322440:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15541 00000100:00100000:1.0:1746066751.322448:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:423:x1830882983056256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.322467:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.322484:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0de9 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.322515:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.322523:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.322525:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.322528:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.322559:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.322569:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 33 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746066751.322584:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983056512 00000100:00100000:0.0:1746066751.322587:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983056512 00000100:00100000:1.0:1746066751.322590:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984380672:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.323064:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15542 00000100:00100000:2.0:1746066751.323072:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983056384:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066751.323080:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.323087:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfa6142 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0df0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066751.323087:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15543 00000100:00100000:0.0:1746066751.323093:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882983056640:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066751.323100:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.323108:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa6149 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0dfe expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.323113:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984380800:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.323131:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984380928:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.323167:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.323173:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15544 00000100:00100000:3.0:1746066751.323181:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2014:x1830882983056512:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066751.323187:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.323193:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0df7 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.323203:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.323204:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.323210:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.323222:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.323235:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d200, rc 0) 00000100:00100000:2.0:1746066751.323655:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.324136:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882983056512:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 954us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.324143:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15544 00000100:00100000:1.0:1746066751.324988:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.326533:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882983056128:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 14728us (15773us total) trans 17179874344 rc 0/0 00000100:00100000:2.0:1746066751.326543:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 884 00002000:00100000:2.0:1746066751.326555:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3604479) req@ffff880098fbfb80 x1830882983056128/t17179874344(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.326565:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbfb80 with x1830882983056128 ext(3145728->3604479) 00010000:00010000:2.0:1746066751.326586:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 36 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.326600:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 36 pid: 20361 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066751.326608:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbfb80 00000100:00100000:0.0:1746066751.329415:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.329521:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984380928:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066751.329553:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa6149 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dfe expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.329565:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094540e00/0xf1867c21abfa6149 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dfe expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066751.329680:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983056896 00000100:00100000:1.0:1746066751.329687:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983056896 00000100:00100000:1.0:1746066751.329739:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16207 00000100:00100000:1.0:1746066751.329746:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:425:x1830882983056896:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066751.330102:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.330120:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44800/0xf1867c21abfa6157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e05 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.330219:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066751.330233:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.330244:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066751.330274:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.330285:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 13 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.330296:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984381056:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.330367:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.330526:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e423100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984380672:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066751.330543:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 47 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.330555:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44a00, rc 0) 00000100:00100000:1.0:1746066751.330588:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:423:x1830882983056256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8129us (9514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.330596:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15541 00000100:00100000:1.0:1746066751.330684:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984380800:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066751.330700:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfa6142 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df0 expref: 20 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.330709:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1000/0xf1867c21abfa6142 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df0 expref: 20 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.330758:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094540e00, rc 0) 00000100:00100000:2.0:1746066751.330859:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882983056640:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 7765us (9729us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.330866:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15543 00000100:00100000:0.0:1746066751.331678:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066751.332042:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1000, rc 0) 00000100:00100000:2.0:1746066751.332174:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983057024 00000100:00100000:2.0:1746066751.332180:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983057024 00002000:00100000:2.0:1746066751.332217:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1642496->2097151) req@ffff880130d88000 x1830882983057024/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.332226:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88000 with x1830882983057024 ext(1642496->2097151) 00010000:00010000:2.0:1746066751.332236:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 34 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.332246:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 34 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:2.0:1746066751.332253:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d88000 00000100:00100000:2.0:1746066751.332278:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 885 00000100:00100000:2.0:1746066751.332289:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983057024:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066751.332569:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983056384:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9496us (11452us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066751.332585:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15542 00000100:00100000:0.0:1746066751.332693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.332862:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.332931:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983057152 00000100:00100000:3.0:1746066751.332935:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983057152 00000100:00100000:0.0:1746066751.332947:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e421180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984381056:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066751.332954:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 36 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746066751.332964:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066751.332970:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983057280 00000100:00100000:3.0:1746066751.332972:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983057280 00010000:00010000:3.0:1746066751.332981:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 14 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.333045:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6957 00000100:00100000:2.0:1746066751.333051:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882983057152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.333061:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.333077:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 36 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.333091:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 36 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.333113:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44000/0xf1867c21abfa60fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3604479) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dbf expref: 36 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.333139:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.333141:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.333148:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.333156:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.333186:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.333197:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984381184:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066751.333256:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.333303:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6958 00000100:00100000:3.0:1746066751.333309:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983057280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.333318:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.333323:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 14 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.333331:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 14 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.333344:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fc00/0xf1867c21abfa6118 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dc6 expref: 14 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.333363:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066751.333367:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.333375:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.333381:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.333393:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.333410:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983057280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.333416:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6958 00010000:00010000:0.0:1746066751.333474:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.333480:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066751.333496:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066751.333620:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa44800/0xf1867c21abfa6157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.333633:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 27 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.333639:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066751.333642:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066751.334223:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45600, rc 0) 00000100:00100000:1.0:1746066751.334859:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:425:x1830882983056896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5111us (5450us total) trans 8589936516 rc 0/0 00000100:00100000:1.0:1746066751.334867:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16207 00000100:00100000:1.0:1746066751.336088:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.336197:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984381184:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.336218:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.336246:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983057152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3195us (3553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.336254:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6957 00000100:00100000:0.0:1746066751.337172:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983057408 00000100:00100000:0.0:1746066751.337179:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983057408 00000100:00100000:0.0:1746066751.337230:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16208 00000100:00100000:0.0:1746066751.337237:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:420:x1830882983057408:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066751.337259:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.337276:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa616c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e0c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.337463:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa616c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e0c expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.337478:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa616c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e0c expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.337496:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066751.337498:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066751.337502:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541a00, rc 0) 00000100:00100000:0.0:1746066751.337528:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:420:x1830882983057408:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 292us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.337533:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16208 00000100:00100000:0.0:1746066751.339311:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.339442:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983057024:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7152us (7764us total) trans 21474841789 rc 0/0 00000100:00100000:3.0:1746066751.339450:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 885 00002000:00100000:3.0:1746066751.339459:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1642496->2097151) req@ffff880130d88000 x1830882983057024/t21474841789(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.339468:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88000 with x1830882983057024 ext(1642496->2097151) 00010000:00010000:3.0:1746066751.339477:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.339489:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.339495:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d88000 00000100:00100000:2.0:1746066751.339699:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983057664 00000100:00100000:2.0:1746066751.339706:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983057664 00002000:00100000:2.0:1746066751.339734:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880130d8b100 x1830882983057664/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.339741:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b100 with x1830882983057664 ext(3145728->4194303) 00002000:00010000:2.0:1746066751.339744:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8b100 00000100:00100000:2.0:1746066751.339770:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4040 00000100:00100000:2.0:1746066751.339776:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983057664:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066751.342676:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.342990:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983058048 00000100:00100000:0.0:1746066751.342999:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983058048 00000100:00100000:0.0:1746066751.343053:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16209 00000100:00100000:0.0:1746066751.343061:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:420:x1830882983058048:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066751.343079:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.343097:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c000/0xf1867c21abfa6173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e13 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.343179:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343195:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343206:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343218:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343224:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343229:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343346:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa6188 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343356:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa6188 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343362:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa6188 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:0.0:1746066751.343370:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066751.343437:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343442:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343448:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343452:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343458:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d93da00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066751.343461:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343467:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343476:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066751.343479:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066751.343481:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343486:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa617a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343496:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343500:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343505:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343507:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d93dc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066751.343509:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343513:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343517:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098485100) 00010000:00010000:0.0:1746066751.343518:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066751.343520:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343524:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa6181 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.343555:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c000/0xf1867c21abfa6173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e13 expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.343566:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa6188 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e13 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.343571:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066751.343572:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066751.343586:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5400, rc 0) 00000100:00100000:0.0:1746066751.343639:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:420:x1830882983058048:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 578us (971us total) trans 8589936517 rc 0/0 00000100:00100000:0.0:1746066751.343644:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16209 00000100:00100000:1.0:1746066751.344199:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.344244:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983057792 00000100:00100000:3.0:1746066751.344248:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983057792 00010000:00010000:3.0:1746066751.344268:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.344738:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6959 00000100:00100000:3.0:1746066751.344744:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+36:2013:x1830882983057792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.344755:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.344773:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.344783:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.344798:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0000/0xf1867c21abfa60e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1642496->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0da3 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.344828:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.344830:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.344837:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.344847:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.344878:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 46 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.344906:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984381312:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.344980:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.346366:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983057664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6586us (7053us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066751.346375:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4040 00002000:00100000:2.0:1746066751.346384:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880130d8b100 x1830882983057664/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.346392:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b100 with x1830882983057664 ext(3145728->4194303) 00002000:00010000:2.0:1746066751.346397:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8b100 00000100:00100000:3.0:1746066751.346917:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984381312:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.346936:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.346955:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+35:2013:x1830882983057792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2211us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.346963:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6959 00000100:00100000:0.0:1746066751.347081:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.347100:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983058304 00000100:00100000:0.0:1746066751.347105:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983058304 00000100:00100000:0.0:1746066751.347142:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16210 00000100:00100000:0.0:1746066751.347148:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:420:x1830882983058304:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066751.347293:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.347311:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfa6196 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e1a expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.347408:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.347427:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.347433:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.347457:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.347469:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 26 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746066751.347479:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984381440:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.347532:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.348772:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984381440:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.348787:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066751.348810:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.348848:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983058432 00000100:00100000:3.0:1746066751.348853:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983058432 00010000:00010000:3.0:1746066751.348872:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 27 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.348923:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6960 00000100:00100000:3.0:1746066751.348929:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882983058432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.348939:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.348943:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 27 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.348952:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 27 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.348971:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa45600/0xf1867c21abfa615e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e05 expref: 27 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.348983:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066751.348987:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.348995:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.349001:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.349022:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.349059:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983058432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.349065:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6960 00010000:00010000:0.0:1746066751.349377:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349384:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349399:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349405:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349410:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349416:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe5800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066751.349420:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349426:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349434:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066751.349437:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066751.349440:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349444:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa619d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066751.349475:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfa6196 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e1a expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.349481:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5c00/0xf1867c21abfa6196 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e1a expref: 17 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.349488:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5c00, rc 0) 00000100:00100000:0.0:1746066751.349508:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:420:x1830882983058304:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2360us (2428us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066751.349514:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16210 00000100:00100000:1.0:1746066751.350185:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.350222:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983058560 00000100:00100000:2.0:1746066751.350226:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983058560 00000100:00100000:2.0:1746066751.350259:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15545 00000100:00100000:2.0:1746066751.350264:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882983058560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066751.350279:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.350292:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e21 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.350309:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.350311:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.350319:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.350335:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 36 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.350344:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bba00, rc 0) 00000100:00100000:2.0:1746066751.350379:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983058560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 114us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.350385:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15545 00000100:00100000:0.0:1746066751.351603:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.351648:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.351717:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983058816 00000100:00100000:2.0:1746066751.351722:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983058816 00002000:00100000:2.0:1746066751.351755:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880130d89f80 x1830882983058816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.351764:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d89f80 with x1830882983058816 ext(1048576->2097151) 00002000:00010000:2.0:1746066751.351770:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d89f80 00000100:00100000:2.0:1746066751.351797:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4041 00000100:00100000:2.0:1746066751.351803:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983058816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.352409:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983059072 00000100:00100000:3.0:1746066751.352413:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983059072 00000100:00100000:3.0:1746066751.352455:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5893 00000100:00100000:3.0:1746066751.352463:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:420:x1830882983059072:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066751.352634:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:420:x1830882983059072:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 173us (985us total) trans 8589936518 rc 0/0 00000100:00100000:3.0:1746066751.352639:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5893 00000100:00100000:0.0:1746066751.353469:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.353539:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983059328 00000100:00100000:2.0:1746066751.353543:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983059328 00002000:00100000:2.0:1746066751.353562:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880130d88380 x1830882983059328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.353570:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88380 with x1830882983059328 ext(4194304->5033983) 00002000:00010000:2.0:1746066751.353587:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d88380 00000100:00100000:2.0:1746066751.353601:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4042 00000100:00100000:2.0:1746066751.353607:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983059328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066751.362573:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983058816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10757us (10959us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066751.362596:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4041 00002000:00100000:2.0:1746066751.362608:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880130d89f80 x1830882983058816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.362617:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d89f80 with x1830882983058816 ext(1048576->2097151) 00002000:00010000:2.0:1746066751.362623:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d89f80 00000100:00100000:3.0:1746066751.362800:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983059328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9192us (9330us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066751.362808:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4042 00002000:00100000:3.0:1746066751.362815:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880130d88380 x1830882983059328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.362826:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88380 with x1830882983059328 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.362829:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d88380 00000100:00100000:0.0:1746066751.370005:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.370319:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983059584 00000100:00100000:3.0:1746066751.370330:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983059584 00002000:00100000:3.0:1746066751.370380:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095dd4700 x1830882983059584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.370394:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4700 with x1830882983059584 ext(2097152->4194303) 00002000:00010000:3.0:1746066751.370399:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4700 00000100:00100000:3.0:1746066751.370435:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4043 00000100:00100000:3.0:1746066751.370443:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983059584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.379812:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.381863:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983059712 00000100:00100000:2.0:1746066751.381876:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983059712 00000100:00100000:2.0:1746066751.382012:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15546 00000100:00100000:2.0:1746066751.382020:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:425:x1830882983059712:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.382040:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.382056:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e28 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.382084:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.382092:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.382099:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.382104:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.382106:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.382109:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [876544->1048575] (req 876544->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.382137:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.382148:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 37 pid: 9592 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.382158:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984381568:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.382428:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.382436:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 18 pid: 3528 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.382447:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984381696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.382473:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.382480:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 48 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.382486:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984381824:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.382497:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.389634:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.389666:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.389699:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984381568:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.389713:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984381696:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.389720:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984381824:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.389749:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066751.389752:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [876544->1048575] (req 876544->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.389770:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb600, rc 0) 00000100:00100000:2.0:1746066751.389771:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983059840 00000100:00100000:3.0:1746066751.389772:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983059968 00000100:00100000:2.0:1746066751.389777:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983059840 00000100:00100000:3.0:1746066751.389778:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983059968 00010000:00010000:2.0:1746066751.389804:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 19 pid: 3528 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.389806:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 38 pid: 9592 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746066751.389821:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+38:425:x1830882983059712:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7801us (10023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.389824:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983060096 00000100:00100000:2.0:1746066751.389826:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983060096 00000100:00100000:0.0:1746066751.389829:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15546 00000100:00100000:3.0:1746066751.389832:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6961 00010000:00010000:2.0:1746066751.389833:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 49 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.389840:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983059840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066751.389845:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6962 00000100:00100000:2.0:1746066751.389850:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+37:2014:x1830882983059968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.389854:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.389856:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.389872:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 37 pid: 9592 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.389873:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 19 pid: 3528 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746066751.389896:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 37 pid: 9592 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.389906:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 19 pid: 3528 timeout: 819 lvb_type: 1 00000100:00100000:1.0:1746066751.389921:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6963 00010000:00010000:2.0:1746066751.389932:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800979a6a00/0xf1867c21abfa5e6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bdc expref: 37 pid: 9592 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.389932:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2014:x1830882983060096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.390024:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066751.390026:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097cc1e00/0xf1867c21abfa5e9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bea expref: 19 pid: 3528 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.390039:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+36:2014:x1830882983059968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 188us (372us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066751.390041:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066751.390043:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066751.390044:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6962 00010000:00010000:1.0:1746066751.390052:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 49 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.390059:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882983059840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 221us (436us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066751.390062:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 49 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.390066:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6961 00010000:00010000:1.0:1746066751.390075:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009357aa00/0xf1867c21abfa5e55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0bc7 expref: 49 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.390092:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.390094:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.390100:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 35 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.390108:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 35 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.390135:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 35 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066751.390429:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984381952:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066751.390494:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.390722:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983059584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20279us (20727us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066751.390730:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4043 00002000:00100000:3.0:1746066751.390741:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095dd4700 x1830882983059584/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.390751:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4700 with x1830882983059584 ext(2097152->4194303) 00002000:00010000:3.0:1746066751.390758:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4700 00000100:00100000:1.0:1746066751.391748:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984381952:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066751.391765:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.391800:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882983060096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1871us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.391808:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6963 00000100:00100000:0.0:1746066751.397850:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.397968:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983060352 00000100:00100000:2.0:1746066751.397978:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983060352 00000100:00100000:2.0:1746066751.398025:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15547 00000100:00100000:2.0:1746066751.398033:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:423:x1830882983060352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066751.398053:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.398070:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e2f expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.398097:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.398098:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.398107:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 36 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.398120:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 36 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.398130:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb400, rc 0) 00000100:00100000:2.0:1746066751.398259:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:423:x1830882983060352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 224us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.398265:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15547 00000100:00100000:0.0:1746066751.398991:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.399071:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983060480 00000100:00100000:3.0:1746066751.399076:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983060480 00002000:00100000:3.0:1746066751.399106:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (876544->880639) req@ffff8800a5d81180 x1830882983060480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.399116:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830882983060480 ext(876544->880639) 00002000:00010000:3.0:1746066751.399121:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81180 00000100:00100000:3.0:1746066751.399144:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4044 00000100:00100000:3.0:1746066751.399150:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983060480:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.399263:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983060480:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 113us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066751.399270:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4044 00002000:00100000:3.0:1746066751.399274:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (876544->880639) req@ffff8800a5d81180 x1830882983060480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.399282:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830882983060480 ext(876544->880639) 00002000:00010000:3.0:1746066751.399285:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d81180 00000100:00100000:0.0:1746066751.400822:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.400919:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983060736 00000100:00100000:2.0:1746066751.400924:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983060736 00002000:00100000:2.0:1746066751.400949:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a5d82d80 x1830882983060736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.400957:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830882983060736 ext(3145728->4194303) 00002000:00010000:2.0:1746066751.400960:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82d80 00000100:00100000:2.0:1746066751.401037:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4045 00000100:00100000:2.0:1746066751.401045:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882983060736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.403347:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.403398:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983060864 00000100:00100000:3.0:1746066751.403405:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983060864 00000100:00100000:3.0:1746066751.403456:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15548 00000100:00100000:3.0:1746066751.403464:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:425:x1830882983060864:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066751.403480:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.403500:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e36 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.403530:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.403538:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.403544:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.403549:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.403550:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.403553:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.403597:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.403609:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 24 pid: 11630 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746066751.403622:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382080:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066751.403704:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.403712:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 16 pid: 9590 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746066751.403720:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382208:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066751.403803:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.403812:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 37 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.403820:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382336:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066751.403837:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.410021:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882983060736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8965us (9190us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066751.410034:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4045 00000100:00100000:3.0:1746066751.410039:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382080:192.168.204.16@tcp:104: 00002000:00100000:2.0:1746066751.410047:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a5d82d80 x1830882983060736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066751.410052:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382208:192.168.204.16@tcp:104: 00002000:00100000:2.0:1746066751.410056:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82d80 with x1830882983060736 ext(3145728->4194303) 00000100:00100000:3.0:1746066751.410059:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382336:192.168.204.16@tcp:104: 00002000:00010000:2.0:1746066751.410061:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82d80 00010000:00010000:3.0:1746066751.410091:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.410108:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0c00, rc 0) 00000100:00100000:3.0:1746066751.410126:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:425:x1830882983060864:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6663us (6785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.410133:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15548 00000100:00100000:0.0:1746066751.412232:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.412276:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.412305:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983060992 00000100:00100000:1.0:1746066751.412315:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983060992 00000100:00100000:3.0:1746066751.412323:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983061120 00000100:00100000:3.0:1746066751.412327:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983061120 00010000:00010000:3.0:1746066751.412350:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.412350:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 17 pid: 9590 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746066751.412399:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6964 00000100:00100000:3.0:1746066751.412406:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983060992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.412420:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066751.412429:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6965 00000100:00100000:2.0:1746066751.412436:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983061120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.412440:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 17 pid: 9590 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746066751.412445:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.412452:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 17 pid: 9590 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746066751.412502:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.412516:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992600/0xf1867c21abfa604d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d41 expref: 17 pid: 9590 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746066751.412516:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.412530:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8d3a00/0xf1867c21abfa5f89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ca0 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.412551:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066751.412598:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066751.412618:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983061120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 182us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.412624:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6965 00000100:00100000:3.0:1746066751.412768:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983060992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 185us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.412775:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6964 00000100:00100000:2.0:1746066751.415137:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.415185:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983061248 00000100:00100000:3.0:1746066751.415192:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983061248 00010000:00010000:3.0:1746066751.415219:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 24 pid: 11630 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746066751.415247:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6966 00000100:00100000:3.0:1746066751.415253:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983061248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.415264:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.415280:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 24 pid: 11630 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.415292:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 24 pid: 11630 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.415312:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496a00/0xf1867c21abfa5fa5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0cae expref: 24 pid: 11630 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.415328:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.415329:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.415336:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.415349:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.415380:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.415392:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984382464:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.415611:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.421285:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984382464:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.421352:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.421569:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983061248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6312us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.421605:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6966 00000100:00100000:0.0:1746066751.422784:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.422819:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.422841:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983061504 00000100:00100000:3.0:1746066751.422848:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983061504 00000100:00100000:3.0:1746066751.422900:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983061376 00000100:00100000:3.0:1746066751.422902:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983061376 00000100:00100000:0.0:1746066751.422915:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15549 00000100:00100000:3.0:1746066751.422925:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15550 00000100:00100000:0.0:1746066751.422926:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983061504:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066751.422931:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983061376:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.422945:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.422945:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.422962:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfa61c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e3d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.422962:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5000/0xf1867c21abfa61c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e44 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.423009:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984382592:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.423009:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984382720:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.423069:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.423119:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00002000:00010000:3.0:1746066751.424519:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066751 -> 1746066752 00002000:00010000:3.0:1746066751.424523:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066750 -> 1746066752 00002000:00010000:3.0:1746066751.424525:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746066751 -> 1746066752 00000100:00100000:3.0:1746066751.424544:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984382592:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066751.424569:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfa61c0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e3d expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.424596:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfa61c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e3d expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.424610:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f000, rc 0) 00000100:00100000:3.0:1746066751.424700:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983061376:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1767us (1879us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066751.424707:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15550 00000100:00100000:1.0:1746066751.424788:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.425017:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983061760 00000100:00100000:3.0:1746066751.425023:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983061760 00002000:00100000:3.0:1746066751.425053:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1392640->1396735) req@ffff880094306680 x1830882983061760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.425063:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306680 with x1830882983061760 ext(1392640->1396735) 00002000:00010000:3.0:1746066751.425067:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306680 00000100:00100000:3.0:1746066751.425112:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4046 00000100:00100000:3.0:1746066751.425117:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983061760:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.425366:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983061760:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 248us (578us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066751.425372:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4046 00002000:00100000:3.0:1746066751.425378:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1392640->1396735) req@ffff880094306680 x1830882983061760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.425386:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306680 with x1830882983061760 ext(1392640->1396735) 00002000:00010000:3.0:1746066751.425388:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094306680 00002000:00010000:1.0:1746066751.425727:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066751 -> 1746066752 00002000:00010000:1.0:1746066751.425730:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066751 -> 1746066752 00002000:00010000:1.0:1746066751.425732:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066751 -> 1746066752 00000100:00100000:1.0:1746066751.425742:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984382720:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066751.425760:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5000/0xf1867c21abfa61c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e44 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.425770:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5000/0xf1867c21abfa61c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e44 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.425790:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5000, rc 0) 00000100:00100000:1.0:1746066751.425822:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983061504:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2899us (3040us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066751.425828:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15549 00000100:00100000:0.0:1746066751.428916:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.428964:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983062016 00000100:00100000:1.0:1746066751.428973:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983062016 00000100:00100000:1.0:1746066751.429028:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5894 00000100:00100000:1.0:1746066751.429036:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+26:425:x1830882983062016:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066751.429247:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:425:x1830882983062016:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 210us (362us total) trans 8589936519 rc 0/0 00000100:00100000:1.0:1746066751.429258:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5894 00000100:00100000:0.0:1746066751.429813:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.429877:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983062272 00000100:00100000:3.0:1746066751.429902:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983062272 00002000:00100000:3.0:1746066751.429931:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095ce2680 x1830882983062272/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.429942:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2680 with x1830882983062272 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.429947:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce2680 00000100:00100000:3.0:1746066751.430086:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4047 00000100:00100000:3.0:1746066751.430092:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983062272:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.438550:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983062272:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8445us (8725us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066751.438563:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4047 00002000:00100000:3.0:1746066751.438589:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095ce2680 x1830882983062272/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.438599:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2680 with x1830882983062272 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.438605:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce2680 00000100:00100000:1.0:1746066751.449739:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.449792:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983062400 00000100:00100000:0.0:1746066751.449805:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983062400 00000100:00100000:0.0:1746066751.449869:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15551 00000100:00100000:0.0:1746066751.449879:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983062400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066751.449961:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.449981:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa61ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e4b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066751.450044:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984382848:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066751.450169:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.450223:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.450485:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983062528 00000100:00100000:3.0:1746066751.450489:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983062528 00000100:00100000:3.0:1746066751.450522:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15552 00000100:00100000:3.0:1746066751.450528:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983062528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.450537:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.450548:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa61d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e52 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.450592:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382976:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066751.450970:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.452241:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984382976:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066751.452243:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984382848:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066751.452270:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa61d5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e52 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.452270:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa61ce lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e4b expref: 47 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.452281:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80ea00/0xf1867c21abfa61d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e52 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.452281:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe4200/0xf1867c21abfa61ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e4b expref: 47 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.452295:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80ea00, rc 0) 00010000:00010000:2.0:1746066751.452435:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4200, rc 0) 00000100:00100000:3.0:1746066751.452510:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983062528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1980us (2339us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066751.452519:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15552 00000100:00100000:2.0:1746066751.452604:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983062400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2726us (2870us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.452611:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15551 00000100:00100000:0.0:1746066751.454591:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.454751:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.454817:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983062656 00000100:00100000:3.0:1746066751.454825:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983062656 00000100:00100000:2.0:1746066751.454827:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983062784 00000100:00100000:2.0:1746066751.454835:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983062784 00000100:00100000:3.0:1746066751.454880:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15553 00000100:00100000:3.0:1746066751.454918:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983062656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.454935:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.454952:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa61dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e59 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.455003:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984383104:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066751.455064:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.455186:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15554 00000100:00100000:2.0:1746066751.455289:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983062784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066751.455298:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.455308:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfa61e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e60 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.455339:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984383232:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066751.455363:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.456345:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984383232:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066751.456367:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984383104:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066751.456369:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfa61e3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e60 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.456380:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097bc9800/0xf1867c21abfa61e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e60 expref: 36 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.456384:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa61dc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e59 expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.456391:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa61dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e59 expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.456394:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097bc9800, rc 0) 00010000:00010000:3.0:1746066751.456396:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e800, rc 0) 00000100:00100000:3.0:1746066751.456419:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983062656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1503us (1851us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.456419:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983062784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1133us (1668us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066751.456425:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15553 00000100:00100000:2.0:1746066751.456500:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15554 00000100:00100000:0.0:1746066751.470022:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.470188:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983062912 00000100:00100000:2.0:1746066751.470199:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983062912 00000100:00100000:2.0:1746066751.470250:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16211 00000100:00100000:2.0:1746066751.470258:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:429:x1830882983062912:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066751.470284:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.470301:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa61ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e67 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.470363:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470376:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470386:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470397:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470403:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470407:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470481:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470490:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470495:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066751.470534:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066751.470537:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066751.470552:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470561:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470569:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470590:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470596:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470601:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470607:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135974e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066751.470611:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470617:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470628:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066751.470631:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066751.470636:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470640:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa61f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470673:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470678:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470682:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470686:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135974200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066751.470688:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470693:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470698:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880093a37500) 00010000:00010000:2.0:1746066751.470700:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066751.470702:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470707:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa61f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.470732:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa61ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.470744:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 18 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.470751:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066751.470752:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066751.470755:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135975e00, rc 0) 00000100:00100000:2.0:1746066751.470816:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:429:x1830882983062912:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 558us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.470822:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16211 00000100:00100000:0.0:1746066751.476814:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.476857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.476909:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.476919:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983063040 00000100:00100000:3.0:1746066751.476929:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983063040 00000100:00100000:0.0:1746066751.476949:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.476977:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983063168 00000100:00100000:3.0:1746066751.476979:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983063168 00000100:00100000:0.0:1746066751.476989:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983063296 00000100:00100000:3.0:1746066751.476992:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983063424 00000100:00100000:0.0:1746066751.476992:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983063296 00000100:00100000:3.0:1746066751.476994:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983063424 00000100:00100000:3.0:1746066751.477008:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15555 00000100:00100000:0.0:1746066751.477013:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15556 00000100:00100000:3.0:1746066751.477015:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983063040:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:0.0:1746066751.477019:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983063168:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066751.477033:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.477033:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.477048:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa620d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e6e expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.477048:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa6206 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e75 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.477099:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984383360:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.477099:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984383488:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066751.477112:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15557 00000100:00100000:2.0:1746066751.477121:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882983063424:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066751.477128:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.477137:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e83 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.477149:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.477150:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.477159:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066751.477171:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15558 00010000:00010000:2.0:1746066751.477173:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066751.477179:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882983063296:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066751.477182:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135975400, rc 0) 00010000:00010000:1.0:1746066751.477186:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.477194:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e7c expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.477205:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.477206:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.477217:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 21 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.477227:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 21 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.477234:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894600, rc 0) 00000100:00100000:3.0:1746066751.477313:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.477588:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800975583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.477652:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983063424:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 531us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.477661:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882983063296:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 482us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.477662:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15557 00000100:00100000:1.0:1746066751.477667:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15558 00000100:00100000:3.0:1746066751.479426:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984383360:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066751.479456:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa620d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e6e expref: 20 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.479468:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f600/0xf1867c21abfa620d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e6e expref: 20 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.479480:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f600, rc 0) 00000100:00100000:3.0:1746066751.480031:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983063040:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3015us (3226us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066751.480038:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15555 00000100:00100000:2.0:1746066751.480266:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984383488:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066751.480283:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa6206 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e75 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.480293:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa6206 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e75 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.480306:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5600, rc 0) 00000100:00100000:2.0:1746066751.480328:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983063168:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3308us (3470us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.480333:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15556 00000100:00100000:0.0:1746066751.482665:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.482961:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983063936 00000100:00100000:2.0:1746066751.482970:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983063936 00000100:00100000:2.0:1746066751.483021:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16212 00000100:00100000:2.0:1746066751.483030:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:429:x1830882983063936:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066751.483050:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.483068:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa6222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e91 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.483175:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.483189:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.483202:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.483235:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.483247:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 19 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.483260:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984383616:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.483354:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.483471:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.483565:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983063680 00000100:00100000:0.0:1746066751.483568:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983063680 00000100:00100000:0.0:1746066751.483612:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16213 00000100:00100000:0.0:1746066751.483617:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+42:432:x1830882983063680:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066751.483626:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.483632:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa6230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e8a expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.483667:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066751.483673:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066751.483680:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:2.0:1746066751.484306:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984383616:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.484321:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066751.484846:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.485034:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983064064 00000100:00100000:3.0:1746066751.485040:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983064064 00010000:00010000:3.0:1746066751.485062:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 20 pid: 17253 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.485082:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6967 00000100:00100000:3.0:1746066751.485088:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983064064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.485096:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.485101:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 20 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.485110:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 20 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.485128:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975e00/0xf1867c21abfa61ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e67 expref: 20 pid: 17253 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.485154:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066751.485158:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.485164:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.485169:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066751.485175:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066751.485179:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066751.485183:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066751.485209:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066751.485221:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.485228:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746066751.485238:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983064064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 150us (392us total) trans 0 rc 0/0 00000004:00200000:1.0:1746066751.485240:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000100:00100000:3.0:1746066751.485243:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6967 00010000:00010000:2.0:1746066751.485342:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066751.485348:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066751.485356:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066751.485424:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135974200/0xf1867c21abfa6222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e91 expref: 20 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.485436:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e91 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.485442:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066751.485444:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066751.485447:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135974e00, rc 0) 00000100:00100000:2.0:1746066751.485478:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:429:x1830882983063936:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2449us (2819us total) trans 8589936521 rc 0/0 00000100:00100000:2.0:1746066751.485483:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16212 00010000:00010000:1.0:1746066751.485540:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe5000/0xf1867c21abfa6230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.485564:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 44 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.485570:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066751.485580:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066751.485583:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4e00, rc 0) 00000100:00100000:1.0:1746066751.485600:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:432:x1830882983063680:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1982us (2129us total) trans 8589936520 rc 0/0 00000100:00100000:1.0:1746066751.485605:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16213 00000100:00100000:0.0:1746066751.487461:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.487538:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983064320 00000100:00100000:1.0:1746066751.487545:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983064320 00000100:00100000:1.0:1746066751.487650:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16214 00000100:00100000:1.0:1746066751.487657:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:429:x1830882983064320:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066751.487678:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.487681:0:7243:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066751.487699:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135974e00/0xf1867c21abfa6229 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e91 expref: 19 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.487714:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066751.487718:0:7243:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066751.487729:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa624c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e98 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.487808:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.487820:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 43 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.487826:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.487852:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 43 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.487867:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 43 pid: 7243 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.487878:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984383744:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.488342:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.490318:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984383744:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.490320:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066751.490346:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:3.0:1746066751.490535:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983064448 00000100:00100000:3.0:1746066751.490542:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983064448 00010000:00010000:3.0:1746066751.490587:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 44 pid: 7243 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.490622:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6968 00000100:00100000:3.0:1746066751.490629:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983064448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.490641:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.490647:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 44 pid: 7243 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.490660:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 44 pid: 7243 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.490680:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe4e00/0xf1867c21abfa6237 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e8a expref: 44 pid: 7243 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.490693:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066751.490697:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066751.490707:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066751.490713:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066751.490742:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.490777:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983064448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.490783:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6968 00010000:00010000:1.0:1746066751.491072:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491079:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491097:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491102:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491108:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491113:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135975200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066751.491117:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491122:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491133:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066751.491135:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066751.491138:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491142:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135975200/0xf1867c21abfa6253 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.491176:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa624c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e98 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.491183:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894800/0xf1867c21abfa624c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e98 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.491191:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894800, rc 0) 00000100:00100000:1.0:1746066751.491216:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:429:x1830882983064320:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3560us (3760us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066751.491222:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16214 00000100:00100000:0.0:1746066751.497298:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.497350:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983064704 00000100:00100000:1.0:1746066751.497361:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983064704 00000100:00100000:3.0:1746066751.497460:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5895 00000100:00100000:3.0:1746066751.497470:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:429:x1830882983064704:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066751.497697:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:429:x1830882983064704:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 228us (409us total) trans 8589936522 rc 0/0 00000100:00100000:3.0:1746066751.497704:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5895 00010000:00010000:2.0:1746066751.502167:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746066751.505514:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841789 is committed 00000001:00080000:0.0:1746066751.505529:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841788 is committed 00000001:00080000:0.0:1746066751.505569:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841776 is committed 00000001:00080000:0.0:1746066751.505603:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841758 is committed 00000100:00100000:0.0:1746066751.556606:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.556734:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983064960 00000100:00100000:1.0:1746066751.556744:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983064960 00000100:00100000:1.0:1746066751.557729:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16215 00000100:00100000:1.0:1746066751.557740:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:435:x1830882983064960:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066751.557768:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.557788:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5c600/0xf1867c21abfa625a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0e9f expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.557907:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.557921:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:1.0:1746066751.557932:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:1.0:1746066751.557946:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066751.558035:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5c600/0xf1867c21abfa625a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.559248:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 29 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.559257:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066751.559260:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066751.559263:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894a00, rc 0) 00000100:00100000:1.0:1746066751.559320:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+29:435:x1830882983064960:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1583us (2726us total) trans 8589936523 rc 0/0 00000100:00100000:1.0:1746066751.559327:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16215 00000100:00100000:0.0:1746066751.604671:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.604776:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983065216 00000100:00100000:3.0:1746066751.604787:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983065216 00002000:00100000:3.0:1746066751.604834:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->876543) req@ffff880095ce3480 x1830882983065216/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.604844:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3480 with x1830882983065216 ext(0->876543) 00002000:00010000:3.0:1746066751.604849:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce3480 00000100:00100000:2.0:1746066751.605074:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4048 00000100:00100000:2.0:1746066751.605086:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983065216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.610541:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.610586:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.611051:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983065728 00000100:00100000:3.0:1746066751.611061:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983065728 00002000:00100000:3.0:1746066751.611108:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880095ce0700 x1830882983065728/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.611116:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0700 with x1830882983065728 ext(1048576->2097151) 00002000:00010000:3.0:1746066751.611122:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce0700 00000100:00100000:3.0:1746066751.611139:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983065600 00000100:00100000:3.0:1746066751.611141:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983065600 00002000:00100000:3.0:1746066751.611155:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1396736->2097151) req@ffff88008e332a00 x1830882983065600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.611161:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332a00 with x1830882983065600 ext(1396736->2097151) 00002000:00010000:3.0:1746066751.611164:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e332a00 00000100:00100000:3.0:1746066751.611187:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4049 00000100:00100000:3.0:1746066751.611195:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983065728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066751.611791:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4050 00000100:00100000:2.0:1746066751.611809:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983065600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066751.613873:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983065216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8783us (9209us total) trans 0 rc 876544/876544 00000100:00100000:2.0:1746066751.613903:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4048 00002000:00100000:2.0:1746066751.613913:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->876543) req@ffff880095ce3480 x1830882983065216/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 876544/876544 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.613922:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3480 with x1830882983065216 ext(0->876543) 00002000:00010000:2.0:1746066751.613926:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce3480 00000100:00100000:2.0:1746066751.621552:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983065600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9740us (10953us total) trans 0 rc 700416/700416 00000100:00100000:2.0:1746066751.621565:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4050 00002000:00100000:2.0:1746066751.621590:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1396736->2097151) req@ffff88008e332a00 x1830882983065600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.621600:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332a00 with x1830882983065600 ext(1396736->2097151) 00002000:00010000:2.0:1746066751.621607:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e332a00 00000100:00100000:3.0:1746066751.621990:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882983065728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10794us (11457us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.621997:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4049 00002000:00100000:3.0:1746066751.622002:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880095ce0700 x1830882983065728/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.622009:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0700 with x1830882983065728 ext(1048576->2097151) 00002000:00010000:3.0:1746066751.622012:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce0700 00000100:00100000:0.0:1746066751.626108:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.626221:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983065856 00000100:00100000:2.0:1746066751.626231:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983065856 00000100:00100000:2.0:1746066751.626292:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15559 00000100:00100000:2.0:1746066751.626301:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+18:432:x1830882983065856:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.626322:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.626343:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ea6 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.626374:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.626384:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.626390:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.626396:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.626397:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.626401:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.626432:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.626443:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 19 pid: 20361 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.626459:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984383872:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.626613:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.626622:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 10 pid: 12255 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.626630:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984384000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.626655:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 7 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.626663:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 7 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.626670:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984384128:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.626686:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.633316:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.633342:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984383872:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.633347:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.633354:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984384000:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.633362:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984384128:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.633374:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066751.633399:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 19 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066751.633401:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.633444:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983066240 00000100:00100000:0.0:1746066751.633451:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983066240 00010000:00010000:0.0:1746066751.633482:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 20 pid: 20361 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746066751.633505:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983065984 00000100:00100000:0.0:1746066751.633507:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983065984 00010000:00010000:0.0:1746066751.633515:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 11 pid: 12255 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746066751.633524:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983066368 00000100:00100000:0.0:1746066751.633525:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983066368 00000100:00100000:1.0:1746066751.633530:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6969 00010000:00010000:0.0:1746066751.633536:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 8 pid: 20361 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.633539:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2013:x1830882983066240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066751.633548:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6970 00000100:00100000:0.0:1746066751.633552:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983065984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066751.633554:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066751.633557:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066751.633591:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 20 pid: 20361 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746066751.633591:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 11 pid: 12255 timeout: 819 lvb_type: 1 00010000:00010000:1.0:1746066751.633601:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 20 pid: 20361 timeout: 819 lvb_type: 1 00000100:00100000:3.0:1746066751.633646:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6971 00000100:00100000:3.0:1746066751.633654:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882983066368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.633661:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066751.633846:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 11 pid: 12255 timeout: 819 lvb_type: 1 00010000:00010000:3.0:1746066751.633908:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 8 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.633919:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 8 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.633941:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44e00/0xf1867c21abfa60f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0db8 expref: 8 pid: 20361 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.633946:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800965fba00, rc 0) 00010000:00010000:3.0:1746066751.633955:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.633996:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+7:2013:x1830882983066368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 342us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.634003:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6971 00000100:00100000:3.0:1746066751.634026:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983066112 00000100:00100000:3.0:1746066751.634029:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983066112 00000100:00100000:3.0:1746066751.634050:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15560 00000100:00100000:3.0:1746066751.634054:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+7:438:x1830882983066112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.634070:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.634081:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ead expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.634096:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.634098:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.634106:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 8 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.634115:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 8 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.634121:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e800, rc 0) 00000100:00100000:3.0:1746066751.634136:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+8:438:x1830882983066112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 82us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.634141:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15560 00010000:00010000:1.0:1746066751.634228:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094540200/0xf1867c21abfa6126 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0dd4 expref: 20 pid: 20361 timeout: 819 lvb_type: 1 00010000:00010000:1.0:1746066751.634248:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.634264:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882983066240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 727us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.634269:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6969 00010000:00010000:0.0:1746066751.634369:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa6150 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0df7 expref: 11 pid: 12255 timeout: 819 lvb_type: 1 00010000:00010000:0.0:1746066751.634383:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066751.634384:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066751.634388:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 18 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.634395:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 18 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.634425:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 18 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066751.634443:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984384256:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066751.634493:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.634623:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+18:432:x1830882983065856:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8322us (8525us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.634628:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15559 00000100:00100000:2.0:1746066751.636419:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984384256:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066751.636437:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066751.636478:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983065984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2925us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.636486:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6970 00000100:00100000:0.0:1746066751.637499:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.637695:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983066624 00000100:00100000:3.0:1746066751.637703:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983066624 00002000:00100000:3.0:1746066751.638014:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3665920->4194303) req@ffff880098fb4a80 x1830882983066624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.638095:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4a80 with x1830882983066624 ext(3665920->4194303) 00002000:00010000:3.0:1746066751.638101:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb4a80 00000100:00100000:3.0:1746066751.638251:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4051 00000100:00100000:3.0:1746066751.638259:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983066624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.643762:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.643842:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983066880 00000100:00100000:2.0:1746066751.643852:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983066880 00002000:00100000:2.0:1746066751.644128:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3014656->3018751) req@ffff880098fb4700 x1830882983066880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.644139:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4700 with x1830882983066880 ext(3014656->3018751) 00002000:00010000:2.0:1746066751.644145:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb4700 00000100:00100000:2.0:1746066751.644166:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4052 00000100:00100000:2.0:1746066751.644175:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983066880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.644371:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983066624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6111us (6873us total) trans 0 rc 528384/528384 00000100:00100000:3.0:1746066751.644378:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4051 00002000:00100000:3.0:1746066751.644383:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3665920->4194303) req@ffff880098fb4a80 x1830882983066624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.644389:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4a80 with x1830882983066624 ext(3665920->4194303) 00002000:00010000:3.0:1746066751.644392:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb4a80 00000100:00100000:2.0:1746066751.644808:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983066880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 634us (1057us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066751.644814:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4052 00002000:00100000:2.0:1746066751.644819:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3014656->3018751) req@ffff880098fb4700 x1830882983066880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.644826:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4700 with x1830882983066880 ext(3014656->3018751) 00002000:00010000:2.0:1746066751.644829:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb4700 00000100:00100000:0.0:1746066751.648333:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.648397:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983067008 00000100:00100000:2.0:1746066751.648407:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983067008 00000100:00100000:2.0:1746066751.648607:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15561 00000100:00100000:2.0:1746066751.648616:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983067008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066751.648636:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.648654:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfa627d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0eb4 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.648692:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfa627d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0eb4 expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.648699:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a589a200/0xf1867c21abfa627d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0eb4 expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.648717:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a200, rc 0) 00000100:00100000:2.0:1746066751.648775:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983067008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 160us (453us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.648780:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15561 00000100:00100000:0.0:1746066751.649604:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.649640:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983067136 00000100:00100000:2.0:1746066751.649644:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983067136 00000100:00100000:2.0:1746066751.649675:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15562 00000100:00100000:2.0:1746066751.649680:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:432:x1830882983067136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.649689:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.649700:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ebb expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649725:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649734:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.649741:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 36 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649748:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649759:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649765:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066751.649767:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066751.649770:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 8/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->2924543] (req 2097152->2924543) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 36 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649800:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649811:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.649829:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384384:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.649937:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649946:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 22 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.649954:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384512:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.649980:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 36 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.649987:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 36 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.649995:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384640:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.650026:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.650035:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 16 pid: 20361 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.650042:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384768:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.650068:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.650076:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.650083:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384896:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.650098:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.651843:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.652020:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.652120:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983067264 00000100:00100000:3.0:1746066751.652128:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983067264 00010000:00010000:3.0:1746066751.652159:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 37 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.652190:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983067392 00000100:00100000:3.0:1746066751.652192:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983067392 00010000:00010000:3.0:1746066751.652202:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 23 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.652219:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6972 00000100:00100000:3.0:1746066751.652225:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983067264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.652237:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.652256:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 37 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.652266:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 37 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.652287:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.652320:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983067264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.652325:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6972 00000100:00100000:3.0:1746066751.652342:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6973 00000100:00100000:3.0:1746066751.652347:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983067392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.652353:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.652358:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 23 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.652369:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 23 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.652379:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.652391:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983067392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 44us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.652395:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6973 00010000:00010000:0.0:1746066751.652855:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa609a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d79 expref: 36 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746066751.652870:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384384:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066751.652880:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992000/0xf1867c21abfa6070 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0d5d expref: 22 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:0.0:1746066751.652909:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384512:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.652920:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384640:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.653001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.653054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.653069:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983067520 00000100:00100000:2.0:1746066751.653072:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983067520 00010000:00010000:2.0:1746066751.653088:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 17 pid: 20361 timeout: 819 lvb_type: 1 00000100:00100000:2.0:1746066751.653104:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6974 00000100:00100000:2.0:1746066751.653109:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983067520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.653115:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.653122:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 17 pid: 20361 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746066751.653129:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 17 pid: 20361 timeout: 819 lvb_type: 1 00010000:00010000:2.0:1746066751.653140:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066751.653157:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983067520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.653163:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6974 00010000:00010000:0.0:1746066751.653460:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135975400/0xf1867c21abfa6214 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e83 expref: 16 pid: 20361 timeout: 819 lvb_type: 1 00000100:00100000:0.0:1746066751.653471:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384768:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.653478:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984384896:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066751.653507:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->2924543] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 35 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.653516:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589be00, rc 0) 00000100:00100000:0.0:1746066751.653550:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:432:x1830882983067136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3870us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.653557:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15562 00000100:00100000:3.0:1746066751.653621:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983067776 00000100:00100000:3.0:1746066751.653624:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983067776 00002000:00100000:3.0:1746066751.653651:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf5f80 x1830882983067776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.653659:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5f80 with x1830882983067776 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.653663:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5f80 00000100:00100000:3.0:1746066751.653685:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4053 00000100:00100000:3.0:1746066751.653690:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882983067776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.656085:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.656755:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983067904 00000100:00100000:1.0:1746066751.656764:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983067904 00010000:00010000:1.0:1746066751.656802:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.656842:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6975 00000100:00100000:1.0:1746066751.656850:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983067904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066751.656865:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066751.656902:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.656913:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.656937:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45200/0xf1867c21abfa6134 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de2 expref: 22 pid: 11630 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.656967:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.657006:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983067904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 156us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.657012:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6975 00000100:00100000:0.0:1746066751.657530:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.658370:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983068032 00000100:00100000:2.0:1746066751.658375:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983068032 00010000:00010000:2.0:1746066751.658396:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 35 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.658425:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6976 00000100:00100000:2.0:1746066751.658430:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983068032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.658439:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.658450:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 35 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.658459:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 35 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.658474:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb400/0xf1867c21abfa61b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e2f expref: 35 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.658498:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.658500:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.658505:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.658513:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.658546:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.658558:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984385024:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066751.659109:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.659486:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.659582:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983068160 00000100:00100000:2.0:1746066751.659586:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983068160 00000100:00100000:2.0:1746066751.659614:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15563 00000100:00100000:2.0:1746066751.659621:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:435:x1830882983068160:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.659636:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.659649:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ec2 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.659667:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.659673:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066751.659675:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066751.659678:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.659696:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.659708:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.659717:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984385152:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.659764:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.659865:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882983067776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6173us (6862us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066751.659873:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4053 00002000:00100000:3.0:1746066751.659881:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf5f80 x1830882983067776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.659902:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5f80 with x1830882983067776 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.659906:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5f80 00000100:00100000:3.0:1746066751.661037:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984385152:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.661038:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984385024:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066751.661054:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066751.661060:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2703360->3145727] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.661072:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3e00, rc 0) 00000100:00100000:2.0:1746066751.661079:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983068032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2648us (3549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.661088:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6976 00000100:00100000:3.0:1746066751.661090:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+22:435:x1830882983068160:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1469us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.661096:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15563 00000100:00100000:0.0:1746066751.663735:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.664116:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.664151:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983068288 00000100:00100000:1.0:1746066751.664160:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983068288 00000100:00100000:1.0:1746066751.664210:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983068416 00000100:00100000:1.0:1746066751.664212:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983068416 00000100:00100000:3.0:1746066751.664371:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15564 00000100:00100000:3.0:1746066751.664381:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983068288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.664398:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.664416:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfa6292 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ec9 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.664446:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfa6292 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec9 expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.664456:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f000/0xf1867c21abfa6292 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec9 expref: 9 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066751.664460:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15565 00000100:00100000:1.0:1746066751.664466:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983068416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.664471:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f000, rc 0) 00010000:00010000:1.0:1746066751.664474:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.664484:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa6299 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ed0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.664519:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983068288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 140us (793us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066751.664525:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984385280:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066751.664526:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15564 00000100:00100000:1.0:1746066751.664592:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.666130:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.666597:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983068672 00000100:00100000:3.0:1746066751.666604:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983068672 00002000:00100000:3.0:1746066751.666642:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2920448->2924543) req@ffff880098fbd500 x1830882983068672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.666652:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd500 with x1830882983068672 ext(2920448->2924543) 00010000:00010000:3.0:1746066751.666660:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.666673:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.666680:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbd500 00000100:00100000:3.0:1746066751.666702:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 886 00000100:00100000:3.0:1746066751.666709:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983068672:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.666941:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983068672:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 231us (814us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066751.666947:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 886 00002000:00100000:3.0:1746066751.666953:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2920448->2924543) req@ffff880098fbd500 x1830882983068672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.666960:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd500 with x1830882983068672 ext(2920448->2924543) 00010000:00010000:3.0:1746066751.666965:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.666978:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.666983:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbd500 00000100:00100000:2.0:1746066751.667355:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984385280:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066751.667384:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa6299 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ed0 expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.667394:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faec00/0xf1867c21abfa6299 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ed0 expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.667417:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faec00, rc 0) 00000100:00100000:2.0:1746066751.667449:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983068416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2983us (3334us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.667456:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15565 00000100:00100000:0.0:1746066751.668771:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.669148:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.669218:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983068800 00000100:00100000:2.0:1746066751.669224:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983068800 00000100:00100000:2.0:1746066751.669255:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983068928 00000100:00100000:2.0:1746066751.669258:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983068928 00000100:00100000:3.0:1746066751.669270:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15566 00000100:00100000:2.0:1746066751.669276:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15567 00000100:00100000:3.0:1746066751.669279:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983068800:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066751.669281:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983068928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.669292:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.669292:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.669306:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80e200/0xf1867c21abfa62a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ed7 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.669306:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa62a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ede expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.669329:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e200/0xf1867c21abfa62a7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ed7 expref: 9 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.669337:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e200/0xf1867c21abfa62a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ed7 expref: 9 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.669347:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80e200, rc 0) 00000100:00100000:2.0:1746066751.669349:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984385408:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066751.669378:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983068800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 101us (611us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066751.669384:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15566 00000100:00100000:2.0:1746066751.669399:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.671476:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984385408:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066751.671506:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa62a0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ede expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.671516:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa62a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ede expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.671524:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3400, rc 0) 00000100:00100000:2.0:1746066751.671754:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983068928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2470us (2604us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.671771:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15567 00000100:00100000:0.0:1746066751.674510:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.674560:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.674663:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983069184 00000100:00100000:3.0:1746066751.674672:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983069184 00002000:00100000:3.0:1746066751.674714:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2924543) req@ffff880098fbf100 x1830882983069184/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.674724:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882983069184 ext(2097152->2924543) 00010000:00010000:3.0:1746066751.674731:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.674744:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 34 pid: 12255 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.674750:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbf100 00000100:00100000:3.0:1746066751.674768:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 887 00000100:00100000:3.0:1746066751.674774:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983069184:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066751.675019:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983069440 00000100:00100000:1.0:1746066751.675023:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983069440 00000100:00100000:1.0:1746066751.675053:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5896 00000100:00100000:1.0:1746066751.675059:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:432:x1830882983069440:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066751.675257:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:432:x1830882983069440:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 197us (695us total) trans 8589936524 rc 0/0 00000100:00100000:1.0:1746066751.675263:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5896 00000100:00100000:0.0:1746066751.679857:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.680247:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983069568 00000100:00100000:3.0:1746066751.680257:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983069568 00000100:00100000:3.0:1746066751.680305:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15568 00000100:00100000:3.0:1746066751.680313:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983069568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.680334:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.680354:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa62ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ee5 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.680412:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984385536:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066751.682325:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.682536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.682804:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.682830:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.682905:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983069696 00000100:00100000:0.0:1746066751.682912:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983069696 00000100:00100000:0.0:1746066751.682952:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983069952 00000100:00100000:0.0:1746066751.682954:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983069952 00000100:00100000:0.0:1746066751.682966:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983069824 00000100:00100000:0.0:1746066751.682968:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983069824 00000100:00100000:1.0:1746066751.682977:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15569 00000100:00100000:1.0:1746066751.682984:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983069696:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.683000:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.683017:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faf200/0xf1867c21abfa62b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0eec expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066751.683069:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984385664:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066751.683116:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.683316:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15570 00000100:00100000:0.0:1746066751.683323:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983069952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066751.683330:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.683338:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa62bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0efa expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066751.683364:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984385792:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.683391:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.683406:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15571 00000100:00100000:0.0:1746066751.683411:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983069824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066751.683419:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.683429:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc0e800/0xf1867c21abfa62c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ef3 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.683447:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc0e800/0xf1867c21abfa62c3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ef3 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.683457:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc0e800/0xf1867c21abfa62c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ef3 expref: 21 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.683489:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc0e800, rc 0) 00000100:00100000:0.0:1746066751.683511:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983069824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 100us (684us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066751.683517:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15571 00000100:00100000:2.0:1746066751.686195:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984385536:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066751.686217:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984385792:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066751.686231:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa62ae lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ee5 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.686231:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa62bc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0efa expref: 41 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.686244:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa62ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ee5 expref: 19 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.686244:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa62bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0efa expref: 41 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.686253:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00010000:00010000:2.0:1746066751.686257:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80fa00, rc 0) 00000100:00100000:0.0:1746066751.686291:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983069952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2967us (3486us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066751.686298:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15570 00000100:00100000:1.0:1746066751.686334:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984385664:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066751.686356:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faf200/0xf1867c21abfa62b5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0eec expref: 39 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.686366:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faf200/0xf1867c21abfa62b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0eec expref: 39 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.686382:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf200, rc 0) 00000100:00100000:2.0:1746066751.686482:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983069568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6169us (6637us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066751.686487:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15568 00000100:00100000:1.0:1746066751.686517:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983069696:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3532us (4222us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066751.686522:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15569 00000100:00100000:3.0:1746066751.686601:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882983069184:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 11826us (12097us total) trans 17179874345 rc 0/0 00000100:00100000:3.0:1746066751.686609:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 887 00002000:00100000:3.0:1746066751.686618:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2924543) req@ffff880098fbf100 x1830882983069184/t17179874345(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.686628:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882983069184 ext(2097152->2924543) 00010000:00010000:3.0:1746066751.686636:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 36 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.686648:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 36 pid: 12255 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.686654:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbf100 00000100:00100000:0.0:1746066751.689038:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.689300:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983070080 00000100:00100000:0.0:1746066751.689302:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.689308:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983070080 00000100:00100000:1.0:1746066751.689359:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15572 00000100:00100000:1.0:1746066751.689368:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+18:442:x1830882983070080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.689386:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.689404:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f01 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.689431:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.689447:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.689449:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.689453:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.689469:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983070208 00000100:00100000:2.0:1746066751.689472:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983070208 00010000:00010000:1.0:1746066751.689480:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.689491:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 36 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.689491:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 7 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.689502:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984385920:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.689553:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6977 00000100:00100000:2.0:1746066751.689559:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882983070208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.689579:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.689595:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 36 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.689605:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 36 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.689623:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589be00/0xf1867c21abfa6284 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2924543) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ebb expref: 36 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.689636:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.689637:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.689642:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 21 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.689649:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 21 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.689672:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 21 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.689679:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984386048:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066751.689829:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.690610:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.691797:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.691831:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.691851:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983070720 00000100:00100000:0.0:1746066751.691857:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983070720 00002000:00100000:0.0:1746066751.691907:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2703360->2707455) req@ffff880098fbe300 x1830882983070720/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066751.691917:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882983070720 ext(2703360->2707455) 00002000:00010000:0.0:1746066751.691922:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbe300 00000100:00100000:0.0:1746066751.691936:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983070592 00000100:00100000:0.0:1746066751.691948:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983070592 00002000:00100000:0.0:1746066751.691964:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (876544->1048575) req@ffff880098fbf800 x1830882983070592/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066751.691971:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf800 with x1830882983070592 ext(876544->1048575) 00010000:00010000:0.0:1746066751.691977:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 8 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:0.0:1746066751.691989:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 8 pid: 9590 timeout: 819 lvb_type: 0 00002000:00010000:0.0:1746066751.691995:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbf800 00000100:00100000:1.0:1746066751.692005:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984385920:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.692008:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 888 00000100:00100000:0.0:1746066751.692025:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882983070592:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746066751.692027:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 19 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.692041:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae000, rc 0) 00000100:00100000:1.0:1746066751.692072:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+19:442:x1830882983070080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2705us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.692080:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15572 00000100:00100000:2.0:1746066751.692096:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984386048:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066751.692106:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4054 00010000:00010000:2.0:1746066751.692108:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066751.692111:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983070720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066751.692126:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983070208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2568us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.692134:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6977 00000100:00100000:1.0:1746066751.692207:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983070720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 96us (413us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066751.692214:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4054 00002000:00100000:1.0:1746066751.692218:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2703360->2707455) req@ffff880098fbe300 x1830882983070720/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066751.692225:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882983070720 ext(2703360->2707455) 00002000:00010000:1.0:1746066751.692228:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbe300 00000100:00100000:3.0:1746066751.695151:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983070592:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3118us (3311us total) trans 21474841790 rc 0/0 00000100:00100000:3.0:1746066751.695160:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 888 00002000:00100000:3.0:1746066751.695169:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (876544->1048575) req@ffff880098fbf800 x1830882983070592/t21474841790(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.695177:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf800 with x1830882983070592 ext(876544->1048575) 00010000:00010000:3.0:1746066751.695184:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 10 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.695196:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 10 pid: 9590 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.695203:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbf800 00000100:00100000:0.0:1746066751.701630:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.701720:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983070848 00000100:00100000:1.0:1746066751.701731:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983070848 00000100:00100000:0.0:1746066751.701748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.701785:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15573 00000100:00100000:1.0:1746066751.701793:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:435:x1830882983070848:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066751.701815:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.701833:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f08 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.701864:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 11 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.701872:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.701873:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.701876:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3538943] (req 3145728->3538943) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.701934:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 11 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.701946:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 11 pid: 13363 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.701952:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983070976 00000100:00100000:2.0:1746066751.701957:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983070976 00000100:00100000:1.0:1746066751.701964:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984386176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.701975:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 12 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.702006:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6978 00000100:00100000:2.0:1746066751.702012:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983070976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.702021:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.702040:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 12 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.702051:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 12 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.702072:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984bb600/0xf1867c21abfa61ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 876544->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e28 expref: 12 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.702087:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.702088:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.702137:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.702146:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.702169:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.702177:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984386304:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066751.702254:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.702260:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.703960:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984386176:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.703976:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984386304:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066751.703984:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3538943] (req 3145728->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.703986:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066751.703997:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae200, rc 0) 00000100:00100000:2.0:1746066751.704015:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983070976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2002us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.704017:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+11:435:x1830882983070848:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2226us (2401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.704024:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6978 00000100:00100000:1.0:1746066751.704024:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15573 00000100:00100000:0.0:1746066751.706848:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.707501:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983071104 00000100:00100000:2.0:1746066751.707511:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983071104 00010000:00010000:2.0:1746066751.707549:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 10 pid: 13363 timeout: 819 lvb_type: 0 00000100:00100000:2.0:1746066751.707593:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6979 00000100:00100000:2.0:1746066751.707601:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983071104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066751.707616:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066751.707634:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 10 pid: 13363 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.707646:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 10 pid: 13363 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.707666:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80e800/0xf1867c21abfa6276 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ead expref: 10 pid: 13363 timeout: 819 lvb_type: 0 00010000:00010000:2.0:1746066751.707942:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.707945:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.707956:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.707965:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.707999:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.708011:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984386432:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066751.708095:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.708200:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.708303:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983071360 00000100:00100000:3.0:1746066751.708307:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983071360 00002000:00100000:3.0:1746066751.708340:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880096e6b800 x1830882983071360/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.708350:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6b800 with x1830882983071360 ext(0->1048575) 00002000:00010000:3.0:1746066751.708354:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e6b800 00000100:00100000:3.0:1746066751.708369:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4055 00000100:00100000:3.0:1746066751.708375:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983071360:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.711531:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984386432:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.711553:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.711617:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983071104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4015us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.711631:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6979 00000100:00100000:0.0:1746066751.714067:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.714702:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983071616 00000100:00100000:2.0:1746066751.714713:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983071616 00002000:00100000:2.0:1746066751.714756:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3534848->3538943) req@ffff880096e68a80 x1830882983071616/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.714766:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e68a80 with x1830882983071616 ext(3534848->3538943) 00002000:00010000:2.0:1746066751.714771:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e68a80 00000100:00100000:3.0:1746066751.715166:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983071360:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6788us (7317us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.715174:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4055 00002000:00100000:3.0:1746066751.715181:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880096e6b800 x1830882983071360/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.715188:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6b800 with x1830882983071360 ext(0->1048575) 00002000:00010000:3.0:1746066751.715192:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e6b800 00000100:00100000:3.0:1746066751.715214:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4056 00000100:00100000:3.0:1746066751.715221:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983071616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.715704:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983071616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 482us (1642us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066751.715710:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4056 00002000:00100000:3.0:1746066751.715715:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3534848->3538943) req@ffff880096e68a80 x1830882983071616/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.715721:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e68a80 with x1830882983071616 ext(3534848->3538943) 00002000:00010000:3.0:1746066751.715725:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e68a80 00000100:00100000:0.0:1746066751.721766:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.722044:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983071744 00000100:00100000:1.0:1746066751.722054:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983071744 00000100:00100000:1.0:1746066751.722110:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15574 00000100:00100000:1.0:1746066751.722118:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:442:x1830882983071744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.722137:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.722156:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f0f expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.722186:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.722194:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.722197:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066751.722200:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.722234:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.722246:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 21 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:1.0:1746066751.722258:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984386560:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.722483:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.727039:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.727135:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983071872 00000100:00100000:3.0:1746066751.727145:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983071872 00002000:00100000:3.0:1746066751.727194:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1396735) req@ffff880096e6bb80 x1830882983071872/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066751.727198:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984386560:192.168.204.16@tcp:104: 00002000:00100000:3.0:1746066751.727204:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6bb80 with x1830882983071872 ext(1048576->1396735) 00010000:00010000:3.0:1746066751.727214:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 22 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:1.0:1746066751.727225:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 36 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.727229:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 22 pid: 9590 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.727235:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096e6bb80 00010000:00010000:1.0:1746066751.727240:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae600, rc 0) 00000100:00100000:3.0:1746066751.727275:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 889 00000100:00100000:3.0:1746066751.727283:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983071872:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066751.727291:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+36:442:x1830882983071744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5173us (5536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.727299:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15574 00000100:00100000:3.0:1746066751.735142:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983071872:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7848us (8102us total) trans 17179874346 rc 0/0 00000100:00100000:3.0:1746066751.735155:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 889 00002000:00100000:3.0:1746066751.735168:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1396735) req@ffff880096e6bb80 x1830882983071872/t17179874346(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.735177:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6bb80 with x1830882983071872 ext(1048576->1396735) 00010000:00010000:3.0:1746066751.735188:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.735204:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.735212:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096e6bb80 00000100:00100000:0.0:1746066751.738795:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.738858:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983072000 00000100:00100000:3.0:1746066751.738867:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983072000 00010000:00010000:3.0:1746066751.738923:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.738955:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6980 00000100:00100000:3.0:1746066751.738962:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983072000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.738977:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.738997:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.739008:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.739031:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0c00/0xf1867c21abfa61b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e36 expref: 24 pid: 9590 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.739063:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.739065:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.739072:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.739080:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.739116:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.739128:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984386688:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.739218:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.740613:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984386688:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.740632:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.740660:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983072000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1698us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.740669:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6980 00000100:00100000:0.0:1746066751.742323:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.742368:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983072256 00000100:00100000:3.0:1746066751.742375:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983072256 00002000:00100000:3.0:1746066751.742413:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096e69180 x1830882983072256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.742420:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69180 with x1830882983072256 ext(1048576->2097151) 00002000:00010000:3.0:1746066751.742424:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e69180 00000100:00100000:3.0:1746066751.742446:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4057 00000100:00100000:3.0:1746066751.742453:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983072256:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.748366:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983072256:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5902us (6037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.748379:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4057 00002000:00100000:3.0:1746066751.748391:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096e69180 x1830882983072256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.748400:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69180 with x1830882983072256 ext(1048576->2097151) 00002000:00010000:3.0:1746066751.748407:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e69180 00000100:00100000:0.0:1746066751.756332:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.756772:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.757136:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983072384 00000100:00100000:1.0:1746066751.757145:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983072384 00000100:00100000:1.0:1746066751.757189:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983072512 00000100:00100000:1.0:1746066751.757192:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983072512 00000100:00100000:1.0:1746066751.757327:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15575 00000100:00100000:1.0:1746066751.757336:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983072384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.757358:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066751.757412:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15576 00000100:00100000:3.0:1746066751.757420:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983072512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.757428:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.757442:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d200/0xf1867c21abfa62df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f1d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.757479:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa62e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f16 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.757498:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984386816:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066751.757502:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984386944:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066751.757613:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.757779:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.758941:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984386816:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066751.758968:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d200/0xf1867c21abfa62df lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f1d expref: 37 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066751.758979:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d200/0xf1867c21abfa62df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f1d expref: 37 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066751.759123:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984386944:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066751.759139:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa62e6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f16 expref: 20 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.759147:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa62e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f16 expref: 20 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.759171:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf200, rc 0) 00000100:00100000:1.0:1746066751.759209:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983072384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1874us (2889us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066751.759216:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15575 00010000:00010000:3.0:1746066751.759533:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d200, rc 0) 00000100:00100000:3.0:1746066751.759581:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983072512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2161us (2808us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066751.759587:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15576 00000100:00100000:0.0:1746066751.762481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.763127:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983072640 00000100:00100000:3.0:1746066751.763137:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983072640 00000100:00100000:3.0:1746066751.763194:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15577 00000100:00100000:3.0:1746066751.763203:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:442:x1830882983072640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.763221:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.763238:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f24 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.763268:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.763275:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066751.763277:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066751.763280:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.763309:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 20 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.763319:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 20 pid: 12255 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.763403:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984387072:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066751.764441:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.766166:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984387072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066751.766196:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.766213:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7ce00, rc 0) 00000100:00100000:3.0:1746066751.766253:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:442:x1830882983072640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3050us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.766262:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15577 00000100:00100000:0.0:1746066751.767379:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.767457:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983072768 00000100:00100000:3.0:1746066751.767465:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983072768 00002000:00100000:3.0:1746066751.767504:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3014656->3145727) req@ffff880093ac8700 x1830882983072768/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.767514:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8700 with x1830882983072768 ext(3014656->3145727) 00010000:00010000:3.0:1746066751.767522:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 20 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.767540:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 20 pid: 12255 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.767547:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ac8700 00000100:00100000:3.0:1746066751.767589:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 890 00000100:00100000:3.0:1746066751.767597:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983072768:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066751.770525:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983072768:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2917us (3137us total) trans 21474841791 rc 0/0 00000100:00100000:3.0:1746066751.770538:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 890 00002000:00100000:3.0:1746066751.770548:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3014656->3145727) req@ffff880093ac8700 x1830882983072768/t21474841791(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.770557:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac8700 with x1830882983072768 ext(3014656->3145727) 00010000:00010000:3.0:1746066751.770566:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 22 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.770592:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 22 pid: 12255 timeout: 819 lvb_type: 0 00002000:00010000:3.0:1746066751.770599:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093ac8700 00000100:00100000:0.0:1746066751.773424:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.773601:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983072896 00000100:00100000:3.0:1746066751.773610:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983072896 00010000:00010000:3.0:1746066751.773645:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 22 pid: 12255 timeout: 819 lvb_type: 0 00000100:00100000:3.0:1746066751.773672:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6981 00000100:00100000:3.0:1746066751.773679:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983072896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.773694:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.773714:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 22 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.773726:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 22 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.773749:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa626f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ea6 expref: 22 pid: 12255 timeout: 819 lvb_type: 0 00010000:00010000:3.0:1746066751.773776:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.773778:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.773785:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.773793:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.773826:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.773839:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984387200:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.774479:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.777776:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.777905:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984387200:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.777928:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.777971:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983072896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4291us (4555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.777984:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6981 00000100:00100000:2.0:1746066751.778052:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983073152 00000100:00100000:2.0:1746066751.778060:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983073152 00002000:00100000:2.0:1746066751.778099:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880093ac9880 x1830882983073152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.778108:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9880 with x1830882983073152 ext(2097152->3145727) 00002000:00010000:2.0:1746066751.778113:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ac9880 00000100:00100000:2.0:1746066751.778128:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4058 00000100:00100000:2.0:1746066751.778134:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983073152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066751.800641:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.800985:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983073152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22848us (23216us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.800996:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4058 00002000:00100000:3.0:1746066751.801007:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880093ac9880 x1830882983073152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.801017:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9880 with x1830882983073152 ext(2097152->3145727) 00002000:00010000:3.0:1746066751.801023:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ac9880 00000100:00100000:0.0:1746066751.801270:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983073408 00000100:00100000:0.0:1746066751.801279:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983073408 00000100:00100000:0.0:1746066751.801326:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16216 00000100:00100000:0.0:1746066751.801333:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:446:x1830882983073408:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066751.801355:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066751.801372:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfa62f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f2b expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.801469:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066751.801484:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066751.801495:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:0.0:1746066751.801506:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066751.801606:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14a00/0xf1867c21abfa62f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 47 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.801624:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 46 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066751.801633:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066751.801635:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066751.801638:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14000, rc 0) 00000100:00100000:0.0:1746066751.801660:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:446:x1830882983073408:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 328us (1030us total) trans 8589936525 rc 0/0 00000100:00100000:0.0:1746066751.801666:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16216 00000100:00100000:3.0:1746066751.804038:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984387584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746066751.804086:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984387456:0@lo:400:kworker.0 00000100:00100000:3.0:1746066751.804097:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804116:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804139:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984387584 00000100:00100000:1.0:1746066751.804146:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984387584 00000100:00100000:3.0:1746066751.804152:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3775:1830882984388096:0@lo:400:kworker.0 00000100:00100000:3.0:1746066751.804172:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804179:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984387456 00000100:00100000:1.0:1746066751.804181:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984387456 00000100:00100000:3.0:1746066751.804183:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984388608:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804190:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1746066751.804196:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804196:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984387584:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746066751.804212:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388096 00000100:00100000:3.0:1746066751.804215:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388096 00000004:00000024:1.0:1746066751.804225:0:11960:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:3.0:1746066751.804244:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1746066751.804249:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3775:x1830882984388096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804256:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984387584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.804262:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1746066751.804273:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3775:x1830882984388096:12345-0@lo:400:kworker.0 Request processed in 24us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.804274:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388608 00000100:00100000:1.0:1746066751.804276:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388608 00000100:00100000:3.0:1746066751.804278:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1746066751.804283:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1746066751.804286:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882984387456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804307:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882984387456:12345-0@lo:400:kworker.0 Request processed in 21us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.804311:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3775:1830882984388096:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804312:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1746066751.804319:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1746066751.804321:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984387584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746066751.804323:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984388608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804338:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984388608:12345-0@lo:400:kworker.0 Request processed in 16us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.804343:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1746066751.804360:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984387456:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804365:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984387968:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804383:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804407:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3774:1830882984388480:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804421:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804431:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830882984388992:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804444:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804469:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388480 00000100:00100000:1.0:1746066751.804472:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388480 00000100:00100000:1.0:1746066751.804487:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388992 00000100:00100000:1.0:1746066751.804489:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388992 00000100:00100000:0.0:1746066751.804491:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28b87956-2543-42c1-b799-d011d2dfefc7:3777:1830882984387328:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804501:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1746066751.804506:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3774:x1830882984388480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804518:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804530:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3774:x1830882984388480:12345-0@lo:400:kworker.0 Request processed in 23us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.804535:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1746066751.804541:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984387840:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804542:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1746066751.804546:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830882984388992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804556:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804563:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3774:x1830882984388992:12345-0@lo:400:kworker.0 Request processed in 17us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.804577:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882984388352:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804581:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1746066751.804592:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804597:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388352 00000100:00100000:1.0:1746066751.804599:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388352 00000100:00100000:0.0:1746066751.804600:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984388864:0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804612:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804614:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1746066751.804617:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984388352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804624:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746066751.804628:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3777:1830882984387712:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804639:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984388352:12345-0@lo:400:kworker.0 Request processed in 21us (46us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.804642:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066751.804644:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:1.0:1746066751.804650:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984387712 00000100:00100000:1.0:1746066751.804651:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984387712 00000100:00100000:0.0:1746066751.804651:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3777:1830882984388224:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.804661:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:1.0:1746066751.804665:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3777:x1830882984387712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804665:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066751.804673:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984388736:0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804687:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066751.804701:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882984388352:0@lo:400:kworker.0 00000100:00080000:0.0:1746066751.804717:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746066751.804721:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066751.804730:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984387968 00000100:00100000:0.0:1746066751.804732:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984387968 00000100:00100000:0.0:1746066751.804753:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984387840 00000100:00100000:0.0:1746066751.804755:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984387840 00000100:00100000:0.0:1746066751.804767:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388864 00000100:00100000:0.0:1746066751.804769:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388864 00000100:00100000:0.0:1746066751.804778:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388736 00000100:00100000:0.0:1746066751.804780:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388736 00000100:00100000:0.0:1746066751.804790:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1746066751.804794:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882984387968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804816:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882984387968:12345-0@lo:400:kworker.0 Request processed in 22us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.804821:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1746066751.804828:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1746066751.804831:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984387840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804847:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984387840:12345-0@lo:400:kworker.0 Request processed in 15us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.804851:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1746066751.804858:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1746066751.804861:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984388864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804875:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984388864:12345-0@lo:400:kworker.0 Request processed in 14us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.804880:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1746066751.804901:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1746066751.804905:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882984388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.804920:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882984388736:12345-0@lo:400:kworker.0 Request processed in 14us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066751.804924:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00080000:0.0:1746066751.804937:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746066751.804939:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066751.804948:0:3777:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841776 gen 2 00000004:00080000:0.0:1746066751.804954:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a6300, transno 21474841710 00000004:00080000:0.0:1746066751.804961:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c8ba680, transno 21474841711 00000004:00080000:0.0:1746066751.804963:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c8b9c00, transno 21474841712 00000004:00080000:0.0:1746066751.804966:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0e680, transno 21474841713 00000004:00080000:0.0:1746066751.804968:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c8b8700, transno 21474841714 00000004:00080000:0.0:1746066751.804971:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095800a80, transno 21474841715 00000004:00080000:0.0:1746066751.804973:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c8b9500, transno 21474841716 00000004:00080000:0.0:1746066751.804975:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095802300, transno 21474841717 00000004:00080000:0.0:1746066751.804977:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307100, transno 21474841718 00000004:00080000:0.0:1746066751.804979:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095803800, transno 21474841723 00000004:00080000:0.0:1746066751.804981:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d01c00, transno 21474841724 00000004:00080000:0.0:1746066751.804983:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d01500, transno 21474841725 00000004:00080000:0.0:1746066751.804985:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098924a80, transno 21474841726 00000004:00080000:0.0:1746066751.804987:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d00700, transno 21474841727 00000004:00080000:0.0:1746066751.804989:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d02300, transno 21474841728 00000004:00080000:0.0:1746066751.804991:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d00e00, transno 21474841729 00000004:00080000:0.0:1746066751.804993:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d02a00, transno 21474841730 00000004:00080000:0.0:1746066751.804995:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098925180, transno 21474841731 00000004:00080000:0.0:1746066751.804997:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80000, transno 21474841732 00000004:00080000:0.0:1746066751.804999:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83100, transno 21474841733 00000004:00080000:0.0:1746066751.805000:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d81f80, transno 21474841734 00000004:00080000:0.0:1746066751.805002:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83b80, transno 21474841735 00000004:00080000:0.0:1746066751.805004:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80380, transno 21474841736 00000004:00080000:0.0:1746066751.805006:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80a80, transno 21474841737 00000004:00080000:0.0:1746066751.805008:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de5c700, transno 21474841738 00000004:00080000:0.0:1746066751.805010:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d83480, transno 21474841739 00000004:00080000:0.0:1746066751.805012:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80e00, transno 21474841740 00000004:00080000:0.0:1746066751.805014:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096425f80, transno 21474841746 00000004:00080000:0.0:1746066751.805016:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b0700, transno 21474841747 00000004:00080000:0.0:1746066751.805018:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb5880, transno 21474841748 00000004:00080000:0.0:1746066751.805021:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b2d80, transno 21474841749 00000004:00080000:0.0:1746066751.805023:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096427b80, transno 21474841750 00000004:00080000:0.0:1746066751.805025:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e6b480, transno 21474841751 00000004:00080000:0.0:1746066751.805027:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78e680, transno 21474841752 00000004:00080000:0.0:1746066751.805029:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7100, transno 21474841753 00000004:00080000:0.0:1746066751.805031:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009d9b1500, transno 21474841754 00000004:00080000:0.0:1746066751.805033:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78f480, transno 21474841759 00000004:00080000:0.0:1746066751.805035:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78c700, transno 21474841760 00000004:00080000:0.0:1746066751.805037:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e420380, transno 21474841761 00000004:00080000:0.0:1746066751.805039:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5c00, transno 21474841762 00000004:00080000:0.0:1746066751.805041:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5f80, transno 21474841763 00000004:00080000:0.0:1746066751.805043:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78f800, transno 21474841764 00000004:00080000:0.0:1746066751.805045:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78ea00, transno 21474841765 00000004:00080000:0.0:1746066751.805046:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5880, transno 21474841766 00000004:00080000:0.0:1746066751.805048:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54d880, transno 21474841767 00000004:00080000:0.0:1746066751.805050:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb74380, transno 21474841768 00000004:00080000:0.0:1746066751.805053:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb75500, transno 21474841769 00000004:00080000:0.0:1746066751.805055:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb75880, transno 21474841770 00000004:00080000:0.0:1746066751.805057:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800945d4380, transno 21474841771 00000004:00080000:0.0:1746066751.805059:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb76d80, transno 21474841772 00000004:00080000:0.0:1746066751.805061:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb77b80, transno 21474841773 00000004:00080000:0.0:1746066751.805062:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb76300, transno 21474841774 00000004:00080000:0.0:1746066751.805064:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bb74a80, transno 21474841775 00000004:00080000:0.0:1746066751.805066:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800945d4a80, transno 21474841776 00000100:00100000:0.0:1746066751.805069:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984388736:0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.805078:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984387840:0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.805085:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984388864:0@lo:400:kworker.0 00000100:00100000:2.0:1746066751.805244:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984388224 00000100:00100000:2.0:1746066751.805248:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984388224 00000100:00100000:2.0:1746066751.805269:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:2.0:1746066751.805274:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3777:x1830882984388224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066751.805308:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3777:x1830882984388224:12345-0@lo:400:kworker.0 Request processed in 33us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.805312:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:2.0:1746066751.805354:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984387328 00000100:00100000:2.0:1746066751.805357:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984387328 00000004:00080000:0.0:1746066751.805380:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 54 done 00000100:00080000:0.0:1746066751.805389:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066751.805404:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3777:1830882984388224:0@lo:400:kworker.0 00000100:00100000:3.0:1746066751.805488:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984389120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746066751.805506:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066751.805522:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984388608:0@lo:400:kworker.0 00000100:00100000:3.0:1746066751.805547:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984389120 00000100:00100000:3.0:1746066751.805549:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984389120 00000100:00100000:3.0:1746066751.805562:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1746066751.805700:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882984389120:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746066751.805708:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1746066751.805714:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009673cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3777:x1830882984387328:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1746066751.805717:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445654528 avail 1316192256 00000100:00100000:2.0:1746066751.805740:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009673cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3777:x1830882984387328:12345-0@lo:400:kworker.0 Request processed in 26us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.805742:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882984389120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 175us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.805746:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1746066751.805746:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1746066751.805765:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984389120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746066751.805784:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984387968:0@lo:400:kworker.0 00000100:00100000:3.0:1746066751.805792:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3774:1830882984388480:0@lo:400:kworker.0 00000100:00100000:3.0:1746066751.805800:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3774:1830882984388992:0@lo:400:kworker.0 00000100:00100000:1.0:1746066751.806044:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3777:x1830882984387712:12345-0@lo:400:kworker.0 Request processed in 1377us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.806050:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1746066751.806147:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3777:1830882984387712:0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.806154:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28b87956-2543-42c1-b799-d011d2dfefc7:3777:1830882984387328:0@lo:400:kworker.0 00000100:00100000:0.0:1746066751.810973:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.813472:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.813827:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983073536 00000100:00100000:3.0:1746066751.813836:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983073536 00000100:00100000:2.0:1746066751.814455:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983073664 00000100:00100000:2.0:1746066751.814459:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983073664 00000100:00100000:3.0:1746066751.814469:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15578 00000100:00100000:3.0:1746066751.814477:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:442:x1830882983073536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.814495:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066751.814498:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15579 00000100:00100000:2.0:1746066751.814504:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:446:x1830882983073664:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.814510:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.814512:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f32 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.814517:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f39 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.814542:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.814551:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066751.814553:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066751.814557:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.814565:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066751.814577:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066751.814581:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->3661823] (req 3551232->3661823) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.814625:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->3661823] (req 3551232->3661823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.814635:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 22 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.814646:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 22 pid: 12255 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746066751.814654:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3000, rc 0) 00000100:00100000:3.0:1746066751.814658:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984389248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.814767:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:446:x1830882983073664:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 261us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.814773:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15579 00000100:00100000:3.0:1746066751.814861:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066751.820147:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746066751.820170:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984389376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746066751.820241:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066751.820331:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984389376 00000100:00100000:2.0:1746066751.820339:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984389376 00000100:00100000:2.0:1746066751.820393:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1746066751.820401:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882984389376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746066751.820433:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1080961472 pending 352256 free 3906453504 avail 3674931200 00000100:00100000:2.0:1746066751.820485:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3777:x1830882984389376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.820492:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1746066751.820653:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984389376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746066751.820725:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984389248:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066751.820751:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.820769:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7c600, rc 0) 00000100:00100000:3.0:1746066751.820809:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:442:x1830882983073536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6332us (9848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.820816:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15578 00000100:00100000:0.0:1746066751.821269:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.821718:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983073792 00000100:00100000:3.0:1746066751.821722:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983073792 00002000:00100000:3.0:1746066751.821752:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2703360->3145727) req@ffff880093aca680 x1830882983073792/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.821767:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca680 with x1830882983073792 ext(2703360->3145727) 00010000:00010000:3.0:1746066751.821774:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 23 pid: 12255 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.821787:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 23 pid: 12255 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066751.821794:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093aca680 00000100:00100000:3.0:1746066751.821820:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 891 00000100:00100000:3.0:1746066751.821826:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983073792:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066751.837082:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983073792:12345-192.168.204.16@tcp:4:cat.0 Request processed in 15242us (15799us total) trans 17179874347 rc 0/0 00000100:00100000:3.0:1746066751.837096:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 891 00002000:00100000:3.0:1746066751.837110:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (2703360->3145727) req@ffff880093aca680 x1830882983073792/t17179874347(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.837120:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca680 with x1830882983073792 ext(2703360->3145727) 00010000:00010000:3.0:1746066751.837130:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 25 pid: 12255 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.837147:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 25 pid: 12255 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066751.837154:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093aca680 00000100:00100000:1.0:1746066751.839992:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.840152:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983073920 00000100:00100000:3.0:1746066751.840163:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983073920 00010000:00010000:3.0:1746066751.840199:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 25 pid: 12255 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066751.840224:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6982 00000100:00100000:3.0:1746066751.840231:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983073920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.840245:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.840265:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 25 pid: 12255 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.840276:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 25 pid: 12255 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.840299:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3e00/0xf1867c21abfa628b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2703360->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ec2 expref: 25 pid: 12255 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.840315:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.840318:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.840325:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.840332:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.840339:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.840340:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.840344:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.840354:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.840380:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 37 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.840390:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984389504:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.842618:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.842634:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984389632:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.842678:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.844272:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984389504:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.844281:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984389632:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.844301:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.844345:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983073920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4112us (4359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.844355:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6982 00000100:00100000:0.0:1746066751.845260:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.845329:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983074176 00000100:00100000:3.0:1746066751.845335:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983074176 00002000:00100000:3.0:1746066751.845371:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3551232->3555327) req@ffff880093aca300 x1830882983074176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.845381:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca300 with x1830882983074176 ext(3551232->3555327) 00002000:00010000:3.0:1746066751.845386:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093aca300 00000100:00100000:3.0:1746066751.845404:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4059 00000100:00100000:3.0:1746066751.845411:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983074176:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066751.845543:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983074176:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 132us (283us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066751.845548:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4059 00002000:00100000:3.0:1746066751.845553:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3551232->3555327) req@ffff880093aca300 x1830882983074176/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.845560:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093aca300 with x1830882983074176 ext(3551232->3555327) 00002000:00010000:3.0:1746066751.845563:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093aca300 00000100:00100000:0.0:1746066751.846070:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.846364:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983074432 00000100:00100000:2.0:1746066751.846369:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983074432 00002000:00100000:2.0:1746066751.846388:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff880093acb480 x1830882983074432/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.846396:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acb480 with x1830882983074432 ext(2097152->3145727) 00002000:00010000:2.0:1746066751.846399:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093acb480 00000100:00100000:2.0:1746066751.846421:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4060 00000100:00100000:2.0:1746066751.846427:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983074432:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066751.854181:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984389760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746066751.854248:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066751.854524:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984389760 00000100:00100000:3.0:1746066751.854532:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984389760 00000100:00100000:3.0:1746066751.854588:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1746066751.854596:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984389760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746066751.854620:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1064607040 pending 5550080 free 3912097792 avail 3680575488 00000100:00100000:3.0:1746066751.854666:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984389760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.854671:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1746066751.855902:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984389760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746066751.856222:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.856542:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983074688 00000100:00100000:3.0:1746066751.856547:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983074688 00002000:00100000:3.0:1746066751.856587:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3657728->3661823) req@ffff88012faf7100 x1830882983074688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.856596:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7100 with x1830882983074688 ext(3657728->3661823) 00002000:00010000:3.0:1746066751.856601:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf7100 00000100:00100000:0.0:1746066751.857084:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983074432:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10655us (11013us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066751.857091:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4060 00002000:00100000:0.0:1746066751.857097:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff880093acb480 x1830882983074432/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066751.857104:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acb480 with x1830882983074432 ext(2097152->3145727) 00002000:00010000:0.0:1746066751.857107:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093acb480 00000100:00100000:0.0:1746066751.857123:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4061 00000100:00100000:0.0:1746066751.857129:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983074688:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066751.857381:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983074688:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 251us (1161us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066751.857387:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4061 00002000:00100000:0.0:1746066751.857392:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3657728->3661823) req@ffff88012faf7100 x1830882983074688/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/4536 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066751.857399:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7100 with x1830882983074688 ext(3657728->3661823) 00002000:00010000:0.0:1746066751.857402:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf7100 00000100:00100000:0.0:1746066751.865347:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.866061:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983074816 00000100:00100000:3.0:1746066751.866072:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983074816 00000100:00100000:3.0:1746066751.866133:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15580 00000100:00100000:3.0:1746066751.866141:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+21:442:x1830882983074816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066751.866165:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066751.866184:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f40 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.866218:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 8 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.866226:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066751.866228:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066751.866232:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.866263:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 8 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.866274:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 8 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066751.866287:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984389888:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066751.866379:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.869785:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984389888:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066751.869819:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.869843:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e362400, rc 0) 00000100:00100000:3.0:1746066751.869924:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:442:x1830882983074816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3781us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.869932:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15580 00000100:00100000:0.0:1746066751.870161:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.871044:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983074944 00000100:00100000:2.0:1746066751.871052:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983074944 00002000:00100000:2.0:1746066751.871095:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3538943) req@ffff880096e69500 x1830882983074944/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.871105:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69500 with x1830882983074944 ext(3145728->3538943) 00010000:00010000:2.0:1746066751.871114:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 9 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746066751.871127:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 9 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:2.0:1746066751.871135:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096e69500 00000100:00100000:2.0:1746066751.871164:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 892 00000100:00100000:2.0:1746066751.871171:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983074944:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066751.876694:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983074944:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5511us (6522us total) trans 21474841792 rc 0/0 00000100:00100000:0.0:1746066751.876707:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 892 00002000:00100000:0.0:1746066751.876719:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3538943) req@ffff880096e69500 x1830882983074944/t21474841792(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066751.876729:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69500 with x1830882983074944 ext(3145728->3538943) 00010000:00010000:0.0:1746066751.876740:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066751.876756:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746066751.876763:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096e69500 00000100:00100000:0.0:1746066751.884710:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.885467:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983075072 00000100:00100000:3.0:1746066751.885477:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983075072 00010000:00010000:3.0:1746066751.885517:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066751.885547:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6983 00000100:00100000:3.0:1746066751.885554:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983075072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.885581:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.885600:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.885612:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.885634:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fae200/0xf1867c21abfa62d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f08 expref: 11 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.885652:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.885654:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.885660:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.885672:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.885703:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.885713:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984390016:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.888836:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066751.892534:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984390016:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066751.892558:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.892631:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983075072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7075us (7929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.892643:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6983 00000100:00100000:0.0:1746066751.905208:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.905237:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.905260:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983075328 00000100:00100000:0.0:1746066751.905270:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.905271:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983075328 00002000:00100000:3.0:1746066751.905320:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880096e69880 x1830882983075328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746066751.905353:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983075456 00000100:00100000:1.0:1746066751.905358:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983075456 00000100:00100000:1.0:1746066751.905385:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983075584 00000100:00100000:1.0:1746066751.905386:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983075584 00000100:00100000:1.0:1746066751.905402:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15581 00000100:00100000:1.0:1746066751.905409:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983075456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.905424:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.905440:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f47 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.905463:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.905465:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.905473:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.905488:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.905497:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafe00, rc 0) 00000100:00100000:1.0:1746066751.905543:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882983075456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 134us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.905549:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15581 00000100:00100000:1.0:1746066751.905575:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15582 00000100:00100000:1.0:1746066751.905581:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983075584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.905588:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.905597:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f4e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.905608:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.905610:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746066751.905612:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69880 with x1830882983075328 ext(3145728->4194303) 00010000:00010000:1.0:1746066751.905613:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746066751.905617:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e69880 00010000:00010000:1.0:1746066751.905623:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066751.905630:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faea00, rc 0) 00000100:00100000:3.0:1746066751.905632:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4062 00000100:00100000:3.0:1746066751.905638:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983075328:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066751.905645:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882983075584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.905651:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15582 00000100:00100000:0.0:1746066751.906467:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.906489:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066751.906542:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983075712 00000100:00100000:1.0:1746066751.906547:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983075712 00000100:00100000:1.0:1746066751.906574:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983075840 00000100:00100000:1.0:1746066751.906576:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983075840 00000100:00100000:1.0:1746066751.906587:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15583 00000100:00100000:1.0:1746066751.906591:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882983075712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.906599:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.906608:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f55 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066751.906619:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15584 00010000:00010000:1.0:1746066751.906623:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.906624:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.906629:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066751.906635:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882983075840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066751.906637:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.906654:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.906654:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafa00, rc 0) 00010000:00010000:2.0:1746066751.906669:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa6333 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f5c expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066751.906672:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983075712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.906677:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15583 00000100:00100000:2.0:1746066751.906716:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390144:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066751.906864:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066751.912723:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390144:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066751.912763:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa6333 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f5c expref: 26 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.912779:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa6333 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f5c expref: 26 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066751.913617:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3400, rc 0) 00000100:00100000:0.0:1746066751.915066:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2013:x1830882983075840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8432us (8570us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066751.915077:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15584 00000100:00100000:3.0:1746066751.915963:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983075328:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10315us (10758us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.915978:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4062 00002000:00100000:3.0:1746066751.915990:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880096e69880 x1830882983075328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.915998:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69880 with x1830882983075328 ext(3145728->4194303) 00002000:00010000:3.0:1746066751.916003:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e69880 00000100:00100000:0.0:1746066751.926682:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.926732:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.926755:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983076224 00000100:00100000:2.0:1746066751.926766:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983076224 00000100:00100000:0.0:1746066751.926778:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.926813:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15585 00000100:00100000:2.0:1746066751.926821:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:442:x1830882983076224:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066751.926833:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983076096 00010000:00010000:2.0:1746066751.926842:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066751.926845:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983076096 00010000:00010000:2.0:1746066751.926861:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f63 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.926917:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066751.926920:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88008e332300 x1830882983076096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066751.926925:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066751.926927:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00100000:3.0:1746066751.926930:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332300 with x1830882983076096 ext(0->1048575) 00010000:00010000:2.0:1746066751.926931:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066751.926935:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e332300 00000100:00100000:3.0:1746066751.926955:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983076480 00000100:00100000:3.0:1746066751.926958:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983076480 00010000:00010000:2.0:1746066751.926962:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 39 pid: 11630 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066751.926972:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a5d7f100 x1830882983076480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.926978:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830882983076480 ext(1048576->2097151) 00010000:00010000:2.0:1746066751.926978:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 39 pid: 11630 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066751.926981:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f100 00000100:00100000:2.0:1746066751.926990:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390272:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066751.927001:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4063 00000100:00100000:3.0:1746066751.927008:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983076096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066751.927062:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.927081:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4064 00000100:00100000:2.0:1746066751.927088:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983076480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.933680:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.933871:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983076096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6861us (7136us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066751.933903:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4063 00002000:00100000:0.0:1746066751.933915:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88008e332300 x1830882983076096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066751.933918:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983076608 00002000:00100000:0.0:1746066751.933924:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332300 with x1830882983076096 ext(0->1048575) 00000100:00100000:3.0:1746066751.933926:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983076608 00002000:00010000:0.0:1746066751.933930:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e332300 00000100:00100000:2.0:1746066751.933933:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390272:192.168.204.16@tcp:104: 00002000:00100000:3.0:1746066751.933963:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3551232->3661823) req@ffff8800a5d7ea00 x1830882983076608/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746066751.933964:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066751.933970:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ea00 with x1830882983076608 ext(3551232->3661823) 00010000:00010000:3.0:1746066751.933977:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 40 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746066751.933982:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3400, rc 0) 00010000:00010000:3.0:1746066751.933990:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 40 pid: 11630 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066751.933996:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7ea00 00000100:00100000:2.0:1746066751.934003:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:442:x1830882983076224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7183us (7333us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.934009:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15585 00000100:00100000:3.0:1746066751.934025:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 893 00000100:00100000:3.0:1746066751.934032:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983076608:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066751.939708:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983076480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12605us (12914us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.939721:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4064 00002000:00100000:3.0:1746066751.939733:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a5d7f100 x1830882983076480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.939743:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f100 with x1830882983076480 ext(1048576->2097151) 00002000:00010000:3.0:1746066751.939749:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f100 00000100:00100000:0.0:1746066751.940899:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983076608:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6849us (7211us total) trans 17179874348 rc 0/0 00000100:00100000:0.0:1746066751.940908:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 893 00002000:00100000:0.0:1746066751.940915:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3551232->3661823) req@ffff8800a5d7ea00 x1830882983076608/t17179874348(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/448 e 0 to 0 dl 1746066762 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066751.940925:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ea00 with x1830882983076608 ext(3551232->3661823) 00010000:00010000:0.0:1746066751.940934:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 41 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066751.940950:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 41 pid: 11630 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746066751.940957:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d7ea00 00000100:00100000:0.0:1746066751.946833:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.946955:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983076736 00000100:00100000:3.0:1746066751.946965:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983076736 00010000:00010000:3.0:1746066751.947007:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 41 pid: 11630 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066751.947037:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6984 00000100:00100000:3.0:1746066751.947044:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983076736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.947059:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.947079:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 41 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.947093:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 41 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.947117:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3000/0xf1867c21abfa6310 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3551232->18446744073709551615] (req 3551232->3661823) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f39 expref: 41 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.947152:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.947154:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.947161:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.947170:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.947205:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.947217:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984390400:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.947304:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.948759:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984390400:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066751.948780:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066751.948817:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882983076736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1773us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.948826:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6984 00000100:00100000:0.0:1746066751.952409:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.952553:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983076992 00000100:00100000:2.0:1746066751.952562:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983076992 00002000:00100000:2.0:1746066751.952623:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a5d7c700 x1830882983076992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.952635:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830882983076992 ext(3145728->4194303) 00002000:00010000:2.0:1746066751.952640:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:2.0:1746066751.952672:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4065 00000100:00100000:2.0:1746066751.952680:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882983076992:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066751.960175:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.960416:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882983076992:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7734us (8014us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066751.960427:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4065 00002000:00100000:2.0:1746066751.960438:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a5d7c700 x1830882983076992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.960448:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c700 with x1830882983076992 ext(3145728->4194303) 00002000:00010000:2.0:1746066751.960454:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7c700 00000100:00100000:2.0:1746066751.960479:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983077248 00000100:00100000:2.0:1746066751.960486:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983077248 00002000:00100000:2.0:1746066751.960516:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012b54c380 x1830882983077248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066751.960523:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c380 with x1830882983077248 ext(2097152->3145727) 00002000:00010000:2.0:1746066751.960526:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c380 00000100:00100000:2.0:1746066751.960541:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4066 00000100:00100000:2.0:1746066751.960547:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983077248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066751.971862:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.973336:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983077504 00000100:00100000:3.0:1746066751.973347:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983077504 00002000:00100000:3.0:1746066751.973394:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a5d7c380 x1830882983077504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/0 e 0 to 0 dl 1746066762 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.973404:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c380 with x1830882983077504 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.973409:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c380 00000100:00100000:3.0:1746066751.973430:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4067 00000100:00100000:3.0:1746066751.973437:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983077504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066751.974133:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983077248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13584us (13968us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066751.974141:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4066 00002000:00100000:3.0:1746066751.974147:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff88012b54c380 x1830882983077248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.974154:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c380 with x1830882983077248 ext(2097152->3145727) 00002000:00010000:3.0:1746066751.974157:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c380 00000100:00100000:3.0:1746066751.987191:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983077504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13741us (15327us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066751.987204:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4067 00002000:00100000:3.0:1746066751.987218:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a5d7c380 x1830882983077504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:157/0 lens 488/440 e 0 to 0 dl 1746066762 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066751.987228:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7c380 with x1830882983077504 ext(4194304->5033983) 00002000:00010000:3.0:1746066751.987235:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7c380 00000100:00100000:0.0:1746066751.993537:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066751.993605:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.993688:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983077632 00000100:00100000:2.0:1746066751.993697:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983077632 00000100:00100000:1.0:1746066751.993749:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983077760 00000100:00100000:1.0:1746066751.993754:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983077760 00000100:00100000:1.0:1746066751.993780:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15586 00000100:00100000:2.0:1746066751.993786:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15587 00000100:00100000:1.0:1746066751.993787:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+26:455:x1830882983077632:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066751.993793:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:448:x1830882983077760:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066751.994049:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066751.994054:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066751.994068:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f71 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.994068:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f6a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.994092:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.994094:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.994097:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.994101:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.994107:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.994113:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066751.994114:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066751.994115:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.994117:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1732608->2097151] (req 1732608->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066751.994126:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66400, rc 0) 00010000:00010000:2.0:1746066751.994145:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066751.994156:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 28 pid: 11630 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746066751.994168:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390528:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066751.994176:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:455:x1830882983077632:12345-192.168.204.16@tcp:101:cat.0 Request processed in 389us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066751.994182:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15586 00010000:00010000:2.0:1746066751.994911:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.994921:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 39 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066751.994936:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390656:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066751.995248:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066751.996173:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390528:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066751.997438:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066751.997594:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066751.997627:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1732608->2097151] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066751.997647:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3c00, rc 0) 00000100:00100000:3.0:1746066751.997658:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983077888 00000100:00100000:3.0:1746066751.997666:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983077888 00010000:00010000:3.0:1746066751.997695:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 28 pid: 11630 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746066751.997707:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:448:x1830882983077760:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3913us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066751.997715:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15587 00000100:00100000:3.0:1746066751.997918:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6985 00000100:00100000:3.0:1746066751.997926:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882983077888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.997938:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.997960:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 27 pid: 11630 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066751.997972:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 27 pid: 11630 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066751.997995:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faea00/0xf1867c21abfa6325 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f4e expref: 27 pid: 11630 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066751.998020:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066751.998529:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983077888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 602us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066751.998536:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6985 00000100:00100000:0.0:1746066751.998911:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066751.999122:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983078016 00000100:00100000:3.0:1746066751.999126:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983078016 00010000:00010000:3.0:1746066751.999145:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 40 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066751.999256:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6986 00000100:00100000:3.0:1746066751.999261:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882983078016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066751.999269:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066751.999280:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 40 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.999289:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 40 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.999310:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fae600/0xf1867c21abfa62d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f0f expref: 40 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066751.999322:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.999324:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066751.999331:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.999340:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066751.999369:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066751.999381:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984390784:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066751.999451:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.000533:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.000640:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983078144 00000100:00100000:2.0:1746066752.000645:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983078144 00000100:00100000:2.0:1746066752.000683:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15588 00000100:00100000:2.0:1746066752.000690:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983078144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.000707:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.000723:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa634f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f78 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.000771:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390912:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.000833:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.001292:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984390784:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066752.001304:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066752.001405:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.001420:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983078016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2157us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.001426:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6986 00000100:00100000:2.0:1746066752.001654:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983078400 00000100:00100000:2.0:1746066752.001658:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983078400 00002000:00100000:2.0:1746066752.001687:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1732608->1736703) req@ffff88012bb74380 x1830882983078400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.001696:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74380 with x1830882983078400 ext(1732608->1736703) 00002000:00010000:2.0:1746066752.001700:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74380 00000100:00100000:2.0:1746066752.001725:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4068 00000100:00100000:2.0:1746066752.001731:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983078400:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066752.001839:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983078400:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 108us (434us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066752.001845:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4068 00002000:00100000:2.0:1746066752.001849:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1732608->1736703) req@ffff88012bb74380 x1830882983078400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.001856:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74380 with x1830882983078400 ext(1732608->1736703) 00002000:00010000:2.0:1746066752.001859:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74380 00002000:00010000:2.0:1746066752.002627:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066752 -> 1746066753 00002000:00010000:2.0:1746066752.002631:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066752 -> 1746066753 00002000:00010000:2.0:1746066752.002633:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066752 -> 1746066753 00000100:00100000:2.0:1746066752.002644:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984390912:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.002666:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa634f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f78 expref: 40 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.002679:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3800/0xf1867c21abfa634f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f78 expref: 40 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.002703:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3800, rc 0) 00000100:00100000:2.0:1746066752.002736:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983078144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2046us (2205us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.002742:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15588 00000100:00100000:0.0:1746066752.006261:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.006606:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.006635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.006655:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.006712:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983078528 00000100:00100000:1.0:1746066752.006721:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983078528 00000100:00100000:1.0:1746066752.006758:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983078784 00000100:00100000:1.0:1746066752.006760:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983078784 00000100:00100000:1.0:1746066752.006776:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15589 00000100:00100000:1.0:1746066752.006784:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983078528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066752.006802:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.006820:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfa6356 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f7f expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.006872:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984391040:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.006961:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983079040 00000100:00100000:1.0:1746066752.006964:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.006966:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983079040 00000100:00100000:1.0:1746066752.006981:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15590 00000100:00100000:1.0:1746066752.006987:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+26:448:x1830882983078784:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066752.006993:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746066752.006996:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012bb76d80 x1830882983079040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746066752.007000:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f86 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746066752.007004:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76d80 with x1830882983079040 ext(3145728->4194303) 00002000:00010000:2.0:1746066752.007008:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb76d80 00010000:00010000:1.0:1746066752.007016:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.007028:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 15 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.007034:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.007039:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.007041:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.007044:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1564671] (req 1048576->1564671) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.007061:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.007072:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 27 pid: 1893 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.007080:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391168:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.007106:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 15 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.007114:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 15 pid: 9591 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746066752.007121:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391296:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.007144:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 40 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.007150:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 40 pid: 1893 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.007156:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391424:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.007170:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.007219:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983079168 00000100:00100000:2.0:1746066752.007223:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983079168 00002000:00100000:2.0:1746066752.007237:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012bb77b80 x1830882983079168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.007244:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb77b80 with x1830882983079168 ext(2097152->4194303) 00002000:00010000:2.0:1746066752.007247:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb77b80 00000100:00100000:2.0:1746066752.007257:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4069 00000100:00100000:2.0:1746066752.007262:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983079040:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066752.007509:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4070 00000100:00100000:3.0:1746066752.007518:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983079168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066752.016361:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391168:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.016362:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.016374:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391296:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.016382:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391424:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.016418:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1564671] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.016437:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67200, rc 0) 00000100:00100000:1.0:1746066752.016489:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:448:x1830882983078784:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9500us (9881us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.016497:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15590 00000100:00100000:1.0:1746066752.016556:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984391040:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066752.016593:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfa6356 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f7f expref: 40 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.016602:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f67400/0xf1867c21abfa6356 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f7f expref: 40 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.016621:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67400, rc 0) 00000100:00100000:1.0:1746066752.016638:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983078528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9855us (10387us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066752.016643:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15589 00000100:00100000:3.0:1746066752.016951:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983079552 00000100:00100000:3.0:1746066752.016961:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983079552 00000100:00100000:2.0:1746066752.017021:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066752.017082:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 16 pid: 9591 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746066752.017114:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.017288:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983079424 00000100:00100000:3.0:1746066752.017292:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983079424 00000100:00100000:1.0:1746066752.017718:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983079296 00000100:00100000:1.0:1746066752.017722:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983079296 00010000:00010000:1.0:1746066752.017735:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 39 pid: 1893 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.017754:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6987 00000100:00100000:1.0:1746066752.017760:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983079552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066752.017772:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6988 00010000:00010000:1.0:1746066752.017773:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066752.017780:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983079296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066752.017786:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 16 pid: 9591 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746066752.017788:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066752.017796:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 16 pid: 9591 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746066752.017807:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 39 pid: 1893 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.017815:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa5ca3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ae7 expref: 16 pid: 9591 timeout: 820 lvb_type: 1 00010000:00010000:2.0:1746066752.017822:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 39 pid: 1893 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.017838:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066752.017846:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be3c00/0xf1867c21abfa5c33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a85 expref: 39 pid: 1893 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746066752.017856:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066752.017856:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983079552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.017862:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6987 00000100:00100000:2.0:1746066752.017872:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983079296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.017878:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6988 00010000:00010000:3.0:1746066752.018268:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 29 pid: 1893 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.018288:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6989 00000100:00100000:3.0:1746066752.018294:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882983079424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.018303:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.018314:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 29 pid: 1893 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.018325:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 29 pid: 1893 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.018336:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098be2c00/0xf1867c21abfa5c3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a8c expref: 29 pid: 1893 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.018345:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.018347:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.018353:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.018360:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.018389:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.018400:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984391552:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.018966:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b196dc00 going to sleep for 11 seconds 00000100:00080000:3.0:1746066752.018978:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066752.023293:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984391552:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066752.023318:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.023379:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983079424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5084us (6472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.023393:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6989 00000100:00100000:2.0:1746066752.028319:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983079040:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 21045us (21672us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066752.028331:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4069 00002000:00100000:2.0:1746066752.028343:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012bb76d80 x1830882983079040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.028352:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76d80 with x1830882983079040 ext(3145728->4194303) 00002000:00010000:2.0:1746066752.028359:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb76d80 00000100:00100000:0.0:1746066752.030645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.030689:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983079808 00000100:00100000:2.0:1746066752.030699:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983079808 00002000:00100000:2.0:1746066752.030741:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1560576->1564671) req@ffff88012bb76300 x1830882983079808/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.030751:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76300 with x1830882983079808 ext(1560576->1564671) 00002000:00010000:2.0:1746066752.030757:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb76300 00000100:00100000:2.0:1746066752.030808:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4071 00000100:00100000:2.0:1746066752.030817:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983079808:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066752.030970:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983079808:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 154us (335us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066752.030977:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4071 00002000:00100000:2.0:1746066752.030982:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1560576->1564671) req@ffff88012bb76300 x1830882983079808/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.030989:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76300 with x1830882983079808 ext(1560576->1564671) 00002000:00010000:2.0:1746066752.030992:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb76300 00000100:00100000:3.0:1746066752.037329:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882983079168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 29801us (30661us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066752.037341:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4070 00002000:00100000:3.0:1746066752.037353:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012bb77b80 x1830882983079168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.037363:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb77b80 with x1830882983079168 ext(2097152->4194303) 00002000:00010000:3.0:1746066752.037369:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb77b80 00000100:00100000:0.0:1746066752.046452:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.047386:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983080064 00000100:00100000:3.0:1746066752.047397:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983080064 00002000:00100000:3.0:1746066752.047449:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012bb74a80 x1830882983080064/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.047460:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74a80 with x1830882983080064 ext(4194304->5033983) 00002000:00010000:3.0:1746066752.047467:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb74a80 00000100:00100000:3.0:1746066752.047493:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4072 00000100:00100000:3.0:1746066752.047502:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983080064:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.059218:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983080064:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11703us (12763us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066752.059232:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4072 00002000:00100000:3.0:1746066752.059244:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012bb74a80 x1830882983080064/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.059254:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74a80 with x1830882983080064 ext(4194304->5033983) 00002000:00010000:3.0:1746066752.059261:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb74a80 00000100:00100000:0.0:1746066752.124654:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.124728:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983080192 00000100:00100000:1.0:1746066752.124738:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983080192 00000100:00100000:1.0:1746066752.124828:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16217 00000100:00100000:1.0:1746066752.124837:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:461:x1830882983080192:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066752.124866:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.124920:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66600/0xf1867c21abfa6364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f8d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.124990:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125004:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125015:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125028:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125033:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125038:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125109:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125119:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.125127:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.125133:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.125162:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.125174:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 45 pid: 7243 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.125186:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984391680:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.125284:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 28 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.125292:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 28 pid: 7243 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.125300:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984391808:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.125320:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363540 going to sleep for 11 seconds 00000100:00080000:3.0:1746066752.125512:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066752.129140:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984391680:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.129152:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984391808:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.129179:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066752.129610:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.130214:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.130322:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983080576 00000100:00100000:1.0:1746066752.130330:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983080576 00000100:00100000:3.0:1746066752.130554:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983080320 00000100:00100000:3.0:1746066752.130569:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983080320 00000100:00080000:2.0:1746066752.130657:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746066752.130675:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 46 pid: 7243 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.130702:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5897 00000100:00100000:1.0:1746066752.130709:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+29:8545:x1830882983080576:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066752.130710:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6990 00000100:00100000:3.0:1746066752.130718:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983080320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.130734:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.130741:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 46 pid: 7243 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.130752:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 46 pid: 7243 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.130776:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14000/0xf1867c21abfa62fb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f2b expref: 46 pid: 7243 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.130799:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066752.130806:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.130815:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.130820:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.130825:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.130961:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983080320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 241us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.130968:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6990 00000100:00100000:1.0:1746066752.131395:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:8545:x1830882983080576:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 686us (1789us total) trans 8589936526 rc 0/0 00000100:00100000:1.0:1746066752.131401:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5897 00000100:00100000:0.0:1746066752.133039:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.133389:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983080704 00000100:00100000:3.0:1746066752.133396:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983080704 00010000:00010000:3.0:1746066752.133422:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 30 pid: 7243 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.133513:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6991 00000100:00100000:3.0:1746066752.133520:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983080704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.133531:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.133536:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 30 pid: 7243 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.133546:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 30 pid: 7243 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.133577:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6261 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e9f expref: 30 pid: 7243 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.133593:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066752.133597:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.133606:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.133612:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.133865:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066752.134492:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134499:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066752.134551:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066752.134555:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066752.134581:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134591:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134602:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134608:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134613:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134618:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134623:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f67800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066752.134626:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134635:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134644:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066752.134646:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066752.134649:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134653:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f67800/0xf1867c21abfa636b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134665:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134669:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134673:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134676:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f66e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066752.134678:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134681:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134687:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a438ea00) 00010000:00010000:1.0:1746066752.134688:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066752.134690:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134694:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66e00/0xf1867c21abfa6372 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.134729:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66600/0xf1867c21abfa6364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.134741:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 20 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.134747:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066752.134748:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066752.134751:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66000, rc 0) 00000100:00100000:3.0:1746066752.135512:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983080704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1991us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.135521:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6991 00000100:00100000:1.0:1746066752.136176:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:461:x1830882983080192:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 11339us (11531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.136182:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16217 00000100:00100000:0.0:1746066752.138717:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.138934:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983080832 00000100:00100000:1.0:1746066752.138946:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983080832 00000100:00100000:1.0:1746066752.139041:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15591 00000100:00100000:1.0:1746066752.139052:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983080832:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066752.139071:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.139091:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f94 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.139118:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.139120:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.139133:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.139150:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.139168:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f67e00, rc 0) 00000100:00100000:1.0:1746066752.139236:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983080832:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 183us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.139241:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15591 00000100:00080000:3.0:1746066752.139374:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066752.141104:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.141153:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.141296:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983080960 00000100:00100000:2.0:1746066752.141304:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983080960 00000100:00100000:0.0:1746066752.141323:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.141348:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983081088 00000100:00100000:2.0:1746066752.141350:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983081088 00000100:00100000:2.0:1746066752.141367:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15592 00000100:00100000:2.0:1746066752.141373:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983080960:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066752.141386:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.141401:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800941a1a00/0xf1867c21abfa6387 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0f9b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.141451:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391936:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066752.141473:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15593 00000100:00100000:3.0:1746066752.141484:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983081088:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066752.141494:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.141505:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa638e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fa2 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.141510:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.141541:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984392064:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066752.141586:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.141973:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.142520:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983081344 00000100:00100000:3.0:1746066752.142527:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983081344 00000100:00100000:3.0:1746066752.142559:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983081216 00000100:00100000:3.0:1746066752.142574:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983081216 00000100:00100000:3.0:1746066752.142598:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15594 00000100:00100000:3.0:1746066752.142606:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983081344:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066752.142616:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.142626:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fb0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.142641:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.142644:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.142653:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.142670:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.142681:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428600, rc 0) 00000100:00100000:0.0:1746066752.143277:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15595 00000100:00100000:0.0:1746066752.143287:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983081216:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066752.143298:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.143311:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fa9 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.143325:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.143327:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.143333:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.143343:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.143351:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356aa00, rc 0) 00000100:00100000:3.0:1746066752.143712:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882983081344:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1103us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.143719:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15594 00000100:00100000:0.0:1746066752.144091:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983081216:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 804us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.144098:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15595 00002000:00010000:3.0:1746066752.145385:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066749 -> 1746066753 00002000:00010000:3.0:1746066752.145390:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066749 -> 1746066753 00002000:00010000:3.0:1746066752.145392:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066750 -> 1746066753 00000100:00100000:3.0:1746066752.145415:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984392064:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066752.145445:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa638e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa2 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.145463:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa638e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa2 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.145473:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428400, rc 0) 00000100:00100000:3.0:1746066752.145670:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882983081088:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4188us (4516us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066752.145675:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15593 00000100:00100000:0.0:1746066752.146009:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984391936:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066752.146030:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800941a1a00/0xf1867c21abfa6387 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f9b expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.146042:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800941a1a00/0xf1867c21abfa6387 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f9b expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.146063:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941a1a00, rc 0) 00000100:00100000:0.0:1746066752.146079:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983080960:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4707us (4981us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066752.146083:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15592 00000100:00100000:0.0:1746066752.149438:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.149689:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983081600 00000100:00100000:1.0:1746066752.149698:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983081600 00000100:00100000:1.0:1746066752.149748:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16218 00000100:00100000:1.0:1746066752.149755:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:461:x1830882983081600:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066752.149774:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.149791:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfa63a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fb7 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.150083:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.150099:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.150107:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.150148:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.150161:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 21 pid: 7244 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.150178:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984392192:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.150935:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.151735:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984392192:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.151752:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066752.153190:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.153316:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983081728 00000100:00100000:3.0:1746066752.153324:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983081728 00010000:00010000:3.0:1746066752.153355:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 22 pid: 7244 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.153385:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6992 00000100:00100000:3.0:1746066752.153393:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2016:x1830882983081728:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.153410:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.153416:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 22 pid: 7244 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.153425:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 22 pid: 7244 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.153446:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66000/0xf1867c21abfa6379 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f8d expref: 22 pid: 7244 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.153462:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066752.153467:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.153476:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.153485:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.153502:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.153539:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2016:x1830882983081728:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.153546:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6992 00010000:00010000:1.0:1746066752.153597:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.153603:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066752.153704:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066752.153848:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66200/0xf1867c21abfa63a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb7 expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.153910:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb7 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.153917:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066752.153920:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066752.153923:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66c00, rc 0) 00000100:00100000:1.0:1746066752.154619:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:461:x1830882983081600:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 4860us (5188us total) trans 8589936527 rc 0/0 00000100:00100000:1.0:1746066752.154627:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16218 00000100:00100000:0.0:1746066752.157748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.157937:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983081984 00000100:00100000:1.0:1746066752.157949:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983081984 00000100:00100000:1.0:1746066752.158027:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16219 00000100:00100000:1.0:1746066752.158037:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:461:x1830882983081984:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066752.158068:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.158072:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066752.158101:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f66c00/0xf1867c21abfa63aa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb7 expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.158119:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066752.158123:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066752.158137:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76e00/0xf1867c21abfa63b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fbe expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.158246:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158261:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158270:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158283:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158288:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158294:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158299:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009db76200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066752.158304:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158312:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158319:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066752.158321:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066752.158324:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158329:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa63bf lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.158355:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76e00/0xf1867c21abfa63b8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fbe expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.158363:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76e00/0xf1867c21abfa63b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fbe expref: 21 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.158371:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76e00, rc 0) 00000100:00100000:1.0:1746066752.158447:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:461:x1830882983081984:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 410us (707us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066752.158454:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16219 00000100:00100000:0.0:1746066752.161205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.161333:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983082240 00000100:00100000:1.0:1746066752.162840:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983082240 00000100:00100000:1.0:1746066752.163434:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5898 00000100:00100000:1.0:1746066752.163447:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:461:x1830882983082240:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066752.163731:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:461:x1830882983082240:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 284us (2533us total) trans 8589936528 rc 0/0 00000100:00100000:1.0:1746066752.163739:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5898 00000100:00100000:0.0:1746066752.182637:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.184091:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983082368 00000100:00100000:2.0:1746066752.184103:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983082368 00000100:00100000:2.0:1746066752.184167:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15596 00000100:00100000:2.0:1746066752.184174:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:460:x1830882983082368:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.184195:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.184214:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fc5 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.184248:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.184256:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.184263:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.184270:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.184271:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.184275:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.184306:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.184318:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 25 pid: 11630 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.184330:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984392320:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.184428:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 15 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.184437:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 15 pid: 20361 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746066752.184446:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984392448:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.184467:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.184474:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.184481:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984392576:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.184494:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.187322:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984392320:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.187612:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.187757:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984392448:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.187764:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984392576:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.187793:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.187811:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093506200, rc 0) 00000100:00100000:2.0:1746066752.188096:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:460:x1830882983082368:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3920us (5467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.188105:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15596 00000100:00100000:3.0:1746066752.188186:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983082496 00000100:00100000:3.0:1746066752.188194:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983082496 00010000:00010000:3.0:1746066752.188223:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 16 pid: 20361 timeout: 820 lvb_type: 1 00000100:00100000:3.0:1746066752.188336:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6993 00000100:00100000:3.0:1746066752.188343:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882983082496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.188359:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.188379:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 16 pid: 20361 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066752.188389:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 16 pid: 20361 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066752.188413:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6395 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fb0 expref: 16 pid: 20361 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066752.188440:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.188473:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882983082496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 131us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.188479:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6993 00000100:00100000:0.0:1746066752.190926:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.191028:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983082624 00000100:00100000:3.0:1746066752.191040:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983082624 00000100:00100000:1.0:1746066752.191053:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066752.191079:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.191198:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983082752 00000100:00100000:0.0:1746066752.191201:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983082752 00010000:00010000:0.0:1746066752.191217:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 26 pid: 11630 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.191252:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6994 00000100:00100000:0.0:1746066752.191259:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882983082752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.191274:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066752.191293:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 26 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.191303:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 26 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.191325:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f66400/0xf1867c21abfa6341 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f6a expref: 26 pid: 11630 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.191344:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066752.191381:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983082752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 123us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.191388:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6994 00000100:00100000:3.0:1746066752.191434:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6995 00000100:00100000:3.0:1746066752.191440:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983082624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.191448:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.191455:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.191463:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.191475:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3400/0xf1867c21abfa633a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f63 expref: 39 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.191484:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.191486:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.191493:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.191502:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.191541:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.191553:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984392704:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.191617:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4603c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.194851:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984392704:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066752.194873:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.194958:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983082624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3516us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.194969:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6995 00000100:00100000:1.0:1746066752.195786:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.195876:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983083008 00000100:00100000:3.0:1746066752.195900:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983083008 00002000:00100000:3.0:1746066752.195942:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (4096000->4100095) req@ffff88012b54ce00 x1830882983083008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.195952:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ce00 with x1830882983083008 ext(4096000->4100095) 00002000:00010000:3.0:1746066752.195958:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54ce00 00000100:00100000:3.0:1746066752.195974:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4073 00000100:00100000:3.0:1746066752.195981:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983083008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066752.196120:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983083008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 138us (336us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066752.196126:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4073 00002000:00100000:3.0:1746066752.196131:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (4096000->4100095) req@ffff88012b54ce00 x1830882983083008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.196145:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ce00 with x1830882983083008 ext(4096000->4100095) 00002000:00010000:3.0:1746066752.196147:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54ce00 00000100:00100000:0.0:1746066752.202389:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.202452:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983083136 00000100:00100000:2.0:1746066752.202463:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983083136 00000100:00100000:2.0:1746066752.202521:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15597 00000100:00100000:2.0:1746066752.202530:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:460:x1830882983083136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.202550:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.202581:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fcc expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.202612:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.202620:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.202628:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.202634:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.202636:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.202639:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.202671:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.202683:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 11 pid: 12233 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746066752.202695:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984392832:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.202801:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.202814:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 11 pid: 9592 timeout: 820 lvb_type: 1 00000100:00100000:2.0:1746066752.202823:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984392960:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.202859:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.202866:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 23 pid: 9590 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.202873:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984393088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.202929:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.205212:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984392832:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.205223:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984392960:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.205230:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984393088:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.205260:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->4947967] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.205277:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507000, rc 0) 00000100:00100000:2.0:1746066752.205316:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+23:460:x1830882983083136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2786us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.205324:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15597 00000100:00100000:0.0:1746066752.208833:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.208920:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.208923:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983083392 00000100:00100000:3.0:1746066752.208933:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983083392 00010000:00010000:3.0:1746066752.208971:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 23 pid: 9590 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.209007:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983083264 00000100:00100000:3.0:1746066752.209009:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983083264 00000100:00100000:1.0:1746066752.209015:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6996 00010000:00010000:3.0:1746066752.209018:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 12 pid: 9592 timeout: 820 lvb_type: 1 00000100:00100000:1.0:1746066752.209025:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e20a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983083392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066752.209032:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6997 00000100:00100000:3.0:1746066752.209037:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983083264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066752.209042:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.209046:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.209062:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 12 pid: 9592 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746066752.209063:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 23 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.209073:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 12 pid: 9592 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746066752.209276:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 23 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.209301:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356aa00/0xf1867c21abfa639c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fa9 expref: 12 pid: 9592 timeout: 820 lvb_type: 1 00000100:00100000:0.0:1746066752.209370:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.209386:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983083520 00000100:00100000:0.0:1746066752.209390:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983083520 00010000:00010000:0.0:1746066752.209403:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 12 pid: 12233 timeout: 820 lvb_type: 1 00010000:00010000:1.0:1746066752.209601:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e362400/0xf1867c21abfa6317 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f40 expref: 23 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.209604:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066752.209623:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.209647:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983083264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 609us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.209655:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6997 00000100:00100000:3.0:1746066752.209671:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6998 00000100:00100000:3.0:1746066752.209676:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983083520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.209682:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.209689:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 12 pid: 12233 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066752.209698:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 12 pid: 12233 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066752.209710:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fafa00/0xf1867c21abfa632c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f55 expref: 12 pid: 12233 timeout: 820 lvb_type: 1 00010000:00010000:3.0:1746066752.209719:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.209720:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.209727:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.209736:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.209783:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e20a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983083392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 759us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.209790:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6996 00010000:00010000:3.0:1746066752.209859:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.209871:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984393216:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.209943:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.212378:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984393216:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066752.212399:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.212623:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983083520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2944us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.212633:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6998 00000100:00100000:0.0:1746066752.217381:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.217452:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983083776 00000100:00100000:1.0:1746066752.217463:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983083776 00002000:00100000:1.0:1746066752.217514:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4943872->4947967) req@ffff8800966e2680 x1830882983083776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.217525:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2680 with x1830882983083776 ext(4943872->4947967) 00002000:00010000:1.0:1746066752.217531:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2680 00000100:00100000:1.0:1746066752.217870:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4074 00000100:00100000:1.0:1746066752.217880:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983083776:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066752.218575:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983083776:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 695us (1204us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066752.218582:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4074 00002000:00100000:1.0:1746066752.218588:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4943872->4947967) req@ffff8800966e2680 x1830882983083776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.218596:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2680 with x1830882983083776 ext(4943872->4947967) 00002000:00010000:1.0:1746066752.218599:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2680 00000100:00100000:0.0:1746066752.222485:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.222544:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983084032 00000100:00100000:2.0:1746066752.222554:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983084032 00000100:00100000:2.0:1746066752.222660:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5899 00000100:00100000:2.0:1746066752.222668:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:460:x1830882983084032:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066752.223633:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:460:x1830882983084032:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 263us (454us total) trans 8589936529 rc 0/0 00000100:00100000:2.0:1746066752.223643:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5899 00000100:00100000:0.0:1746066752.258224:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.258830:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.258847:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983084160 00000100:00100000:2.0:1746066752.258856:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983084160 00000100:00100000:2.0:1746066752.259283:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983084288 00000100:00100000:2.0:1746066752.259286:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983084288 00000100:00100000:0.0:1746066752.259455:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.260157:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983084416 00000100:00100000:2.0:1746066752.260161:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983084416 00000100:00100000:2.0:1746066752.260189:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15598 00000100:00100000:2.0:1746066752.260198:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983084160:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066752.260198:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15599 00000100:00100000:1.0:1746066752.260207:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983084288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066752.260216:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.260220:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.260234:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa63db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fd3 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.260234:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfa63d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fda expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.260291:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984393472:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066752.260293:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984393344:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066752.260348:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15600 00000100:00100000:3.0:1746066752.260354:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882983084416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.260361:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.260372:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa63e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fe1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.260373:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.260398:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984393600:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066752.260418:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.260505:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.260579:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.260588:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983084544 00000100:00100000:2.0:1746066752.260590:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983084544 00000100:00100000:2.0:1746066752.260603:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15601 00000100:00100000:2.0:1746066752.260607:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983084544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.260613:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.260618:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa63e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fe8 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.260639:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984393728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.260653:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.266945:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.267016:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983084800 00000100:00100000:2.0:1746066752.267025:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983084800 00000100:00100000:2.0:1746066752.267075:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16220 00000100:00100000:2.0:1746066752.267083:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:469:x1830882983084800:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.267110:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.267129:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa63f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0fef expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.267233:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066752.267247:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066752.267258:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066752.267268:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066752.267357:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa63f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 32 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.267376:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 31 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.267385:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066752.267388:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066752.267391:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895000, rc 0) 00000100:00100000:2.0:1746066752.267435:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:469:x1830882983084800:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 353us (501us total) trans 8589936530 rc 0/0 00000100:00100000:2.0:1746066752.267441:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16220 00000100:00100000:0.0:1746066752.268304:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984393344:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.268330:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984393472:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066752.268335:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfa63d4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fda expref: 43 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.268346:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa63db lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fd3 expref: 43 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.268347:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77c00/0xf1867c21abfa63d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fda expref: 43 pid: 9592 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746066752.268353:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066752 -> 1746066753 00010000:00010000:2.0:1746066752.268354:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa63db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fd3 expref: 42 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.268356:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77c00, rc 0) 00002000:00010000:1.0:1746066752.268357:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066752 -> 1746066753 00002000:00010000:1.0:1746066752.268359:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066752 -> 1746066753 00010000:00010000:2.0:1746066752.268361:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093506600, rc 0) 00000100:00100000:1.0:1746066752.268368:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984393728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.268384:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983084160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8188us (10172us total) trans 0 rc 301/301 00010000:00010000:1.0:1746066752.268386:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa63e9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fe8 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066752.268390:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15598 00000100:00100000:0.0:1746066752.268390:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983084288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8185us (9560us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066752.268394:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15599 00010000:00010000:1.0:1746066752.268395:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa63e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fe8 expref: 41 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.268406:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:1.0:1746066752.268431:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:2014:x1830882983084544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7822us (7925us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066752.268437:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15601 00002000:00010000:3.0:1746066752.268511:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066752 -> 1746066753 00002000:00010000:3.0:1746066752.268514:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066752 -> 1746066753 00002000:00010000:3.0:1746066752.268516:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066752 -> 1746066753 00000100:00100000:3.0:1746066752.268529:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984393600:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066752.268545:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa63e2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fe1 expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.268554:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa63e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fe1 expref: 23 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.268945:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429800, rc 0) 00000100:00100000:3.0:1746066752.268975:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882983084416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8621us (9520us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066752.268980:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15600 00000100:00100000:0.0:1746066752.273481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.273618:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983084928 00000100:00100000:3.0:1746066752.273630:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983084928 00000100:00100000:3.0:1746066752.273683:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15602 00000100:00100000:3.0:1746066752.273691:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+38:468:x1830882983084928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.273710:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.273727:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ff6 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.273758:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.273766:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.273768:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.273771:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.273803:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.273814:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 24 pid: 9590 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.273825:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984393856:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066752.273932:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.279026:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984393856:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066752.279061:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.279080:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429000, rc 0) 00000100:00100000:3.0:1746066752.279140:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:468:x1830882983084928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5447us (5668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.279148:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15602 00000100:00100000:0.0:1746066752.280367:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.280435:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983085056 00000100:00100000:1.0:1746066752.280443:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983085056 00002000:00100000:1.0:1746066752.280484:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1732608->2097151) req@ffff8800958a5c00 x1830882983085056/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.280492:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5c00 with x1830882983085056 ext(1732608->2097151) 00010000:00010000:1.0:1746066752.280500:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 25 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.280512:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 25 pid: 9590 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.280519:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a5c00 00000100:00100000:1.0:1746066752.280636:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 894 00000100:00100000:1.0:1746066752.280644:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983085056:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066752.288160:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.289273:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.290784:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.291653:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983085184 00000100:00100000:3.0:1746066752.291663:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983085184 00000100:00100000:0.0:1746066752.291667:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983085312 00000100:00100000:0.0:1746066752.291670:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983085312 00000100:00100000:3.0:1746066752.291718:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983085440 00000100:00100000:3.0:1746066752.291720:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983085440 00000100:00100000:2.0:1746066752.291787:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15603 00000100:00100000:2.0:1746066752.291797:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983085184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.291817:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.291834:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa640c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d0ffd expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.291839:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15604 00000100:00100000:0.0:1746066752.291844:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2014:x1830882983085312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066752.291851:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.291859:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa6413 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1004 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.291901:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984394112:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066752.291901:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984393984:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066752.291955:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15605 00000100:00100000:3.0:1746066752.291960:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882983085440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.291966:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.291972:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa641a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d100b expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.291995:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984394240:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.292157:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.292169:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.292348:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.293292:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983085056:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12643us (12923us total) trans 17179874349 rc 0/0 00000100:00100000:1.0:1746066752.293303:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 894 00002000:00100000:1.0:1746066752.293317:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1732608->2097151) req@ffff8800958a5c00 x1830882983085056/t17179874349(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.293673:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5c00 with x1830882983085056 ext(1732608->2097151) 00010000:00010000:1.0:1746066752.293681:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 31 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.293694:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 31 pid: 9590 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.293701:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a5c00 00000100:00100000:3.0:1746066752.298043:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984393984:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066752.298085:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa6413 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1004 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.298099:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa6413 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1004 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.298120:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a400, rc 0) 00000100:00100000:3.0:1746066752.298171:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2014:x1830882983085312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6324us (8900us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066752.298179:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15604 00000100:00100000:2.0:1746066752.298182:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984394112:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.298200:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa640c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ffd expref: 30 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.298209:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37800/0xf1867c21abfa640c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ffd expref: 30 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066752.298224:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984394240:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.298233:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37800, rc 0) 00010000:00010000:3.0:1746066752.298237:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa641a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d100b expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.298244:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa641a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d100b expref: 29 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066752.298250:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882983085184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6456us (10101us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066752.298251:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428c00, rc 0) 00000100:00100000:2.0:1746066752.298255:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15603 00000100:00100000:3.0:1746066752.298264:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983085440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6305us (7486us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066752.298268:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15605 00000100:00100000:3.0:1746066752.299125:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.299415:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983085568 00000100:00100000:0.0:1746066752.299423:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983085568 00010000:00010000:0.0:1746066752.299451:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 27 pid: 9590 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.300246:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 6999 00000100:00100000:0.0:1746066752.300256:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983085568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.300272:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066752.300289:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 27 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.300300:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 27 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.300319:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe3c00/0xf1867c21abfa6348 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1732608->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f71 expref: 27 pid: 9590 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.300359:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.300361:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.300368:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.300375:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.300408:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 38 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.300420:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984394368:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066752.300497:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.306242:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984394368:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066752.306271:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066752.306331:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882983085568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6075us (7208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.306343:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 6999 00000100:00100000:0.0:1746066752.309719:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.310317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.310516:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983085824 00000100:00100000:1.0:1746066752.310527:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983085824 00002000:00100000:1.0:1746066752.310596:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800958a5180 x1830882983085824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.310607:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5180 with x1830882983085824 ext(1048576->2097151) 00002000:00010000:1.0:1746066752.310615:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5180 00000100:00100000:3.0:1746066752.311207:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983085952 00000100:00100000:3.0:1746066752.311212:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983085952 00000100:00100000:3.0:1746066752.311757:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15606 00000100:00100000:3.0:1746066752.311766:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:472:x1830882983085952:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.311788:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.311812:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1012 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.311846:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.311848:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.311857:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.311873:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.311960:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4075 00000100:00100000:1.0:1746066752.311969:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983085824:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066752.316254:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428400, rc 0) 00000100:00100000:3.0:1746066752.316367:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:472:x1830882983085952:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4595us (6042us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.316377:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15606 00000100:00100000:1.0:1746066752.320514:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983085824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8533us (10804us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066752.320526:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4075 00002000:00100000:1.0:1746066752.320539:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800958a5180 x1830882983085824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.320549:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5180 with x1830882983085824 ext(1048576->2097151) 00002000:00010000:1.0:1746066752.320567:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a5180 00000100:00100000:2.0:1746066752.329861:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.330449:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983086080 00000100:00100000:3.0:1746066752.330461:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983086080 00000100:00100000:2.0:1746066752.330462:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.330524:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15607 00000100:00100000:3.0:1746066752.330532:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:468:x1830882983086080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.330551:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.330577:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1019 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.330590:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066752.330610:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.330618:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.330620:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.330626:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.330660:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.330673:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 26 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.330686:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984394496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066752.330763:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.330803:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983086336 00000100:00100000:2.0:1746066752.330807:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983086336 00002000:00100000:2.0:1746066752.330838:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf4a80 x1830882983086336/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.330849:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4a80 with x1830882983086336 ext(1048576->2097151) 00002000:00010000:2.0:1746066752.330854:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf4a80 00000100:00100000:2.0:1746066752.330879:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983086464 00000100:00100000:2.0:1746066752.330897:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983086464 00000100:00100000:1.0:1746066752.330897:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4076 00000100:00100000:1.0:1746066752.330905:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983086336:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066752.330910:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1564672->2097151) req@ffff88012faf4700 x1830882983086464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.330923:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4700 with x1830882983086464 ext(1564672->2097151) 00010000:00010000:2.0:1746066752.330928:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 28 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746066752.330939:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 28 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:2.0:1746066752.330945:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012faf4700 00000100:00100000:2.0:1746066752.330956:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 895 00000100:00100000:2.0:1746066752.330962:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983086464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.332008:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984394496:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066752.332028:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 40 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.332040:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429c00, rc 0) 00000100:00100000:3.0:1746066752.332063:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:468:x1830882983086080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1532us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.332069:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15607 00000100:00100000:0.0:1746066752.337967:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.338033:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983086720 00000100:00100000:3.0:1746066752.338044:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983086720 00002000:00100000:3.0:1746066752.338093:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1564671) req@ffff8800958a4700 x1830882983086720/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.338103:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882983086720 ext(1048576->1564671) 00010000:00010000:3.0:1746066752.338112:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 31 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.338126:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 31 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066752.338137:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a4700 00000100:00100000:3.0:1746066752.338174:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 896 00000100:00100000:3.0:1746066752.338183:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983086720:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066752.338256:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983086464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7292us (7664us total) trans 0 rc 532480/532480 00000100:00100000:2.0:1746066752.338264:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 895 00002000:00100000:2.0:1746066752.338271:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1564672->2097151) req@ffff88012faf4700 x1830882983086464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 532480/532480 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.338278:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4700 with x1830882983086464 ext(1564672->2097151) 00010000:00010000:2.0:1746066752.338283:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 30 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:2.0:1746066752.338294:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 31 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:2.0:1746066752.338300:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012faf4700 00000100:00100000:1.0:1746066752.345260:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983086336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14342us (14785us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066752.345273:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4076 00002000:00100000:1.0:1746066752.345287:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf4a80 x1830882983086336/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.345298:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4a80 with x1830882983086336 ext(1048576->2097151) 00002000:00010000:1.0:1746066752.345305:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf4a80 00000100:00100000:3.0:1746066752.354404:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983086720:12345-192.168.204.16@tcp:4:cat.0 Request processed in 16208us (16434us total) trans 17179874350 rc 0/0 00000100:00100000:3.0:1746066752.354419:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 896 00002000:00100000:3.0:1746066752.354432:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1564671) req@ffff8800958a4700 x1830882983086720/t17179874350(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.354442:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882983086720 ext(1048576->1564671) 00010000:00010000:3.0:1746066752.354454:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 29 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.354472:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 29 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066752.354479:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a4700 00000100:00100000:0.0:1746066752.361985:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.362218:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983086848 00000100:00100000:3.0:1746066752.362227:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983086848 00000100:00100000:3.0:1746066752.362280:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15608 00000100:00100000:3.0:1746066752.362288:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:472:x1830882983086848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.362307:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.362327:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1020 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.362358:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.362364:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.362375:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.362385:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428600, rc 0) 00000100:00100000:3.0:1746066752.362441:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:472:x1830882983086848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 154us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.362446:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15608 00000100:00100000:2.0:1746066752.363144:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.363206:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983086976 00000100:00100000:0.0:1746066752.363210:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983086976 00010000:00010000:0.0:1746066752.363230:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 30 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.363248:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7000 00000100:00100000:0.0:1746066752.363254:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983086976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.363263:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066752.363281:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 30 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.363292:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 30 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.363311:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f67200/0xf1867c21abfa635d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1564671) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f86 expref: 30 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.367467:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.367472:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.367487:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.367498:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.367516:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.367517:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.367521:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.367527:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.367581:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 29 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.367595:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984394624:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066752.369291:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 39 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.369305:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984394752:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066752.371208:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800975583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.371249:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984394624:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066752.372589:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984394752:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066752.372611:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066752.372912:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983086976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9655us (9766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.372924:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7000 00000100:00100000:2.0:1746066752.373551:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.373611:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.373675:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983087360 00000100:00100000:0.0:1746066752.373683:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983087360 00000100:00100000:3.0:1746066752.373709:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983087232 00000100:00100000:3.0:1746066752.373713:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983087232 00000100:00100000:0.0:1746066752.373721:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15609 00000100:00100000:0.0:1746066752.373728:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+11:469:x1830882983087360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066752.373741:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746066752.373743:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012faf5880 x1830882983087232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.373753:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5880 with x1830882983087232 ext(1048576->2097151) 00002000:00010000:3.0:1746066752.373757:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf5880 00010000:00010000:0.0:1746066752.373758:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1027 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.373769:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4077 00010000:00010000:0.0:1746066752.373784:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.373791:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066752.373793:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066752.373796:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->3108863] (req 2433024->3108863) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 12 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.373799:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983087232:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:0.0:1746066752.373821:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.373833:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 21 pid: 20361 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.373843:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984394880:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066752.373903:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800975583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.374478:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.374880:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983087616 00000100:00100000:1.0:1746066752.374900:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983087616 00002000:00100000:1.0:1746066752.374925:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a7800 x1830882983087616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.374934:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7800 with x1830882983087616 ext(1048576->2097151) 00002000:00010000:1.0:1746066752.374938:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7800 00000100:00100000:1.0:1746066752.374972:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4078 00000100:00100000:1.0:1746066752.374978:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983087616:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066752.378180:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984394880:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.378211:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->3108863] (req 2433024->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 12 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.378228:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b200, rc 0) 00000100:00100000:2.0:1746066752.378265:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+12:469:x1830882983087360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4536us (4652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.378274:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15609 00000100:00100000:1.0:1746066752.382865:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.383224:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983087744 00000100:00100000:0.0:1746066752.383234:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983087744 00010000:00010000:0.0:1746066752.383319:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 22 pid: 20361 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.383370:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7001 00000100:00100000:0.0:1746066752.383379:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983087744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.383394:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066752.383416:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 22 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.383428:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 22 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.383451:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb7ce00/0xf1867c21abfa62ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f24 expref: 22 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.384438:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.384442:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.384452:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 11 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.384460:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 11 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.384798:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983087232:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 11022us (11247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066752.384807:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4077 00002000:00100000:3.0:1746066752.384817:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012faf5880 x1830882983087232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.384832:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5880 with x1830882983087232 ext(1048576->2097151) 00002000:00010000:3.0:1746066752.384837:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf5880 00000100:00100000:3.0:1746066752.384921:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983087616:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9943us (10444us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066752.384927:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4078 00002000:00100000:3.0:1746066752.384932:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a7800 x1830882983087616/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.384938:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7800 with x1830882983087616 ext(1048576->2097151) 00002000:00010000:3.0:1746066752.384941:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a7800 00010000:00010000:1.0:1746066752.385008:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 11 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.385022:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984395008:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066752.385069:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.387600:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.387847:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983088000 00000100:00100000:3.0:1746066752.387857:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983088000 00002000:00100000:3.0:1746066752.390616:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->2437119) req@ffff8800958a7100 x1830882983088000/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.390628:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7100 with x1830882983088000 ext(2433024->2437119) 00002000:00010000:3.0:1746066752.390634:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7100 00000100:00100000:3.0:1746066752.390941:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4079 00000100:00100000:3.0:1746066752.390956:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983088000:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066752.391008:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984395008:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066752.391031:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066752.391085:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983087744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7707us (8231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.391094:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7001 00000100:00100000:3.0:1746066752.391419:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983088000:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 469us (3827us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066752.391426:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4079 00002000:00100000:3.0:1746066752.391431:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->2437119) req@ffff8800958a7100 x1830882983088000/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.391438:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7100 with x1830882983088000 ext(2433024->2437119) 00002000:00010000:3.0:1746066752.391442:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7100 00000100:00100000:0.0:1746066752.391644:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.391708:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983088128 00000100:00100000:2.0:1746066752.391715:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983088128 00000100:00100000:2.0:1746066752.391744:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15610 00000100:00100000:2.0:1746066752.391749:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+21:468:x1830882983088128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.391760:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.391777:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d102e expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.391803:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 11 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.391810:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066752.391812:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066752.391815:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.391849:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 11 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.391861:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 11 pid: 13363 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.391872:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984395136:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.391959:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.392295:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.392319:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.392372:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983088256 00000100:00100000:0.0:1746066752.392375:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983088256 00000100:00100000:0.0:1746066752.392394:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983088384 00000100:00100000:0.0:1746066752.392396:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983088384 00000100:00100000:0.0:1746066752.392410:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15611 00000100:00100000:0.0:1746066752.392414:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2014:x1830882983088256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066752.392421:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.392428:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa6444 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1035 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.392455:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984395264:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066752.392479:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800975583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.392630:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15612 00000100:00100000:2.0:1746066752.392636:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882983088384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.392644:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.392653:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009575b200/0xf1867c21abfa644b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d103c expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.392678:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984395392:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.392696:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.393376:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984395136:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.393394:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 22 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.393406:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b600, rc 0) 00000100:00100000:2.0:1746066752.393426:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+22:468:x1830882983088128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1677us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.393432:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15610 00000100:00100000:2.0:1746066752.394575:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984395264:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.394596:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa6444 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1035 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.394605:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356a400/0xf1867c21abfa6444 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1035 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.394626:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a400, rc 0) 00000100:00100000:2.0:1746066752.395315:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2014:x1830882983088256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2898us (3018us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.395322:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15611 00000100:00100000:3.0:1746066752.396571:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984395392:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066752.396598:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009575b200/0xf1867c21abfa644b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d103c expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.396610:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009575b200/0xf1867c21abfa644b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d103c expref: 30 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.397073:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b200, rc 0) 00000100:00100000:3.0:1746066752.397785:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882983088384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5143us (5459us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066752.397793:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15612 00000100:00100000:3.0:1746066752.399413:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.399436:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983088640 00000100:00100000:0.0:1746066752.399443:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983088640 00002000:00100000:0.0:1746066752.399486:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3104768->3108863) req@ffff8800a4d80a80 x1830882983088640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066752.399493:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80a80 with x1830882983088640 ext(3104768->3108863) 00010000:00010000:0.0:1746066752.399500:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 12 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.399510:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 12 pid: 13363 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746066752.399516:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d80a80 00000100:00100000:0.0:1746066752.399540:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 897 00000100:00100000:0.0:1746066752.399547:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983088640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066752.399702:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983088640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 154us (293us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066752.399708:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 897 00002000:00100000:0.0:1746066752.399713:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3104768->3108863) req@ffff8800a4d80a80 x1830882983088640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066752.399721:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80a80 with x1830882983088640 ext(3104768->3108863) 00010000:00010000:0.0:1746066752.399725:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 12 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.399733:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 12 pid: 13363 timeout: 820 lvb_type: 0 00002000:00010000:0.0:1746066752.399738:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d80a80 00000100:00100000:0.0:1746066752.403928:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.404039:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983089024 00000100:00100000:3.0:1746066752.404049:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983089024 00000100:00100000:3.0:1746066752.404104:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15613 00000100:00100000:3.0:1746066752.404113:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:472:x1830882983089024:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066752.404220:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.404270:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983088896 00000100:00100000:1.0:1746066752.404274:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983088896 00002000:00100000:1.0:1746066752.404299:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->3108863) req@ffff8800958a6d80 x1830882983088896/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.404308:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6d80 with x1830882983088896 ext(2433024->3108863) 00010000:00010000:1.0:1746066752.404316:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 13 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.404337:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 13 pid: 13363 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.404344:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a6d80 00000100:00100000:1.0:1746066752.404356:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 898 00000100:00100000:1.0:1746066752.404361:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882983088896:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746066752.404523:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.404540:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1043 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.404572:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.404578:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.404588:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.404603:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428a00, rc 0) 00000100:00100000:3.0:1746066752.404630:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+15:472:x1830882983089024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 518us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.404636:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15613 00000100:00100000:1.0:1746066752.410494:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882983088896:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6121us (6262us total) trans 21474841793 rc 0/0 00000100:00100000:1.0:1746066752.410507:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 898 00002000:00100000:1.0:1746066752.410521:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->3108863) req@ffff8800958a6d80 x1830882983088896/t21474841793(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.410531:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6d80 with x1830882983088896 ext(2433024->3108863) 00010000:00010000:1.0:1746066752.410542:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 15 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.410575:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 15 pid: 13363 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.410582:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a6d80 00000100:00100000:0.0:1746066752.412595:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.412732:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983089152 00000100:00100000:1.0:1746066752.412738:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983089152 00010000:00010000:1.0:1746066752.412765:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 15 pid: 13363 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.412790:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7002 00000100:00100000:1.0:1746066752.412794:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983089152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066752.412805:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066752.412821:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 15 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.412830:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 15 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.412847:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356b200/0xf1867c21abfa6436 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2433024->4194303] (req 2433024->3108863) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1027 expref: 15 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.412863:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.412864:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.412870:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.412878:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.412904:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.412904:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.412907:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.412911:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.412934:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.412942:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984395520:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066752.413007:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 21 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.413015:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984395648:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066752.413031:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.418445:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984395520:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066752.418458:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984395648:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066752.418485:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066752.418539:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983089152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5742us (5949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.418552:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7002 00000100:00100000:0.0:1746066752.419532:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.419582:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.420703:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983089408 00000100:00100000:1.0:1746066752.420712:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983089408 00002000:00100000:1.0:1746066752.420760:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800958a5880 x1830882983089408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.420770:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5880 with x1830882983089408 ext(2097152->3145727) 00002000:00010000:1.0:1746066752.420776:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5880 00000100:00100000:1.0:1746066752.420805:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983089664 00000100:00100000:1.0:1746066752.420808:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983089664 00000100:00100000:2.0:1746066752.420812:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4080 00002000:00100000:1.0:1746066752.420818:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800958a5f80 x1830882983089664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746066752.420822:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983089408:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746066752.420825:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5f80 with x1830882983089664 ext(2097152->4194303) 00002000:00010000:1.0:1746066752.420828:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5f80 00000100:00100000:1.0:1746066752.420851:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4081 00000100:00100000:1.0:1746066752.420856:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983089664:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066752.450578:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983089664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 29700us (30974us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066752.450592:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4081 00002000:00100000:1.0:1746066752.450606:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800958a5f80 x1830882983089664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.450616:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5f80 with x1830882983089664 ext(2097152->4194303) 00002000:00010000:1.0:1746066752.450623:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5f80 00000100:00100000:2.0:1746066752.456568:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983089408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 35727us (37018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066752.456583:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4080 00002000:00100000:2.0:1746066752.456596:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800958a5880 x1830882983089408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.456605:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a5880 with x1830882983089408 ext(2097152->3145727) 00002000:00010000:2.0:1746066752.456611:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a5880 00000100:00100000:0.0:1746066752.460870:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.461538:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983089920 00000100:00100000:2.0:1746066752.461549:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983089920 00000100:00100000:2.0:1746066752.461615:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16221 00000100:00100000:2.0:1746066752.461624:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:475:x1830882983089920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.461653:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.461672:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfa6459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d104a expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.461781:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066752.461797:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066752.461808:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066752.461818:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066752.461953:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575bc00/0xf1867c21abfa6459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 49 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.461980:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 48 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.461988:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066752.461991:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066752.461993:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575be00, rc 0) 00000100:00100000:2.0:1746066752.462045:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+48:475:x1830882983089920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 422us (1185us total) trans 8589936531 rc 0/0 00000100:00100000:2.0:1746066752.462052:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16221 00000100:00100000:2.0:1746066752.468410:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.468669:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983090048 00000100:00100000:3.0:1746066752.468680:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983090048 00000100:00100000:3.0:1746066752.468730:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15614 00000100:00100000:3.0:1746066752.468738:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:472:x1830882983090048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.468757:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066752.468765:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066752.468779:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1051 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.468805:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983090176 00000100:00100000:3.0:1746066752.468808:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983090176 00000100:00100000:3.0:1746066752.468832:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15615 00000100:00100000:3.0:1746066752.468836:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:468:x1830882983090176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.468843:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.468848:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1058 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.468869:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.468877:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.468879:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.468918:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.468952:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.468964:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 41 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.468976:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984395776:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066752.469071:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00010000:00010000:3.0:1746066752.469085:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.469086:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.469093:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.469105:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 30 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.469116:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59c00, rc 0) 00000100:00100000:3.0:1746066752.469141:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:472:x1830882983090048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 404us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.469146:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15614 00000100:00100000:3.0:1746066752.473134:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984395776:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066752.473168:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.473194:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096a59e00, rc 0) 00000100:00100000:3.0:1746066752.473251:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:468:x1830882983090176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4413us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.473259:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15615 00000100:00100000:0.0:1746066752.477037:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.477087:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.477167:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983090432 00000100:00100000:1.0:1746066752.477176:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983090432 00002000:00100000:1.0:1746066752.477226:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800958a4a80 x1830882983090432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.477236:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4a80 with x1830882983090432 ext(2097152->3145727) 00002000:00010000:1.0:1746066752.477242:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4a80 00000100:00100000:1.0:1746066752.477270:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983090560 00000100:00100000:1.0:1746066752.477273:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983090560 00002000:00100000:1.0:1746066752.477286:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (4096000->4194303) req@ffff8800958a7480 x1830882983090560/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.477292:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7480 with x1830882983090560 ext(4096000->4194303) 00010000:00010000:1.0:1746066752.477300:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 41 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.477313:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 41 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.477318:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a7480 00000100:00100000:1.0:1746066752.477331:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 899 00000100:00100000:1.0:1746066752.477338:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983090560:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066752.477460:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4082 00000100:00100000:2.0:1746066752.477468:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983090432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066752.483197:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.483275:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983090816 00000100:00100000:2.0:1746066752.483286:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983090816 00002000:00100000:2.0:1746066752.483333:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800958a7b80 x1830882983090816/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.483344:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7b80 with x1830882983090816 ext(3145728->4194303) 00002000:00010000:2.0:1746066752.483351:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7b80 00000100:00100000:2.0:1746066752.483468:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4083 00000100:00100000:2.0:1746066752.483476:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983090816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.492641:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983090432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15160us (15602us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066752.492654:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4082 00002000:00100000:3.0:1746066752.492667:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800958a4a80 x1830882983090432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.492676:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4a80 with x1830882983090432 ext(2097152->3145727) 00002000:00010000:3.0:1746066752.492682:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4a80 00000100:00100000:1.0:1746066752.504279:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882983090560:12345-192.168.204.16@tcp:4:cat.0 Request processed in 26926us (27175us total) trans 17179874351 rc 0/0 00000100:00100000:1.0:1746066752.504292:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 899 00002000:00100000:1.0:1746066752.504307:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (4096000->4194303) req@ffff8800958a7480 x1830882983090560/t17179874351(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.504316:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7480 with x1830882983090560 ext(4096000->4194303) 00010000:00010000:1.0:1746066752.504327:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 43 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.504346:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 43 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.504352:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958a7480 00000100:00100000:3.0:1746066752.506673:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983090816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23191us (23481us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066752.506683:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4083 00002000:00100000:3.0:1746066752.506690:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800958a7b80 x1830882983090816/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.506697:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a7b80 with x1830882983090816 ext(3145728->4194303) 00002000:00010000:3.0:1746066752.506702:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a7b80 00010000:00010000:2.0:1746066752.507086:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066752.507381:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.507427:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983090944 00000100:00100000:1.0:1746066752.507434:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983090944 00010000:00010000:1.0:1746066752.507463:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 43 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.507493:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7003 00000100:00100000:1.0:1746066752.507499:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983090944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066752.507511:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066752.507527:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 43 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.507537:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 43 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.507567:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa63c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [4096000->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fc5 expref: 43 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.507583:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.507585:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.507591:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.507603:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.507633:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.507643:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984395904:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066752.507699:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.509717:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984395904:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066752.509718:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066752.509737:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066752.509769:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882983090944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2269us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.509778:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7003 00000100:00100000:3.0:1746066752.509972:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983091072 00000100:00100000:3.0:1746066752.509977:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983091072 00000100:00100000:3.0:1746066752.510021:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15616 00000100:00100000:3.0:1746066752.510027:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:472:x1830882983091072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.510043:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.510058:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d105f expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.510078:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.510080:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.510086:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.510098:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.510107:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce1a00, rc 0) 00000100:00100000:3.0:1746066752.510125:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:472:x1830882983091072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 99us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.510130:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15616 00000100:00100000:0.0:1746066752.512624:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.512734:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983091328 00000100:00100000:3.0:1746066752.512739:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983091328 00002000:00100000:3.0:1746066752.512769:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a03d6300 x1830882983091328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.512777:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6300 with x1830882983091328 ext(3145728->4194303) 00002000:00010000:3.0:1746066752.512781:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6300 00000100:00100000:3.0:1746066752.512802:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4084 00000100:00100000:3.0:1746066752.512807:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983091328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066752.517044:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.517111:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983091584 00000100:00100000:1.0:1746066752.517121:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983091584 00002000:00100000:1.0:1746066752.517164:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a03d4700 x1830882983091584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.517174:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882983091584 ext(3145728->4194303) 00002000:00010000:1.0:1746066752.517180:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:1.0:1746066752.517216:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4085 00000100:00100000:1.0:1746066752.517224:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983091584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.517877:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983091328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5068us (5258us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066752.517903:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4084 00002000:00100000:3.0:1746066752.517909:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a03d6300 x1830882983091328/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.517915:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6300 with x1830882983091328 ext(3145728->4194303) 00002000:00010000:3.0:1746066752.517918:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6300 00000100:00100000:0.0:1746066752.522488:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.522569:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983091712 00000100:00100000:2.0:1746066752.522579:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983091712 00000100:00100000:2.0:1746066752.522635:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15617 00000100:00100000:2.0:1746066752.522643:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882983091712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.522663:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.522679:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa6483 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1066 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.522729:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396032:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.522824:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.525064:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983091584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7834us (8022us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066752.525078:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4085 00002000:00100000:1.0:1746066752.525089:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800a03d4700 x1830882983091584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.525099:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882983091584 ext(3145728->4194303) 00002000:00010000:1.0:1746066752.525104:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:2.0:1746066752.526354:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396032:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.526396:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa6483 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1066 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.526410:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa6483 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1066 expref: 23 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.526440:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898e00, rc 0) 00000100:00100000:2.0:1746066752.526477:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882983091712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3833us (4001us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.526484:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15617 00000100:00100000:0.0:1746066752.532242:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.532301:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.532570:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983092096 00000100:00100000:1.0:1746066752.532579:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983092096 00000100:00100000:2.0:1746066752.532584:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983091840 00000100:00100000:2.0:1746066752.532588:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983091840 00002000:00100000:1.0:1746066752.532633:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4947968->5033983) req@ffff8800a03d6d80 x1830882983092096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.532644:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882983092096 ext(4947968->5033983) 00002000:00010000:1.0:1746066752.532649:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d6d80 00000100:00100000:2.0:1746066752.532765:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15618 00000100:00100000:2.0:1746066752.532774:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983091840:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066752.532807:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4086 00000100:00100000:1.0:1746066752.532813:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882983092096:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:2.0:1746066752.532851:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.532869:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa648a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d106d expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.533130:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396160:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.533570:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.534910:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396160:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066752.535025:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+22:2014:x1830882983092096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2209us (2721us total) trans 0 rc 86016/86016 00000100:00100000:1.0:1746066752.535036:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4086 00002000:00100000:1.0:1746066752.535045:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4947968->5033983) req@ffff8800a03d6d80 x1830882983092096/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 86016/86016 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.535054:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882983092096 ext(4947968->5033983) 00002000:00010000:1.0:1746066752.535058:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d6d80 00010000:00010000:2.0:1746066752.535603:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa648a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d106d expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.535617:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898400/0xf1867c21abfa648a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d106d expref: 15 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.535668:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898400, rc 0) 00000100:00100000:2.0:1746066752.535765:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983091840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2991us (3533us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.535776:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15618 00000100:00100000:2.0:1746066752.538580:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.538656:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983092224 00000100:00100000:0.0:1746066752.538667:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983092224 00000100:00100000:0.0:1746066752.538768:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15619 00000100:00100000:0.0:1746066752.538777:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:472:x1830882983092224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066752.538798:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.538815:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1074 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.538843:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.538848:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066752.538850:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066752.538852:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.538878:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 21 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.538909:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 21 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.538919:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396288:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066752.538992:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.542346:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.542395:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.542495:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983092480 00000100:00100000:3.0:1746066752.542500:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983092352 00000100:00100000:3.0:1746066752.542505:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983092352 00000100:00100000:1.0:1746066752.542505:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983092480 00000100:00100000:3.0:1746066752.542545:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15620 00002000:00100000:1.0:1746066752.542548:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4947967) req@ffff8800a03d4380 x1830882983092480/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066752.542563:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2014:x1830882983092352:12345-192.168.204.16@tcp:101:cat.0 00002000:00100000:1.0:1746066752.542574:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4380 with x1830882983092480 ext(4194304->4947967) 00010000:00010000:3.0:1746066752.542577:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.542584:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 23 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.542592:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce1200/0xf1867c21abfa6498 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d107b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.542598:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 23 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.542604:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d4380 00000100:00100000:1.0:1746066752.542620:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 900 00000100:00100000:1.0:1746066752.542625:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983092480:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066752.542643:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984396416:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066752.542711:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.542795:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a03d7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396288:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.542816:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 15 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.542827:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8c00, rc 0) 00000100:00100000:2.0:1746066752.542848:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+15:472:x1830882983092224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4073us (4280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.542855:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15619 00000100:00100000:3.0:1746066752.544928:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984396416:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066752.544958:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce1200/0xf1867c21abfa6498 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d107b expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.544970:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce1200/0xf1867c21abfa6498 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d107b expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.544988:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce1200, rc 0) 00000100:00100000:3.0:1746066752.545032:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983092352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2479us (2694us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066752.545039:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15620 00000100:00100000:2.0:1746066752.549843:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.550286:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983092608 00000100:00100000:3.0:1746066752.550296:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983092608 00000100:00100000:3.0:1746066752.550341:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15621 00000100:00100000:3.0:1746066752.550349:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+24:468:x1830882983092608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.550369:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.550386:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1082 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.550414:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.550416:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.550420:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.550432:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.550442:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0e00, rc 0) 00000100:00100000:3.0:1746066752.550490:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:468:x1830882983092608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 141us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.550496:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15621 00000100:00100000:1.0:1746066752.552849:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983092480:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10213us (10444us total) trans 21474841794 rc 0/0 00000100:00100000:1.0:1746066752.552860:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 900 00002000:00100000:1.0:1746066752.552871:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4947967) req@ffff8800a03d4380 x1830882983092480/t21474841794(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.552879:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4380 with x1830882983092480 ext(4194304->4947967) 00010000:00010000:1.0:1746066752.552906:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.552920:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:1.0:1746066752.552925:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a03d4380 00000100:00100000:0.0:1746066752.561330:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.561446:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983092736 00000100:00100000:1.0:1746066752.561457:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983092736 00010000:00010000:1.0:1746066752.561495:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.561536:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7004 00000100:00100000:1.0:1746066752.561544:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983092736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066752.561567:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066752.561587:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.561600:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.561622:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093507000/0xf1867c21abfa63cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4947967) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fcc expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.562248:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.562251:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.562259:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.562268:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.562276:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.562277:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.562280:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.562291:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.562322:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 24 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.562333:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984396544:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066752.562437:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.562445:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984396672:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066752.562463:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.565301:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984396544:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066752.565312:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984396672:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066752.565333:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066752.565382:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882983092736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3837us (4061us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.565393:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7004 00000100:00100000:0.0:1746066752.565626:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.565761:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983092992 00000100:00100000:1.0:1746066752.565768:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983092992 00002000:00100000:1.0:1746066752.565803:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff8800a03d4e00 x1830882983092992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.565812:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4e00 with x1830882983092992 ext(5029888->5033983) 00002000:00010000:1.0:1746066752.565817:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4e00 00000100:00100000:1.0:1746066752.565841:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4087 00000100:00100000:1.0:1746066752.565847:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983092992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066752.566064:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983092992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 216us (438us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066752.566069:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4087 00002000:00100000:1.0:1746066752.566074:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff8800a03d4e00 x1830882983092992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.566080:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4e00 with x1830882983092992 ext(5029888->5033983) 00002000:00010000:1.0:1746066752.566082:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4e00 00000100:00100000:0.0:1746066752.566275:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.566363:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983093248 00000100:00100000:1.0:1746066752.566366:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983093248 00002000:00100000:1.0:1746066752.566378:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a03d5c00 x1830882983093248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.566386:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882983093248 ext(4194304->5033983) 00002000:00010000:1.0:1746066752.566389:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:1.0:1746066752.566397:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4088 00000100:00100000:1.0:1746066752.566401:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983093248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066752.578574:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983093248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12151us (12278us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066752.578588:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4088 00002000:00100000:1.0:1746066752.578600:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a03d5c00 x1830882983093248/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.578609:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882983093248 ext(4194304->5033983) 00002000:00010000:1.0:1746066752.578616:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:0.0:1746066752.616700:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.616776:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983093376 00000100:00100000:2.0:1746066752.616787:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983093376 00000100:00100000:2.0:1746066752.616847:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15622 00000100:00100000:2.0:1746066752.616855:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:475:x1830882983093376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.616875:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.616925:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1089 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.616956:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.616965:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.616976:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.616982:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.616988:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066752.616990:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066752.616994:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 7/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.617023:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.617035:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 14 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.617047:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.617197:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 25 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.617206:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 25 pid: 13363 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.617214:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396928:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.617239:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.617247:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 25 pid: 9592 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.617253:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984397056:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.617268:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.617274:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.617280:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984397184:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.617290:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.622381:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.622487:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.622590:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.622618:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983093632 00000100:00100000:0.0:1746066752.622626:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983093632 00000100:00100000:1.0:1746066752.622657:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983093504 00000100:00100000:1.0:1746066752.622662:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983093504 00010000:00010000:0.0:1746066752.622663:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 26 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.622679:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 15 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:0.0:1746066752.622692:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983093760 00000100:00100000:0.0:1746066752.622695:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983093760 00000100:00100000:1.0:1746066752.622697:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7005 00000100:00100000:1.0:1746066752.622705:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983093632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.622705:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 27 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.622718:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066752.622719:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7006 00000100:00100000:0.0:1746066752.622724:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882983093504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.622731:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066752.622739:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 27 pid: 13363 timeout: 820 lvb_type: 0 00010000:00010000:0.0:1746066752.622741:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 9 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 15 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.622750:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 27 pid: 13363 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.622784:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7007 00000100:00100000:3.0:1746066752.622792:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983093760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.622799:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066752.622825:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 9 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 15 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.622869:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 27 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.622896:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 27 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:1.0:1746066752.622896:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066752.622907:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066752.622912:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.622938:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983093760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 147us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.622938:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882983093504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 213us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.622939:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983093632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 234us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.622944:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7006 00000100:00100000:3.0:1746066752.622946:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7007 00000100:00100000:1.0:1746066752.622949:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7005 00010000:00010000:2.0:1746066752.623058:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6452 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1043 expref: 14 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.623088:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396800:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.623100:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575b600/0xf1867c21abfa643d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d102e expref: 25 pid: 13363 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.623107:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984396928:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.623115:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce0e00/0xf1867c21abfa649f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1082 expref: 24 pid: 9592 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.623127:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984397056:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.623134:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984397184:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.623245:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 23 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.623255:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898c00, rc 0) 00000100:00100000:2.0:1746066752.623284:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+23:475:x1830882983093376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6430us (6596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.623289:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15622 00000100:00100000:0.0:1746066752.625063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.625341:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983093888 00000100:00100000:3.0:1746066752.625347:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983093888 00010000:00010000:3.0:1746066752.625371:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.625402:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7008 00000100:00100000:3.0:1746066752.625409:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983093888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.625420:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.625434:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.625445:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.625464:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa6491 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1074 expref: 14 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.625489:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.625491:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.625497:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.625510:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.625538:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.625549:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984397312:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.625625:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.629259:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.629260:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984397312:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066752.629281:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.629328:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983093888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3918us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.629338:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7008 00000100:00100000:0.0:1746066752.629414:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983094144 00000100:00100000:0.0:1746066752.629421:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983094144 00002000:00100000:0.0:1746066752.629462:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4034559) req@ffff88012b54ca80 x1830882983094144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066752.629471:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ca80 with x1830882983094144 ext(4030464->4034559) 00002000:00010000:0.0:1746066752.629476:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54ca80 00000100:00100000:0.0:1746066752.629490:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4089 00000100:00100000:0.0:1746066752.629496:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983094144:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066752.631727:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983094144:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 2218us (2463us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066752.631738:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4089 00002000:00100000:0.0:1746066752.631749:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4034559) req@ffff88012b54ca80 x1830882983094144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066752.631759:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ca80 with x1830882983094144 ext(4030464->4034559) 00002000:00010000:0.0:1746066752.631764:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54ca80 00000100:00100000:0.0:1746066752.636326:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.636771:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.638199:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983094272 00000100:00100000:2.0:1746066752.638210:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983094272 00000100:00100000:2.0:1746066752.638266:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983094400 00000100:00100000:2.0:1746066752.638268:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983094400 00000100:00100000:2.0:1746066752.638292:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15623 00000100:00100000:2.0:1746066752.638299:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+31:479:x1830882983094272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.638318:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.638335:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1090 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638363:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638372:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638384:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.638386:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.638390:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1236992->1585151] (req 1236992->1585151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638417:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638427:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 32 pid: 20361 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.638438:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984397440:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.638533:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 42 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638541:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 42 pid: 20361 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.638549:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984397568:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.638573:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.638588:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15624 00000100:00100000:2.0:1746066752.638594:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:475:x1830882983094400:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.638600:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.638605:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1097 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638619:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638626:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638632:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.638633:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.638635:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->3969023] (req 3145728->3969023) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 43 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638648:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 32 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638654:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 32 pid: 9592 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.638661:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984397696:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.638680:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.638687:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 43 pid: 9592 timeout: 820 lvb_type: 0 00000100:00100000:2.0:1746066752.638694:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984397824:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.638706:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.643272:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984397696:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066752.643285:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984397824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066752.643338:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->3969023] (req 3145728->3969023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 43 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.643356:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899200, rc 0) 00000100:00100000:3.0:1746066752.643399:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:475:x1830882983094400:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4804us (6627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.643408:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15624 00000100:00100000:2.0:1746066752.643691:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984397440:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.643701:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984397568:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.643719:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1236992->1585151] (req 1236992->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.643730:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899000, rc 0) 00000100:00100000:2.0:1746066752.643753:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+32:479:x1830882983094272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5454us (7438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.643759:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15623 00000100:00100000:0.0:1746066752.644724:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.644792:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983094528 00000100:00100000:3.0:1746066752.644800:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983094528 00010000:00010000:3.0:1746066752.644831:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 43 pid: 20361 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.646863:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7009 00000100:00100000:3.0:1746066752.646877:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983094528:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.646907:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.646928:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 43 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.646941:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 43 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.646963:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e429000/0xf1867c21abfa6405 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ff6 expref: 43 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.646988:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.647034:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983094528:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 161us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.647039:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7009 00000100:00100000:3.0:1746066752.647516:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.647561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.647592:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.647614:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983094784 00000100:00100000:3.0:1746066752.647621:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983094784 00010000:00010000:3.0:1746066752.647641:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 32 pid: 20361 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.647663:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983094656 00000100:00100000:3.0:1746066752.647665:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983094656 00010000:00010000:3.0:1746066752.647672:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 33 pid: 9592 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.647683:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983094912 00000100:00100000:3.0:1746066752.647685:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983094912 00010000:00010000:3.0:1746066752.647691:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 42 pid: 9592 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.647704:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7010 00000100:00100000:3.0:1746066752.647708:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983094784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.647716:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.647725:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 33 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.647733:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 33 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.647746:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6421 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1012 expref: 33 pid: 20361 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.647756:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.647757:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.647764:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.647776:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.647807:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.647820:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984397952:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.647874:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.647905:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7011 00000100:00100000:3.0:1746066752.647910:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983094656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.647917:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.647925:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 32 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.647933:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 32 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.647943:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce1a00/0xf1867c21abfa647c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d105f expref: 32 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.647951:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.647964:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983094656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.647969:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7011 00000100:00100000:3.0:1746066752.647980:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7012 00000100:00100000:3.0:1746066752.647984:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983094912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.647990:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.647995:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 42 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.648004:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 42 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.648014:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096a59e00/0xf1867c21abfa6475 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1058 expref: 42 pid: 9592 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.648022:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.648023:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.648027:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.648034:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.648050:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.648058:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984398080:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.648083:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.649627:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984398080:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066752.649644:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066752.649672:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983094912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1686us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.649679:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7012 00000100:00100000:3.0:1746066752.649741:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984397952:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066752.649751:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.649764:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983094784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2055us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.649770:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7010 00000100:00100000:0.0:1746066752.656160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.656410:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983095168 00000100:00100000:2.0:1746066752.656420:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983095168 00002000:00100000:2.0:1746066752.656467:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1236992->1241087) req@ffff88012ce07100 x1830882983095168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.656477:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07100 with x1830882983095168 ext(1236992->1241087) 00002000:00010000:2.0:1746066752.656482:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce07100 00000100:00100000:2.0:1746066752.656516:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4090 00000100:00100000:2.0:1746066752.656524:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983095168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066752.656710:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983095168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 185us (561us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066752.656717:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4090 00002000:00100000:2.0:1746066752.656723:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1236992->1241087) req@ffff88012ce07100 x1830882983095168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.656730:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07100 with x1830882983095168 ext(1236992->1241087) 00002000:00010000:2.0:1746066752.656733:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce07100 00000100:00100000:1.0:1746066752.657727:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.658195:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983095424 00000100:00100000:3.0:1746066752.658200:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983095424 00002000:00100000:3.0:1746066752.658231:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3964928->3969023) req@ffff88012b54ed80 x1830882983095424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.658240:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ed80 with x1830882983095424 ext(3964928->3969023) 00002000:00010000:3.0:1746066752.658244:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54ed80 00000100:00100000:3.0:1746066752.658338:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4091 00000100:00100000:3.0:1746066752.658345:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983095424:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066752.658548:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983095424:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 202us (823us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066752.658562:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4091 00002000:00100000:3.0:1746066752.658566:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3964928->3969023) req@ffff88012b54ed80 x1830882983095424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.658573:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ed80 with x1830882983095424 ext(3964928->3969023) 00002000:00010000:3.0:1746066752.658576:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54ed80 00000100:00100000:0.0:1746066752.664443:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.664544:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983095680 00000100:00100000:3.0:1746066752.664563:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983095680 00002000:00100000:3.0:1746066752.664612:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1581056->1585151) req@ffff88012ce06a00 x1830882983095680/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.664623:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06a00 with x1830882983095680 ext(1581056->1585151) 00002000:00010000:3.0:1746066752.664629:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce06a00 00000100:00100000:3.0:1746066752.664762:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4092 00000100:00100000:3.0:1746066752.664771:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983095680:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066752.665281:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983095680:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 510us (849us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066752.665288:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4092 00002000:00100000:3.0:1746066752.665294:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1581056->1585151) req@ffff88012ce06a00 x1830882983095680/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.665300:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06a00 with x1830882983095680 ext(1581056->1585151) 00002000:00010000:3.0:1746066752.665303:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce06a00 00000100:00100000:0.0:1746066752.703949:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.703998:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.704044:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983095808 00000100:00100000:2.0:1746066752.704054:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983095808 00000100:00100000:2.0:1746066752.704098:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983095936 00000100:00100000:2.0:1746066752.704100:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983095936 00000100:00100000:2.0:1746066752.704125:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15625 00000100:00100000:2.0:1746066752.704133:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983095808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.704154:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.704173:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b46fa00/0xf1867c21abfa64bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d109e expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.704227:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984398208:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066752.704312:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.704479:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15626 00000100:00100000:1.0:1746066752.704488:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983095936:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066752.704496:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.704506:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10a5 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.704539:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984398336:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066752.704579:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.706795:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984398208:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066752.706795:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984398336:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066752.706829:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64c2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10a5 expref: 31 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.706839:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b46fa00/0xf1867c21abfa64bb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d109e expref: 14 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.706843:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10a5 expref: 31 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.706860:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b46fa00/0xf1867c21abfa64bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d109e expref: 14 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.706866:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22c00, rc 0) 00010000:00010000:2.0:1746066752.706904:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46fa00, rc 0) 00000100:00100000:1.0:1746066752.707353:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983095936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2519us (3007us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066752.707362:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15626 00000100:00100000:2.0:1746066752.707498:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983095808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2796us (2990us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.707504:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15625 00000100:00100000:0.0:1746066752.713624:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.713740:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983096192 00000100:00100000:3.0:1746066752.713750:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983096192 00002000:00100000:3.0:1746066752.714056:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012ce04700 x1830882983096192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 504/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.714067:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04700 with x1830882983096192 ext(1048576->2097151) 00002000:00010000:3.0:1746066752.714073:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce04700 00000100:00100000:3.0:1746066752.714107:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4093 00000100:00100000:3.0:1746066752.714115:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983096192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.721025:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983096192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6898us (7399us total) trans 0 rc 700416/700416 00000100:00100000:3.0:1746066752.721037:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4093 00002000:00100000:3.0:1746066752.721049:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012ce04700 x1830882983096192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 504/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.721064:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04700 with x1830882983096192 ext(1048576->2097151) 00002000:00010000:3.0:1746066752.721071:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce04700 00000100:00100000:2.0:1746066752.731339:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.731391:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.731423:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983096448 00000100:00100000:0.0:1746066752.731431:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983096448 00000100:00100000:1.0:1746066752.731447:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983096320 00000100:00100000:1.0:1746066752.731451:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983096320 00000100:00100000:0.0:1746066752.731474:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15627 00000100:00100000:0.0:1746066752.731480:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983096448:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066752.731489:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15628 00010000:00010000:0.0:1746066752.731493:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066752.731494:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983096320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066752.731502:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.731507:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8a00/0xf1867c21abfa64c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10b3 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.731511:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a22600/0xf1867c21abfa64d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10ac expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066752.731547:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984398592:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066752.731547:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984398464:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066752.731642:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.731738:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.733106:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984398464:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.733127:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8a00/0xf1867c21abfa64c9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10b3 expref: 31 pid: 13363 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066752.733127:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984398592:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.733137:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8a00/0xf1867c21abfa64c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10b3 expref: 31 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.733145:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136a22600/0xf1867c21abfa64d0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ac expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.733154:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a22600/0xf1867c21abfa64d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ac expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.733162:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8a00, rc 0) 00010000:00010000:1.0:1746066752.733167:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22600, rc 0) 00000100:00100000:2.0:1746066752.733187:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983096448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1706us (1859us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066752.733187:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983096320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1692us (1795us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.733193:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15627 00000100:00100000:1.0:1746066752.733200:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15628 00000100:00100000:0.0:1746066752.735761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.735815:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983096576 00000100:00100000:1.0:1746066752.735821:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983096576 00000100:00100000:1.0:1746066752.735861:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15629 00000100:00100000:1.0:1746066752.735868:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:486:x1830882983096576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066752.735880:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.735920:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10ba expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.735946:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.735953:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066752.735955:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066752.735958:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.735979:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 22 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.735990:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 22 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.736000:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984398720:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.736197:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.739125:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984398720:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066752.739126:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066752.739146:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.739157:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a23200, rc 0) 00000100:00100000:3.0:1746066752.739182:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983096704 00000100:00100000:3.0:1746066752.739187:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983096704 00000100:00100000:1.0:1746066752.739191:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:486:x1830882983096576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3324us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.739196:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15629 00002000:00100000:3.0:1746066752.739218:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4194303) req@ffff88012ce04a80 x1830882983096704/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.739227:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04a80 with x1830882983096704 ext(4030464->4194303) 00010000:00010000:3.0:1746066752.739232:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 23 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.739242:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 23 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066752.739248:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce04a80 00000100:00100000:3.0:1746066752.739268:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 901 00000100:00100000:3.0:1746066752.739274:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983096704:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066752.742397:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983096704:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3111us (3264us total) trans 21474841795 rc 0/0 00000100:00100000:3.0:1746066752.742407:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 901 00002000:00100000:3.0:1746066752.742417:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4194303) req@ffff88012ce04a80 x1830882983096704/t21474841795(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.742426:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce04a80 with x1830882983096704 ext(4030464->4194303) 00010000:00010000:3.0:1746066752.742435:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.742448:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066752.742453:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce04a80 00000100:00100000:0.0:1746066752.744860:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.745002:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983096832 00000100:00100000:3.0:1746066752.745010:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983096832 00010000:00010000:3.0:1746066752.745046:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:3.0:1746066752.745087:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7013 00000100:00100000:3.0:1746066752.745095:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983096832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.745109:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.745128:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.745139:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.745251:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa64a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1089 expref: 25 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.745284:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.745286:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.745294:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.745306:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.745340:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 13 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.745353:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984398848:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.746108:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.747449:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984398848:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066752.747466:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.747503:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983096832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2408us (2652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.747514:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7013 00000100:00100000:0.0:1746066752.752108:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.752578:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097088 00000100:00100000:3.0:1746066752.752589:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097088 00002000:00100000:3.0:1746066752.752644:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096425f80 x1830882983097088/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.752654:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096425f80 with x1830882983097088 ext(2097152->4194303) 00002000:00010000:3.0:1746066752.752660:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096425f80 00000100:00100000:3.0:1746066752.753318:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4094 00000100:00100000:3.0:1746066752.753328:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983097088:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.768398:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983097088:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15059us (16288us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066752.768413:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4094 00002000:00100000:3.0:1746066752.768425:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096425f80 x1830882983097088/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.768434:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096425f80 with x1830882983097088 ext(2097152->4194303) 00002000:00010000:3.0:1746066752.768440:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096425f80 00000100:00100000:0.0:1746066752.784010:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.784322:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097216 00000100:00100000:1.0:1746066752.784332:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097216 00000100:00100000:1.0:1746066752.784396:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15630 00000100:00100000:1.0:1746066752.784405:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:486:x1830882983097216:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066752.784425:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.784442:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10c1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.785153:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 40 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.785167:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066752.785169:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066752.785173:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.785207:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 40 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.785219:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 40 pid: 12233 timeout: 820 lvb_type: 0 00000100:00100000:1.0:1746066752.785232:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984398976:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.785331:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.787062:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984398976:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.787087:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 31 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.787101:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22c00, rc 0) 00000100:00100000:1.0:1746066752.787144:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:486:x1830882983097216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2740us (3146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.787152:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15630 00000100:00100000:0.0:1746066752.787801:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.787980:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097344 00000100:00100000:3.0:1746066752.787987:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097344 00002000:00100000:3.0:1746066752.788028:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3969023) req@ffff880096426d80 x1830882983097344/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.788038:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426d80 with x1830882983097344 ext(3145728->3969023) 00010000:00010000:3.0:1746066752.788044:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 41 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.788057:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 41 pid: 12233 timeout: 820 lvb_type: 0 00002000:00010000:3.0:1746066752.788063:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096426d80 00000100:00100000:3.0:1746066752.788609:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 902 00000100:00100000:3.0:1746066752.788618:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983097344:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066752.798627:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.798667:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.798703:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.798747:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097472 00000100:00100000:2.0:1746066752.798757:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097472 00000100:00100000:2.0:1746066752.798803:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097600 00000100:00100000:2.0:1746066752.798805:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097600 00000100:00100000:2.0:1746066752.798818:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097728 00000100:00100000:2.0:1746066752.798819:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097728 00000100:00100000:2.0:1746066752.798838:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15631 00000100:00100000:2.0:1746066752.798846:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882983097472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.798869:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066752.798898:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15632 00010000:00010000:2.0:1746066752.798904:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b46ea00/0xf1867c21abfa64e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10c8 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.798907:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983097600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066752.798915:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.798926:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10cf expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.798938:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.798941:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.798949:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066752.798964:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984399104:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066752.798966:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.798981:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418600, rc 0) 00000100:00100000:2.0:1746066752.799038:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.799056:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15633 00000100:00100000:2.0:1746066752.799061:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882983097728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.799067:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.799073:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b46ec00/0xf1867c21abfa64f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10d6 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.799092:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984399232:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066752.799570:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882983097600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 663us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.799573:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.799576:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15632 00000100:00100000:2.0:1746066752.800697:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984399104:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.800738:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b46ea00/0xf1867c21abfa64e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c8 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.800749:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b46ea00/0xf1867c21abfa64e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c8 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.800764:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46ea00, rc 0) 00000100:00100000:2.0:1746066752.800797:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882983097472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1952us (2181us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.800803:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15631 00000100:00100000:2.0:1746066752.801772:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984399232:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.801798:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b46ec00/0xf1867c21abfa64f3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10d6 expref: 46 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.801808:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b46ec00/0xf1867c21abfa64f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10d6 expref: 46 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.801815:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b46ec00, rc 0) 00000100:00100000:2.0:1746066752.802196:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882983097728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3133us (3490us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.802203:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15633 00000100:00100000:3.0:1746066752.804018:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882983097344:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 15395us (16211us total) trans 17179874352 rc 0/0 00000100:00100000:3.0:1746066752.804029:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 902 00002000:00100000:3.0:1746066752.804041:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3969023) req@ffff880096426d80 x1830882983097344/t17179874352(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.804054:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426d80 with x1830882983097344 ext(3145728->3969023) 00010000:00010000:3.0:1746066752.804064:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 43 pid: 12233 timeout: 820 lvb_type: 0 00010000:00010000:3.0:1746066752.804077:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 43 pid: 12233 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066752.804083:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096426d80 00000100:00100000:0.0:1746066752.809016:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.809374:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097856 00000100:00100000:2.0:1746066752.809384:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097856 00000100:00100000:2.0:1746066752.809433:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15634 00000100:00100000:2.0:1746066752.809441:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:491:x1830882983097856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.809461:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.809478:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10dd expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.809510:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.809517:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066752.809519:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066752.809522:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.809573:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 30 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.809584:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 30 pid: 13363 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066752.809596:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984399360:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066752.811278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.811322:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.811994:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983097984 00000100:00100000:3.0:1746066752.812003:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983097984 00010000:00010000:3.0:1746066752.812035:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 45 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066752.812073:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7014 00000100:00100000:3.0:1746066752.812080:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983097984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.812092:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.812110:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 45 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.812122:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 45 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.812147:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa64b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3969023) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1097 expref: 45 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.812169:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.812171:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.812178:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.812192:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.812222:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 30 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.812234:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984399488:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066752.812300:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.813059:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984399360:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.813104:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.813115:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096deb400, rc 0) 00000100:00100000:2.0:1746066752.813151:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:491:x1830882983097856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3711us (4147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.813159:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15634 00000100:00100000:1.0:1746066752.816312:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.816713:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984399488:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066752.816733:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066752.816785:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983097984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4703us (5510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.816795:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7014 00000100:00100000:3.0:1746066752.816853:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983098112 00000100:00100000:3.0:1746066752.816860:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983098112 00002000:00100000:3.0:1746066752.817101:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1236992->1585151) req@ffff88012b54d180 x1830882983098112/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.817110:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54d180 with x1830882983098112 ext(1236992->1585151) 00010000:00010000:3.0:1746066752.817118:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 31 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.817131:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 31 pid: 13363 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066752.817138:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b54d180 00000100:00100000:3.0:1746066752.817155:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 903 00000100:00100000:3.0:1746066752.817161:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983098112:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066752.820963:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.821620:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983098368 00000100:00100000:3.0:1746066752.821631:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983098368 00002000:00100000:3.0:1746066752.821677:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095cee300 x1830882983098368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.821688:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cee300 with x1830882983098368 ext(3145728->4194303) 00002000:00010000:3.0:1746066752.821694:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cee300 00000100:00100000:3.0:1746066752.821717:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4095 00000100:00100000:3.0:1746066752.821725:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983098368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066752.825940:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882983098112:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8765us (9624us total) trans 17179874353 rc 0/0 00000100:00100000:0.0:1746066752.825954:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 903 00002000:00100000:0.0:1746066752.825968:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1236992->1585151) req@ffff88012b54d180 x1830882983098112/t17179874353(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066752.825978:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54d180 with x1830882983098112 ext(1236992->1585151) 00010000:00010000:0.0:1746066752.825989:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 35 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066752.826006:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 35 pid: 13363 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746066752.826013:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b54d180 00000100:00100000:0.0:1746066752.831427:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.831880:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983098496 00000100:00100000:2.0:1746066752.831918:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983098496 00010000:00010000:2.0:1746066752.831959:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 35 pid: 13363 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066752.831992:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7015 00000100:00100000:2.0:1746066752.832000:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+35:2014:x1830882983098496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066752.832017:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066752.832035:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 35 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.832046:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 35 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.832070:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899000/0xf1867c21abfa64ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1585151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1090 expref: 35 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.832089:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.832091:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.832098:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 42 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.832104:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 42 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.832135:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 42 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.832146:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984399616:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066752.832231:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.833211:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983098368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11483us (12256us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066752.833220:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4095 00002000:00100000:3.0:1746066752.833230:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095cee300 x1830882983098368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.833240:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cee300 with x1830882983098368 ext(3145728->4194303) 00002000:00010000:3.0:1746066752.833244:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cee300 00000100:00100000:2.0:1746066752.837054:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.837147:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984399616:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066752.837190:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066752.837237:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983098496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5237us (5820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.837249:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7015 00000100:00100000:3.0:1746066752.839106:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983098752 00000100:00100000:3.0:1746066752.839116:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983098752 00002000:00100000:3.0:1746066752.839169:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095ce2a00 x1830882983098752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.839178:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2a00 with x1830882983098752 ext(1048576->2097151) 00002000:00010000:3.0:1746066752.839183:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce2a00 00000100:00100000:3.0:1746066752.839220:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4096 00000100:00100000:3.0:1746066752.839229:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983098752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066752.845497:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.845601:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983098880 00000100:00100000:2.0:1746066752.845611:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983098880 00000100:00100000:2.0:1746066752.845668:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15635 00000100:00100000:2.0:1746066752.845676:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983098880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.845698:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.845715:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10e4 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.845740:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.845742:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.845751:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.845765:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.845786:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0bc00, rc 0) 00000100:00100000:2.0:1746066752.845840:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2013:x1830882983098880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 164us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.845846:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15635 00000100:00100000:3.0:1746066752.848075:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983098752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8840us (11025us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066752.848085:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4096 00002000:00100000:3.0:1746066752.848095:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095ce2a00 x1830882983098752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.848103:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2a00 with x1830882983098752 ext(1048576->2097151) 00002000:00010000:3.0:1746066752.848108:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce2a00 00000100:00100000:0.0:1746066752.850730:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.850808:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983099136 00000100:00100000:3.0:1746066752.850818:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983099136 00002000:00100000:3.0:1746066752.850858:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095ceca80 x1830882983099136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.850867:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceca80 with x1830882983099136 ext(4194304->5033983) 00002000:00010000:3.0:1746066752.850871:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceca80 00000100:00100000:3.0:1746066752.850904:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4097 00000100:00100000:3.0:1746066752.850910:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983099136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.859280:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983099136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8356us (8546us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066752.859300:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4097 00002000:00100000:3.0:1746066752.859314:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095ceca80 x1830882983099136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.859323:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceca80 with x1830882983099136 ext(4194304->5033983) 00002000:00010000:3.0:1746066752.859329:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceca80 00000100:00100000:0.0:1746066752.861985:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.862471:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983099392 00000100:00100000:3.0:1746066752.862480:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983099392 00002000:00100000:3.0:1746066752.862526:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095cec700 x1830882983099392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.862535:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec700 with x1830882983099392 ext(2097152->4194303) 00002000:00010000:3.0:1746066752.862540:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cec700 00000100:00100000:3.0:1746066752.862572:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4098 00000100:00100000:3.0:1746066752.862580:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983099392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066752.880667:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983099392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18077us (18682us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066752.880679:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4098 00002000:00100000:3.0:1746066752.880689:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095cec700 x1830882983099392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.880698:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec700 with x1830882983099392 ext(2097152->4194303) 00002000:00010000:3.0:1746066752.880704:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cec700 00000100:00100000:0.0:1746066752.889943:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.890652:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983099520 00000100:00100000:2.0:1746066752.890663:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983099520 00000100:00100000:2.0:1746066752.890717:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15636 00000100:00100000:2.0:1746066752.890734:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:496:x1830882983099520:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.890757:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.890777:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10eb expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.890816:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.890825:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.890832:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.890833:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.890837:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3338240->3489791] (req 3338240->3489791) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.890872:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 24 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.890912:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 24 pid: 11630 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066752.890926:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984399744:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.891060:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.891069:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 15 pid: 20361 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066752.891077:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984399872:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.891099:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.891644:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.892260:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983099648 00000100:00100000:2.0:1746066752.892265:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983099648 00000100:00100000:2.0:1746066752.892318:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15637 00000100:00100000:2.0:1746066752.892326:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:491:x1830882983099648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.892339:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.892353:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10f2 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.892373:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.892375:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.892383:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.892398:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 44 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.892409:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd15c00, rc 0) 00000100:00100000:2.0:1746066752.892461:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:491:x1830882983099648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 135us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.892467:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15637 00000100:00100000:2.0:1746066752.896216:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984399744:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066752.897012:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.897056:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.897082:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983099776 00000100:00100000:0.0:1746066752.897088:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983099776 00010000:00010000:0.0:1746066752.897123:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 25 pid: 11630 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746066752.897162:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983099904 00000100:00100000:0.0:1746066752.897165:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983099904 00010000:00010000:0.0:1746066752.897174:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 16 pid: 20361 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066752.897190:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7016 00000100:00100000:0.0:1746066752.897197:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983099776:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.897209:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066752.897230:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 25 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066752.897239:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 25 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066752.897266:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa64ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10cf expref: 25 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066752.897284:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066752.897319:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882983099776:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.897325:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7016 00000100:00100000:0.0:1746066752.897339:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7017 00000100:00100000:0.0:1746066752.897343:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882983099904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066752.897348:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066752.897353:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 16 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066752.897360:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 16 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066752.897370:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.897371:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.897378:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.897385:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.897413:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.897427:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984400000:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066752.897479:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558600 going to sleep for 11 seconds 00010000:00010000:2.0:1746066752.897626:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a23200/0xf1867c21abfa64d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10ba expref: 16 pid: 20361 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066752.897643:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984399872:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066752.897690:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.897698:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0b600, rc 0) 00000100:00100000:2.0:1746066752.897717:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:496:x1830882983099520:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6993us (7843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.897723:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15636 00000100:00100000:0.0:1746066752.899387:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.899439:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983100160 00000100:00100000:3.0:1746066752.899446:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983100160 00000100:00100000:2.0:1746066752.899467:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984400000:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066752.899482:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746066752.899484:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095cefb80 x1830882983100160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.899493:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cefb80 with x1830882983100160 ext(3145728->4194303) 00002000:00010000:3.0:1746066752.899498:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cefb80 00000100:00100000:2.0:1746066752.899520:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983099904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2174us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.899523:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4099 00000100:00100000:2.0:1746066752.899527:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7017 00000100:00100000:3.0:1746066752.899529:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983100160:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066752.906034:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.906170:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983100416 00000100:00100000:1.0:1746066752.906180:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983100416 00002000:00100000:1.0:1746066752.906223:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3338240->3342335) req@ffff880095cef800 x1830882983100416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.906234:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef800 with x1830882983100416 ext(3338240->3342335) 00002000:00010000:1.0:1746066752.906240:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef800 00000100:00100000:1.0:1746066752.906265:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4100 00000100:00100000:1.0:1746066752.906272:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983100416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066752.906431:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983100416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 159us (406us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066752.906439:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4100 00002000:00100000:1.0:1746066752.906445:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (3338240->3342335) req@ffff880095cef800 x1830882983100416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.906452:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef800 with x1830882983100416 ext(3338240->3342335) 00002000:00010000:1.0:1746066752.906455:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef800 00000100:00100000:0.0:1746066752.907767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.908013:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983100544 00000100:00100000:2.0:1746066752.908022:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983100544 00000100:00100000:2.0:1746066752.908056:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15638 00000100:00100000:2.0:1746066752.908062:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:494:x1830882983100544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066752.908077:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.908092:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d10f9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.908116:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.908123:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066752.908124:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066752.908127:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2433024->2785279] (req 2433024->2785279) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.908151:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.908161:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 13 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066752.908170:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984400128:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.909267:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00000100:00100000:2.0:1746066752.909356:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983100160:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9824us (9973us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066752.909364:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4099 00002000:00100000:2.0:1746066752.909372:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095cefb80 x1830882983100160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.909381:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cefb80 with x1830882983100160 ext(3145728->4194303) 00002000:00010000:2.0:1746066752.909385:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cefb80 00000100:00100000:0.0:1746066752.913033:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.913637:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983100800 00000100:00100000:2.0:1746066752.913645:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983100800 00002000:00100000:2.0:1746066752.913681:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3485696->3489791) req@ffff880095cece00 x1830882983100800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.913690:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cece00 with x1830882983100800 ext(3485696->3489791) 00010000:00010000:2.0:1746066752.913698:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.913709:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746066752.913716:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cece00 00000100:00100000:2.0:1746066752.913746:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 904 00000100:00100000:2.0:1746066752.913753:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983100800:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066752.914307:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.914323:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983100928 00000100:00100000:0.0:1746066752.914326:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983100928 00000100:00100000:0.0:1746066752.914351:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15639 00000100:00100000:0.0:1746066752.914356:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983100928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066752.914365:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.914375:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa651d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1100 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066752.914409:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984400256:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066752.914462:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066752.914959:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984400128:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066752.915125:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983100800:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 1372us (2098us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066752.915131:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 904 00002000:00100000:2.0:1746066752.915136:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3485696->3489791) req@ffff880095cece00 x1830882983100800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.915143:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cece00 with x1830882983100800 ext(3485696->3489791) 00010000:00010000:2.0:1746066752.915148:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.915157:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746066752.915163:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095cece00 00010000:00010000:3.0:1746066752.915213:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2433024->2785279] (req 2433024->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.915223:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096debe00, rc 0) 00000100:00100000:3.0:1746066752.915251:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:494:x1830882983100544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7189us (7491us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.915257:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15638 00000100:00100000:2.0:1746066752.916496:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984400256:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066752.916516:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa651d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1100 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.916526:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d04200/0xf1867c21abfa651d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1100 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.916542:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04200, rc 0) 00000100:00100000:2.0:1746066752.917281:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983100928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2922us (2972us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.917288:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15639 00000100:00100000:2.0:1746066752.917388:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.917756:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983101184 00000100:00100000:3.0:1746066752.917762:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983101184 00002000:00100000:3.0:1746066752.917791:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3338240->3489791) req@ffff880095dd6300 x1830882983101184/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.917799:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6300 with x1830882983101184 ext(3338240->3489791) 00010000:00010000:3.0:1746066752.917806:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.917816:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066752.917822:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd6300 00000100:00100000:3.0:1746066752.918034:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 905 00000100:00100000:3.0:1746066752.918040:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983101184:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066752.920838:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.921227:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983101312 00000100:00100000:3.0:1746066752.921234:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983101312 00000100:00100000:3.0:1746066752.921266:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15640 00000100:00100000:3.0:1746066752.921273:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:491:x1830882983101312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066752.921290:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066752.921303:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1107 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.921328:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.921330:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066752.921333:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.921344:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066752.921353:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfc00, rc 0) 00000100:00100000:3.0:1746066752.921388:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:491:x1830882983101312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 116us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.921393:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15640 00000100:00100000:3.0:1746066752.922667:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983101184:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4623us (5275us total) trans 21474841796 rc 0/0 00000100:00100000:3.0:1746066752.922675:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 905 00002000:00100000:3.0:1746066752.922688:0:29520:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9a:0x0] (3338240->3489791) req@ffff880095dd6300 x1830882983101184/t21474841796(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:158/0 lens 488/448 e 0 to 0 dl 1746066763 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066752.922697:0:29520:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6300 with x1830882983101184 ext(3338240->3489791) 00010000:00010000:3.0:1746066752.922703:0:29520:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.922714:0:29520:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066752.922721:0:29520:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095dd6300 00000100:00100000:0.0:1746066752.927442:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.927619:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983101440 00000100:00100000:2.0:1746066752.927627:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983101440 00010000:00010000:2.0:1746066752.927659:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066752.927697:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7018 00000100:00100000:2.0:1746066752.927704:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983101440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066752.927716:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066752.927732:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.927744:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.927970:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b600/0xf1867c21abfa6508 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3338240->3489791) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10eb expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.927988:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.927989:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.927996:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.928003:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.928169:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.928171:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.928175:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.928181:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.928205:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.928215:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984400384:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066752.929238:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066752.929248:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984400512:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066752.929280:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.931876:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984400384:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066752.931915:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984400512:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066752.931947:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066752.931990:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983101440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4285us (4554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.932003:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7018 00000100:00100000:0.0:1746066752.933377:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.933420:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.933657:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983101696 00000100:00100000:1.0:1746066752.933663:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983101696 00002000:00100000:1.0:1746066752.933697:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->2437119) req@ffff880095cef480 x1830882983101696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.933706:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef480 with x1830882983101696 ext(2433024->2437119) 00002000:00010000:1.0:1746066752.933710:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef480 00000100:00100000:1.0:1746066752.933730:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983101952 00000100:00100000:1.0:1746066752.933732:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983101952 00002000:00100000:1.0:1746066752.933739:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095cef100 x1830882983101952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.933745:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef100 with x1830882983101952 ext(4194304->5033983) 00002000:00010000:1.0:1746066752.933748:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef100 00000100:00100000:1.0:1746066752.933757:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4101 00000100:00100000:1.0:1746066752.933762:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983101696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066752.933852:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983101696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 89us (480us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066752.933857:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4101 00002000:00100000:1.0:1746066752.933862:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->2437119) req@ffff880095cef480 x1830882983101696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.933868:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef480 with x1830882983101696 ext(2433024->2437119) 00002000:00010000:1.0:1746066752.933870:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef480 00000100:00100000:1.0:1746066752.933880:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4102 00000100:00100000:1.0:1746066752.933898:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983101952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066752.941362:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.942095:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983102208 00000100:00100000:2.0:1746066752.942101:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983102208 00002000:00100000:2.0:1746066752.942132:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2781184->2785279) req@ffff88012ce05880 x1830882983102208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/0 e 0 to 0 dl 1746066763 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066752.942140:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce05880 with x1830882983102208 ext(2781184->2785279) 00002000:00010000:2.0:1746066752.942145:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce05880 00000100:00100000:1.0:1746066752.942675:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983101952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8788us (9252us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066752.942684:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4102 00002000:00100000:1.0:1746066752.942691:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095cef100 x1830882983101952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/440 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.942698:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef100 with x1830882983101952 ext(4194304->5033983) 00002000:00010000:1.0:1746066752.942701:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef100 00000100:00100000:1.0:1746066752.942719:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4103 00000100:00100000:1.0:1746066752.942727:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983102208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066752.943590:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983102208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 862us (2233us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066752.943597:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4103 00002000:00100000:1.0:1746066752.943602:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2781184->2785279) req@ffff88012ce05880 x1830882983102208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:158/0 lens 488/4536 e 0 to 0 dl 1746066763 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066752.943608:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce05880 with x1830882983102208 ext(2781184->2785279) 00002000:00010000:1.0:1746066752.943612:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ce05880 00000100:00100000:0.0:1746066752.951334:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.951558:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983102336 00000100:00100000:2.0:1746066752.951566:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983102336 00000100:00100000:2.0:1746066752.951745:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15641 00000100:00100000:2.0:1746066752.951753:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983102336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.952075:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.952089:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa652b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d110e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.952117:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa652b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d110e expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.952126:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa652b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d110e expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.952146:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70400, rc 0) 00000100:00100000:2.0:1746066752.952853:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983102336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1099us (1524us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.952858:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15641 00000100:00100000:0.0:1746066752.957026:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.957153:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983102464 00000100:00100000:2.0:1746066752.957162:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983102464 00000100:00100000:2.0:1746066752.957215:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15642 00000100:00100000:2.0:1746066752.957222:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983102464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066752.957241:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.957255:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfa6532 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1115 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.957287:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfa6532 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1115 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.957297:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70600/0xf1867c21abfa6532 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1115 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.957316:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70600, rc 0) 00000100:00100000:2.0:1746066752.957368:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983102464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 146us (353us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066752.957374:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15642 00000100:00100000:0.0:1746066752.977036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.977138:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983102592 00000100:00100000:1.0:1746066752.977149:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983102592 00000100:00100000:1.0:1746066752.977561:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16222 00000100:00100000:1.0:1746066752.977570:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:500:x1830882983102592:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066752.977595:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.977612:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa6539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d111c expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.977672:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977684:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977695:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977707:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977712:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977717:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977787:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977798:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.977804:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 47 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.977810:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.977840:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 47 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.977851:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 47 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066752.977864:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984400640:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.977996:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.978004:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066752.978012:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984400768:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.978030:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066752.980128:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.980171:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.980188:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983102848 00000100:00100000:2.0:1746066752.980196:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983102848 00000100:00100000:0.0:1746066752.980203:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983103104 00000100:00100000:0.0:1746066752.980205:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983103104 00000100:00100000:2.0:1746066752.980288:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5900 00000100:00100000:2.0:1746066752.980296:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:30847:x1830882983102848:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066752.980362:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984400640:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.980370:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984400768:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.980394:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066752.980484:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:30847:x1830882983102848:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 188us (362us total) trans 8589936532 rc 0/0 00000100:00100000:2.0:1746066752.980490:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5900 00000100:00100000:3.0:1746066752.980789:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5901 00000100:00100000:3.0:1746066752.980797:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+48:16320:x1830882983103104:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066752.980919:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:16320:x1830882983103104:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 122us (747us total) trans 8589936533 rc 0/0 00000100:00100000:3.0:1746066752.980925:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5901 00000100:00100000:0.0:1746066752.982224:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066752.982524:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.982557:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983103232 00000100:00100000:2.0:1746066752.982563:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983103232 00010000:00010000:2.0:1746066752.982591:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 32 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066752.982624:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983103360 00000100:00100000:2.0:1746066752.982627:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983103360 00010000:00010000:2.0:1746066752.982638:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 49 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066752.982652:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7019 00000100:00100000:3.0:1746066752.982660:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983103232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066752.982664:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7020 00000100:00100000:2.0:1746066752.982669:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882983103360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.982670:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.982676:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 32 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.982677:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066752.982680:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 49 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.982685:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 32 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.982693:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 49 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.982713:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895000/0xf1867c21abfa63f7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0fef expref: 32 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066752.982718:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009575be00/0xf1867c21abfa6460 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d104a expref: 49 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.982728:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066752.982732:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.982741:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.982749:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066752.982757:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066752.982760:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066752.982798:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983103360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 128us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.982804:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7020 00010000:00010000:1.0:1746066752.983088:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983096:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.983108:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066752.983129:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983103232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 470us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.983135:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7019 00000004:00200000:1.0:1746066752.983141:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066752.983145:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066752.983160:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983170:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983180:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983186:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983192:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983198:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983204:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb8000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066752.983207:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983213:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983223:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066752.983226:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066752.983229:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983234:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8000/0xf1867c21abfa6540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983260:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983266:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983270:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983275:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb9200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066752.983277:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983282:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983289:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9e00) 00010000:00010000:1.0:1746066752.983291:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066752.983294:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983298:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.983628:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9e00/0xf1867c21abfa6539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.983647:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 22 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.983653:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066752.983655:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066752.983658:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8800, rc 0) 00000100:00100000:1.0:1746066752.984161:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:500:x1830882983102592:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6590us (7135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.984167:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16222 00000100:00100000:2.0:1746066752.986820:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.986863:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.986906:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.986943:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.986964:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983103488 00000100:00100000:2.0:1746066752.986971:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983103488 00000100:00100000:2.0:1746066752.987007:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983103616 00000100:00100000:2.0:1746066752.987010:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983103616 00000100:00100000:2.0:1746066752.987020:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983103872 00000100:00100000:2.0:1746066752.987021:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983103872 00000100:00100000:2.0:1746066752.987037:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983103744 00000100:00100000:2.0:1746066752.987039:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983103744 00000100:00100000:2.0:1746066752.987055:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15643 00000100:00100000:1.0:1746066752.987067:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15644 00000100:00100000:1.0:1746066752.987073:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983103616:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:0.0:1746066752.987077:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15645 00000100:00100000:0.0:1746066752.987086:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983103872:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066752.987093:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066752.987094:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.987109:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d112a expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066752.987110:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1138 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066752.987112:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15646 00000100:00100000:3.0:1746066752.987118:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983103744:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066752.987125:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.987130:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.987130:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066752.987132:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066752.987132:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066752.987134:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece800/0xf1867c21abfa6563 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1131 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.987139:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.987139:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 19 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.987149:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece800/0xf1867c21abfa6563 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1131 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.987152:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066752.987158:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece800/0xf1867c21abfa6563 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1131 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066752.987160:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cf7800, rc 0) 00010000:00010000:3.0:1746066752.987165:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece800, rc 0) 00000100:00100000:1.0:1746066752.987200:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983103616:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 128us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066752.987209:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15644 00010000:00010000:0.0:1746066752.987534:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066752.987557:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04200, rc 0) 00000100:00100000:3.0:1746066752.987560:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983103744:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 441us (615us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066752.987566:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15646 00000100:00100000:0.0:1746066752.987578:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983103872:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 494us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066752.987584:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15645 00000100:00100000:2.0:1746066752.987636:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983103488:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066752.987645:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.987653:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1123 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.987663:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.987664:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066752.987669:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.987677:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 18 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.987683:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71600, rc 0) 00000100:00100000:2.0:1746066752.987698:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983103488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 638us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066752.987703:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15643 00000100:00100000:0.0:1746066752.989916:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066752.990001:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983104128 00000100:00100000:1.0:1746066752.990009:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983104128 00000100:00100000:1.0:1746066752.990060:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16223 00000100:00100000:1.0:1746066752.990068:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:500:x1830882983104128:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066752.990086:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066752.990102:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa6571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d113f expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.990205:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.990224:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.990232:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.990262:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.990274:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 23 pid: 7244 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066752.990286:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984400896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066752.990410:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066752.994159:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984400896:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066752.994186:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066752.994571:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066752.994658:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983104256 00000100:00100000:3.0:1746066752.994665:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983104256 00010000:00010000:3.0:1746066752.994701:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 24 pid: 7244 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066752.994741:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7021 00000100:00100000:3.0:1746066752.994749:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+24:2015:x1830882983104256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066752.994763:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066752.994769:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 24 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.994778:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 24 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.994801:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8800/0xf1867c21abfa654e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d111c expref: 24 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066752.994817:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066752.994821:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.994830:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.994837:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066752.994863:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066752.994908:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066752.994914:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066752.994924:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2015:x1830882983104256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 175us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066752.994929:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7021 00000004:00200000:1.0:1746066752.994933:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066752.995062:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8a00/0xf1867c21abfa6571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d113f expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.995076:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d113f expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066752.995081:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066752.995084:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066752.995086:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb8200, rc 0) 00000100:00100000:1.0:1746066752.995113:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:500:x1830882983104128:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5045us (5239us total) trans 8589936534 rc 0/0 00000100:00100000:1.0:1746066752.995119:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16223 00000100:00100000:0.0:1746066752.999571:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066752.999638:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983104384 00000100:00100000:2.0:1746066752.999648:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983104384 00000100:00100000:2.0:1746066752.999709:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15647 00000100:00100000:2.0:1746066752.999717:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983104384:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066752.999735:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066752.999752:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa6586 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1146 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066752.999791:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa6586 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1146 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066752.999801:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa6586 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1146 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.000142:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71400, rc 0) 00000100:00100000:2.0:1746066753.000196:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983104384:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 480us (636us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.000202:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15647 00000100:00100000:0.0:1746066753.005045:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.005107:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983104640 00000100:00100000:1.0:1746066753.005117:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983104640 00000100:00100000:1.0:1746066753.005164:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16224 00000100:00100000:1.0:1746066753.005170:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:500:x1830882983104640:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066753.005194:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.005197:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066753.005220:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb8200/0xf1867c21abfa6578 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d113f expref: 23 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.005247:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.005255:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.005266:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa658d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d114d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.005446:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6594 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.005459:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6594 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.005466:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6594 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066753.005477:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.005572:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9a00/0xf1867c21abfa658d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d114d expref: 25 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.005585:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6594 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d114d expref: 24 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.005591:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.005593:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066753.005595:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9200, rc 0) 00000100:00100000:1.0:1746066753.005652:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+24:500:x1830882983104640:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 481us (616us total) trans 8589936535 rc 0/0 00000100:00100000:1.0:1746066753.005658:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16224 00000100:00100000:0.0:1746066753.010088:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.010118:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.010138:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.010159:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983104768 00000100:00100000:0.0:1746066753.010159:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105024 00000100:00100000:1.0:1746066753.010164:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105280 00000100:00100000:2.0:1746066753.010166:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983104768 00000100:00100000:0.0:1746066753.010166:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105024 00000100:00100000:1.0:1746066753.010168:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105280 00000100:00100000:0.0:1746066753.010202:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15648 00000100:00100000:0.0:1746066753.010209:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882983105024:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:2.0:1746066753.010215:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15649 00000100:00100000:2.0:1746066753.010219:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882983104768:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066753.010251:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.010251:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15650 00010000:00010000:0.0:1746066753.010251:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.010257:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882983105280:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066753.010270:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.010270:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010273:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010278:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.010278:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 18 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.010284:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010285:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.010285:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010291:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.010292:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.010293:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.010294:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.010295:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.010296:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010297:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010297:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066753.010299:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066753.010301:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010322:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.010323:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.010323:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010333:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 14 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066753.010333:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 32 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.010334:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 25 pid: 11630 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.010346:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984401280:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.010346:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984401024:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.010346:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984401152:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.010415:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.010463:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983104896 00000100:00100000:1.0:1746066753.010466:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983104896 00000100:00100000:0.0:1746066753.010468:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.010485:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105152 00000100:00100000:1.0:1746066753.010488:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105152 00000100:00100000:1.0:1746066753.010500:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15651 00000100:00100000:1.0:1746066753.010506:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983104896:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:0.0:1746066753.010517:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.010521:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010530:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 43 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010536:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.010542:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.010559:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.010560:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.010562:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.010574:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105408 00010000:00010000:1.0:1746066753.010578:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066753.010579:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105408 00010000:00010000:1.0:1746066753.010585:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 32 pid: 9590 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746066753.010593:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984401408:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.010600:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15652 00000100:00100000:3.0:1746066753.010605:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882983105152:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066753.010614:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 13 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.010622:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 13 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746066753.010624:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.010631:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984401536:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.010641:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.010655:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 20 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.010657:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.010663:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984401664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.010664:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 25 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.010674:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984401792:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.010691:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde480 going to sleep for 11 seconds 00010000:00010000:1.0:1746066753.010691:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 43 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010699:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 43 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.010707:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984401920:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.010721:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15653 00000100:00100000:2.0:1746066753.010726:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2014:x1830882983105408:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:1.0:1746066753.010726:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363540 going to sleep for 11 seconds 00010000:00010000:2.0:1746066753.010740:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010751:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 43 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010753:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010757:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.010761:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.010764:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 20 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066753.010769:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984402048:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.010770:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010776:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 32 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010781:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066753.010783:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066753.010785:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.010788:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363e40 going to sleep for 11 seconds 00010000:00010000:2.0:1746066753.010800:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 32 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010808:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 32 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.010815:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402176:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.010836:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010838:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.010843:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.010844:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 20 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.010846:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 43 pid: 9592 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.010850:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.010852:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 20 pid: 9592 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.010853:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402304:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.010856:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.010857:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.010859:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.010859:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984402432:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.010870:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 20 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.010877:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 20 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.010906:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.010927:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010937:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 32 pid: 20361 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.010944:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.010960:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 43 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.010967:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 43 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.010974:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402816:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.010989:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00010000:00010000:3.0:1746066753.011124:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.011133:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 14 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.011142:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984402944:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.011175:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 13 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.011188:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 13 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.011196:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984403072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.011219:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 25 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.011226:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 25 pid: 9592 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.011234:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984403200:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.011247:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00010000:00010000:0.0:1746066753.011845:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 43 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.011858:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 43 pid: 20361 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.011867:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984403328:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.011909:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.012225:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984401280:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.012225:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984401152:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.013589:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984401024:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.014926:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984401536:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.015015:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984401408:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.015029:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984401664:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.018570:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.018598:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.018610:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984401792:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.018648:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066753.018665:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.018670:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105664 00000100:00100000:0.0:1746066753.018675:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105664 00000100:00100000:3.0:1746066753.018682:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106048 00000100:00100000:3.0:1746066753.018685:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106048 00010000:00010000:3.0:1746066753.018719:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 21 pid: 12255 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.018746:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105536 00000100:00100000:3.0:1746066753.018749:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105536 00010000:00010000:3.0:1746066753.018761:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 26 pid: 11630 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.018776:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7022 00000100:00100000:3.0:1746066753.018784:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2013:x1830882983106048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.018796:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.018816:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 21 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746066753.018825:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 21 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746066753.018848:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71600/0xf1867c21abfa656a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1123 expref: 21 pid: 12255 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746066753.018863:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7023 00010000:00010000:3.0:1746066753.018867:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.018871:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e209050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983105536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.018880:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.018918:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 26 pid: 11630 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.018927:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 26 pid: 11630 timeout: 821 lvb_type: 0 00000100:00080000:2.0:1746066753.018931:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066753.018934:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882983106048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 150us (334us total) trans 0 rc 0/0 00000100:00080000:2.0:1746066753.018938:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746066753.018939:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa6524 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1107 expref: 26 pid: 11630 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.018941:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7022 00010000:00010000:1.0:1746066753.018954:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.018972:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e209050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983105536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.018978:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7023 00000100:00100000:2.0:1746066753.019036:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.019099:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.019112:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105920 00000100:00100000:2.0:1746066753.019118:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105920 00010000:00010000:2.0:1746066753.019148:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 14 pid: 11630 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.019222:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983105792 00000100:00100000:3.0:1746066753.019226:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983105792 00010000:00010000:3.0:1746066753.019236:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 34 pid: 9590 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.019458:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7024 00000100:00100000:2.0:1746066753.019467:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983105920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.019487:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.019505:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 14 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.019515:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 14 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.019534:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f67e00/0xf1867c21abfa6380 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f94 expref: 14 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.019567:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.019596:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983105920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 131us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.019603:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7024 00000100:00100000:1.0:1746066753.019611:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984401920:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.019633:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.019650:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.019662:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106176 00000100:00100000:2.0:1746066753.019664:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106176 00010000:00010000:2.0:1746066753.019675:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 25 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.019693:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7025 00000100:00100000:3.0:1746066753.019699:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882983105792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066753.019704:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7026 00010000:00010000:3.0:1746066753.019708:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066753.019709:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983106176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.019715:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.019716:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 34 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.019722:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 25 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.019725:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 34 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.019731:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 25 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.019737:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa6501 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10e4 expref: 34 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.019742:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fae000/0xf1867c21abfa62ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f01 expref: 25 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.019748:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066753.019751:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.019765:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983105792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.019770:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882983106176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.019772:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7025 00000100:00100000:2.0:1746066753.019777:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7026 00010000:00010000:0.0:1746066753.019966:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 32 pid: 20361 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.019985:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7027 00000100:00100000:0.0:1746066753.019992:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983105664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.019998:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066753.020008:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 32 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.020016:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 32 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.020028:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa642f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1020 expref: 32 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.020045:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.020083:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402176:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.020207:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984402048:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.020232:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.020297:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983105664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 305us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.020303:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7027 00000100:00100000:2.0:1746066753.020351:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.020405:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.020419:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.020422:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106304 00000100:00100000:1.0:1746066753.020428:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106304 00000100:00100000:1.0:1746066753.020437:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106432 00000100:00100000:1.0:1746066753.020439:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106432 00000100:00080000:2.0:1746066753.020460:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746066753.020467:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 15 pid: 11630 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.020484:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402304:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.020484:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106560 00000100:00100000:1.0:1746066753.020486:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106560 00000100:00100000:2.0:1746066753.020489:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.020494:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402560:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.020496:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 31 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.020498:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106688 00000100:00100000:2.0:1746066753.020501:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106688 00000100:00100000:3.0:1746066753.020502:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.020509:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7028 00000100:00100000:1.0:1746066753.020514:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882983106432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066753.020517:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7029 00010000:00010000:2.0:1746066753.020517:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 44 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.020521:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066753.020523:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882983106560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.020529:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 15 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746066753.020532:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066753.020535:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7030 00010000:00010000:1.0:1746066753.020537:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 15 pid: 11630 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.020540:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983106688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.020541:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 31 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.020557:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.020559:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 31 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.020562:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fafe00/0xf1867c21abfa631e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f47 expref: 15 pid: 11630 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.020567:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 44 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.020570:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096a59c00/0xf1867c21abfa646e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1051 expref: 31 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.020571:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.020572:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.020575:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.020576:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 44 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.020579:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.020582:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.020592:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa64fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10dd expref: 44 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.020597:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983106560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (177us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066753.020599:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.020600:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066753.020601:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066753.020602:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7029 00010000:00010000:2.0:1746066753.020603:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.020609:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.020618:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983106432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.020624:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7028 00010000:00010000:2.0:1746066753.020638:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.020641:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.020648:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.020653:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983106688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.020659:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7030 00010000:00010000:1.0:1746066753.020662:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.020669:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746066753.020670:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746066753.020675:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.020681:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a2000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066753.020684:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.020688:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.020690:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.020704:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.020709:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a2000/0xf1867c21abfa65b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.020726:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106816 00000100:00100000:3.0:1746066753.020730:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106816 00010000:00010000:3.0:1746066753.020740:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 20 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.020742:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.020749:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2014:x1830882983104896:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 10242us (10332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.020753:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983106944 00000100:00100000:3.0:1746066753.020754:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983106944 00000100:00100000:1.0:1746066753.020756:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15651 00000100:00100000:2.0:1746066753.020757:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7031 00010000:00010000:3.0:1746066753.020762:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 43 pid: 9592 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.020764:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882983106816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.020771:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066753.020772:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7032 00000100:00100000:3.0:1746066753.020776:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983106944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.020779:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 19 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746066753.020782:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.020788:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 19 pid: 3528 timeout: 821 lvb_type: 1 00002000:00100000:1.0:1746066753.020789:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->2785279) req@ffff8800958ad880 x1830882983106304/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.020797:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882983106304 ext(2433024->2785279) 00010000:00010000:3.0:1746066753.020801:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 43 pid: 9592 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.020801:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 24 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.020805:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d04200/0xf1867c21abfa6555 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1138 expref: 19 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746066753.020808:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 24 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.020809:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 43 pid: 9592 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746066753.020813:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958ad880 00010000:00010000:2.0:1746066753.020816:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066753.020821:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd15c00/0xf1867c21abfa650f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f2 expref: 43 pid: 9592 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.020826:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 906 00010000:00010000:3.0:1746066753.020828:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.020829:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2013:x1830882983106816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.020832:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882983106304:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066753.020835:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7031 00000100:00100000:3.0:1746066753.020842:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882983106944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.020847:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7032 00000100:00100000:3.0:1746066753.020909:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984402816:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.020934:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.021409:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.021414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.021417:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.021429:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.021434:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.021435:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107072 00000100:00100000:0.0:1746066753.021439:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107072 00010000:00010000:1.0:1746066753.021441:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.021445:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d71400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066753.021448:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.021452:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 42 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.021453:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.021462:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.021472:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa65a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.021478:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7033 00000100:00100000:0.0:1746066753.021484:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983107072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.021491:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066753.021496:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984402944:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066753.021497:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 42 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.021506:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 42 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.021518:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7c600/0xf1867c21abfa6309 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0f32 expref: 42 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.021527:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.021603:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984403072:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.021608:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882983104768:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11386us (11527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.021613:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984403200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.021614:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15649 00010000:00010000:3.0:1746066753.021631:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.021673:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984402432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.021721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.021731:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107200 00000100:00100000:2.0:1746066753.021734:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107200 00010000:00010000:2.0:1746066753.021746:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.021760:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7034 00000100:00100000:2.0:1746066753.021766:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983107200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.021773:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.021781:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.021789:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.021799:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894600/0xf1867c21abfa621b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e7c expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.021809:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.021823:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983107200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.021829:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7034 00000100:00100000:2.0:1746066753.021851:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.021861:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107584 00000100:00100000:0.0:1746066753.021861:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882983107072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 376us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.021863:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107584 00000100:00100000:0.0:1746066753.021867:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7033 00010000:00010000:2.0:1746066753.021871:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 26 pid: 9592 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.021903:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7035 00000100:00100000:0.0:1746066753.021910:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983107584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.021918:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066753.021928:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 26 pid: 9592 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.021936:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 26 pid: 9592 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.021949:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44a00/0xf1867c21abfa613b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0de9 expref: 26 pid: 9592 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.021957:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f766680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984403328:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066753.021957:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.021973:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983107584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 64us (121us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066753.021979:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.022318:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7035 00000100:00100000:2.0:1746066753.022358:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.022369:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107712 00000100:00100000:2.0:1746066753.022372:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107712 00010000:00010000:2.0:1746066753.022383:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 14 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.022396:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7036 00000100:00100000:2.0:1746066753.022400:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983107712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.022407:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.022414:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 14 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.022421:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 14 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.022432:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984bba00/0xf1867c21abfa61a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e21 expref: 14 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.022441:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.022442:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.022445:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.022451:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.022476:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.022488:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983107712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.022493:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7036 00000100:00100000:2.0:1746066753.022516:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.022524:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107456 00000100:00100000:2.0:1746066753.022527:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107456 00010000:00010000:2.0:1746066753.022536:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 18 pid: 9592 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.022562:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7037 00000100:00100000:2.0:1746066753.022567:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2013:x1830882983107456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.022572:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.022579:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 18 pid: 9592 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.022586:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 18 pid: 9592 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.022600:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa655c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d112a expref: 18 pid: 9592 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.022609:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.022619:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882983107456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.022624:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7037 00000100:00100000:2.0:1746066753.022653:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.022936:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107328 00000100:00100000:1.0:1746066753.022940:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107328 00010000:00010000:1.0:1746066753.022953:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 30 pid: 20361 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.022974:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.022976:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7038 00000100:00100000:1.0:1746066753.022981:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983107328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066753.022986:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107840 00010000:00010000:1.0:1746066753.022987:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066753.022989:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107840 00010000:00010000:1.0:1746066753.022996:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 30 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.023001:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 41 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.023004:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 30 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.023015:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa64de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10c1 expref: 30 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.023023:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.023025:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.023027:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023034:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023048:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.023068:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882983107328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.023074:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7038 00000100:00100000:1.0:1746066753.023100:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7039 00000100:00100000:1.0:1746066753.023105:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983107840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.023111:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.023117:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 41 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.023125:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 41 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.023136:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e429c00/0xf1867c21abfa6428 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1019 expref: 41 pid: 20361 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.023143:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.023145:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.023147:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023153:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.023157:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023165:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066753.023166:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.023181:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882983107840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.023186:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7039 00010000:00010000:0.0:1746066753.023186:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.023193:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.023205:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.023212:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6bca00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066753.023215:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.023223:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.023234:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.023239:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa65c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.023284:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882983105408:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12556us (12766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.023291:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15653 00010000:00010000:1.0:1746066753.023335:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023340:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023343:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023348:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023354:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023360:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023362:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023366:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023368:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023371:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d04400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066753.023373:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023374:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023379:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ecfe00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066753.023379:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023382:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023387:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023388:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.023392:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d04400/0xf1867c21abfa65a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023398:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.023404:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa65be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.023427:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882983105024:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 13218us (13307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.023433:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15648 00000100:00100000:3.0:1746066753.023444:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882983105152:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 12837us (12975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.023450:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15652 00000100:00100000:1.0:1746066753.026017:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882983106304:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5179us (5606us total) trans 21474841797 rc 0/0 00000100:00100000:1.0:1746066753.026026:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 906 00002000:00100000:1.0:1746066753.026033:0:20357:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9a:0x0] (2433024->2785279) req@ffff8800958ad880 x1830882983106304/t21474841797(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/448 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.026039:0:20357:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958ad880 with x1830882983106304 ext(2433024->2785279) 00010000:00010000:1.0:1746066753.026046:0:20357:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.026055:0:20357:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746066753.026060:0:20357:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958ad880 00000100:00100000:0.0:1746066753.027416:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.027478:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983107968 00000100:00100000:3.0:1746066753.027487:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983107968 00010000:00010000:3.0:1746066753.027519:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.027565:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7040 00000100:00100000:3.0:1746066753.027573:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882983107968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.027586:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.027603:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.027614:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.027636:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096debe00/0xf1867c21abfa6516 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2433024->2785279) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d10f9 expref: 25 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.027651:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.027653:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.027657:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.027664:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.027698:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.027815:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.027826:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.027843:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.027850:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.027858:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.027868:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb8200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066753.027872:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.027879:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.027908:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983107968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 335us (497us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066753.027913:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.027915:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7040 00010000:00010000:1.0:1746066753.027918:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb8200/0xf1867c21abfa65b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.027966:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983105280:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 17709us (17826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.027973:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15650 00000100:00100000:0.0:1746066753.030020:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.030081:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983108224 00000100:00100000:1.0:1746066753.030089:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983108224 00000100:00100000:1.0:1746066753.030142:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16225 00000100:00100000:1.0:1746066753.030149:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+24:500:x1830882983108224:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066753.030198:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746066753.030222:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094541a00/0xf1867c21abfa616c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e0c expref: 24 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030242:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5400/0xf1867c21abfa6188 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0e13 expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030258:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.030262:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.030289:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.030301:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 47 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030309:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030315:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 47 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030319:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030325:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030331:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 47 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030337:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 9/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.030367:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 47 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030382:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 47 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.030396:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403456:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.030491:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030499:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 30 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.030507:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403584:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.030530:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 30 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030537:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 30 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.030559:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403712:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.030584:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 47 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030591:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 47 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.030598:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403840:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.030624:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030630:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.030637:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403968:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.030658:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 47 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.030665:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 47 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.030671:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984404096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.030765:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.032502:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.032625:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403456:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.032633:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403584:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.032639:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403712:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.032644:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403840:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.032650:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984403968:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.032655:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984404096:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.032682:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066753.033107:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.033139:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.033153:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.033166:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.033189:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.033255:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983108480 00000100:00100000:3.0:1746066753.033262:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983108480 00000100:00100000:3.0:1746066753.033300:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983108736 00000100:00100000:3.0:1746066753.033302:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983108736 00000100:00100000:1.0:1746066753.033313:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983108864 00000100:00100000:1.0:1746066753.033317:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983108864 00000100:00100000:3.0:1746066753.033319:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5902 00000100:00100000:3.0:1746066753.033326:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:16320:x1830882983108480:12345-192.168.204.16@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746066753.033338:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 32 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.033355:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983109120 00000100:00100000:1.0:1746066753.033357:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983109120 00010000:00010000:1.0:1746066753.033366:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 49 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.033376:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983108992 00000100:00100000:1.0:1746066753.033378:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983108992 00010000:00010000:1.0:1746066753.033385:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 50 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.033392:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983109248 00000100:00100000:1.0:1746066753.033393:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983109248 00010000:00010000:1.0:1746066753.033400:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 33 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.033408:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7041 00000100:00100000:1.0:1746066753.033413:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983108864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.033421:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.033427:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 33 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033436:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 34 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033454:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa5c17 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a70 expref: 34 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033469:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.033473:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.033480:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.033537:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5903 00000100:00100000:1.0:1746066753.033540:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983108864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 126us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.033553:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:30847:x1830882983108736:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066753.033562:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7041 00000100:00100000:1.0:1746066753.033577:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7042 00000100:00100000:1.0:1746066753.033581:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2015:x1830882983109120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.033588:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.033592:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 50 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033600:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 51 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033610:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098be3400/0xf1867c21abfa5cf0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b0a expref: 51 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033619:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000100:00100000:2.0:1746066753.033621:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:30847:x1830882983108736:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 78us (515us total) trans 8589936537 rc 0/0 00010000:00010000:1.0:1746066753.033622:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.033626:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.033627:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5903 00000100:00100000:1.0:1746066753.033640:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882983109120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.033647:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7042 00000100:00100000:1.0:1746066753.033655:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7043 00000100:00100000:1.0:1746066753.033659:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983108992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.033665:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.033668:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 48 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033675:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 48 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033683:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009326c400/0xf1867c21abfa5c02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0a54 expref: 48 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.033690:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000100:00100000:0.0:1746066753.033691:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7044 00010000:00010000:1.0:1746066753.033693:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.033697:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.033697:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983109248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.033704:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066753.033708:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983108992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 48us (541us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066753.033709:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 32 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.033712:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7043 00010000:00010000:0.0:1746066753.033717:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 32 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.033728:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa5e0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0ba4 expref: 32 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.033737:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066753.033740:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066753.033751:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.033765:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983109248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.033770:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7044 00000100:00100000:3.0:1746066753.034201:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:16320:x1830882983108480:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 875us (1704us total) trans 8589936536 rc 0/0 00000100:00100000:3.0:1746066753.034207:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5902 00000100:00100000:0.0:1746066753.037770:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.037817:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.037880:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983109376 00000100:00100000:2.0:1746066753.037909:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983109376 00010000:00010000:2.0:1746066753.037944:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 30 pid: 7243 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.037970:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983109504 00000100:00100000:2.0:1746066753.037971:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983109504 00010000:00010000:2.0:1746066753.037983:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 47 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.038009:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7045 00000100:00100000:2.0:1746066753.038016:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983109376:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.038030:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.038036:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 30 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.038045:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 30 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.038067:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa5d3d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b26 expref: 30 pid: 7243 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.038081:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.038086:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.038093:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.038132:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983109376:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 116us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.038138:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7045 00000100:00100000:2.0:1746066753.038184:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7046 00000100:00100000:2.0:1746066753.038188:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983109504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.038194:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.038198:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 47 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.038733:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 47 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.038756:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa5d8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d0b49 expref: 47 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.038775:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.038779:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.038787:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.038792:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.038833:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.038865:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.038875:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066753.038920:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983109504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 729us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.038929:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7046 00000040:00080000:1.0:1746066753.039145:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].590, 88 off59632 00000004:00080000:1.0:1746066753.039153:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250268652ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039195:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].528, 88 off54256 00000004:00080000:1.0:1746066753.039200:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250316573ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.039223:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].529, 88 off54344 00000004:00080000:1.0:1746066753.039226:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250343037ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.039238:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].591, 88 off59720 00000004:00080000:1.0:1746066753.039241:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250357952ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039271:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].592, 88 off59808 00000004:00080000:1.0:1746066753.039275:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250391598ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039290:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].530, 88 off54432 00000004:00080000:1.0:1746066753.039293:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250409743ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.039310:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].531, 88 off54520 00000004:00080000:1.0:1746066753.039312:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250429153ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.039320:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].532, 88 off54608 00000004:00080000:1.0:1746066753.039322:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250438871ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.039331:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].593, 88 off59896 00000004:00080000:1.0:1746066753.039333:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250449608ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039342:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].533, 88 off54696 00000004:00080000:1.0:1746066753.039344:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250460548ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.039350:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].594, 88 off59984 00000004:00080000:1.0:1746066753.039353:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250469264ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039360:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].534, 88 off54784 00000004:00080000:1.0:1746066753.039363:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250479414ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.039369:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].595, 88 off60072 00000004:00080000:1.0:1746066753.039371:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250487857ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039379:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].596, 88 off60160 00000004:00080000:1.0:1746066753.039381:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250498323ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039390:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].597, 88 off60248 00000004:00080000:1.0:1746066753.039392:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250509104ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039400:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].598, 88 off60336 00000004:00080000:1.0:1746066753.039402:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721250519123ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.039410:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].535, 88 off54872 00000004:00080000:1.0:1746066753.039413:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721250529667ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066753.041383:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936538 is committed 00000004:00080000:3.0:1746066753.041392:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 526 committed 00000004:00080000:3.0:1746066753.041407:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 587 committed 00000004:00080000:3.0:1746066753.041419:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 586 committed 00000004:00080000:3.0:1746066753.041421:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 585 committed 00000004:00080000:3.0:1746066753.041422:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 584 committed 00000004:00080000:3.0:1746066753.041424:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 525 committed 00000004:00080000:3.0:1746066753.041425:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 583 committed 00000004:00080000:3.0:1746066753.041427:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 524 committed 00000004:00080000:3.0:1746066753.041428:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 582 committed 00000004:00080000:3.0:1746066753.041430:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 523 committed 00000004:00080000:3.0:1746066753.041431:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 522 committed 00000004:00080000:3.0:1746066753.041432:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 521 committed 00000004:00080000:3.0:1746066753.041434:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 581 committed 00000004:00080000:3.0:1746066753.041436:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 580 committed 00000004:00080000:3.0:1746066753.041438:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 520 committed 00000004:00080000:3.0:1746066753.041439:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 519 committed 00000004:00080000:3.0:1746066753.041441:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 579 committed 00000001:00080000:3.0:1746066753.041446:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936537 is committed 00000001:00080000:3.0:1746066753.041452:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936536 is committed 00000100:00100000:0.0:1746066753.041720:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984404480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.041778:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.041808:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984404992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.041824:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.041845:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984405504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.041867:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.041929:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984404608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.041952:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.041966:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984405120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.041980:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.041992:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984405632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.042005:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.042014:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984406144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.042025:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.042038:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746066753.042043:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984406016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.042056:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.042077:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984404480 00000100:00100000:1.0:1746066753.042084:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984404480 00000100:00100000:1.0:1746066753.042120:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984404992 00000100:00100000:1.0:1746066753.042122:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984404992 00000100:00100000:1.0:1746066753.042132:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15654 00000100:00100000:1.0:1746066753.042138:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3776:x1830882984404480:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746066753.042224:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066753.042244:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984405504 00000100:00100000:2.0:1746066753.042251:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984405504 00000100:00100000:1.0:1746066753.042271:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3776:x1830882984404480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (493us total) trans 21474841798 rc 0/0 00000100:00100000:1.0:1746066753.042278:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15654 00000100:00100000:2.0:1746066753.042289:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984404608 00000100:00100000:2.0:1746066753.042291:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984404608 00000100:00100000:1.0:1746066753.042292:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984405120 00000100:00100000:1.0:1746066753.042295:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984405120 00000100:00100000:2.0:1746066753.042299:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984405632 00000100:00100000:2.0:1746066753.042302:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984405632 00000100:00100000:1.0:1746066753.042303:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984406144 00000100:00100000:1.0:1746066753.042305:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984406144 00000100:00100000:2.0:1746066753.042310:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984406016 00000100:00100000:2.0:1746066753.042311:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984406016 00000100:00100000:1.0:1746066753.042315:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15655 00000100:00100000:1.0:1746066753.042319:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3776:x1830882984404992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.042325:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15656 00000100:00100000:2.0:1746066753.042332:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3776:x1830882984405504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066753.042362:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066753.042365:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066753.042367:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066753.042369:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066753.042371:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:1.0:1746066753.042388:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882984404992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (563us total) trans 21474841799 rc 0/0 00000100:00100000:1.0:1746066753.042394:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15655 00000100:00100000:1.0:1746066753.042404:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15657 00000100:00100000:1.0:1746066753.042408:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984404608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066753.042445:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:1.0:1746066753.042447:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.042448:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066753.042450:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.042452:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000004:00080000:0.0:1746066753.042537:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ace00/2, rc 0, transno 17179874354 00000100:00100000:0.0:1746066753.042542:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984405504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.042562:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f765500/2, rc 0, transno 21474841798 00000100:00100000:0.0:1746066753.042569:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984404480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066753.042575:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f765180/2, rc 0, transno 21474841799 00000100:00100000:0.0:1746066753.042577:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f765180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984404992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.042592:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15658 00000100:00100000:0.0:1746066753.042598:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984405120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.042647:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:0.0:1746066753.042650:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.042652:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066753.042653:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.042655:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066753.042713:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.043627:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3777:x1830882984404608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1215us (1671us total) trans 21474841800 rc 0/0 00000100:00100000:1.0:1746066753.043634:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15657 00000100:00100000:1.0:1746066753.043650:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15659 00000100:00100000:1.0:1746066753.043656:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3777:x1830882984405632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066753.043725:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066753.043728:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.043730:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:1.0:1746066753.043731:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.043733:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:2.0:1746066753.043739:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3776:x1830882984405504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1403us (1866us total) trans 17179874354 rc 0/0 00000100:00100000:2.0:1746066753.043748:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15656 00000100:00100000:1.0:1746066753.043761:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+58:3777:x1830882984405632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (1754us total) trans 17179874355 rc 0/0 00000100:00100000:1.0:1746066753.043766:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15659 00000100:00100000:1.0:1746066753.043779:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15660 00000100:00100000:1.0:1746066753.043784:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3777:x1830882984406144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.043836:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3777:x1830882984406144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (1809us total) trans 17179874356 rc 0/0 00000100:00100000:1.0:1746066753.043840:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15660 00000100:00100000:1.0:1746066753.043850:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15661 00000100:00100000:1.0:1746066753.043855:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3777:x1830882984406016:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1746066753.043918:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066753.043921:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3777:x1830882984406016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1863us total) trans 17179874357 rc 0/0 00000100:00100000:1.0:1746066753.043926:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15661 00000100:00100000:0.0:1746066753.044053:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984405120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1455us (2071us total) trans 21474841801 rc 0/0 00000100:00100000:0.0:1746066753.044059:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15658 00000100:00100000:3.0:1746066753.044192:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.044225:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.044243:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.044284:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984404224 00000100:00100000:0.0:1746066753.044288:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984404224 00000100:00100000:0.0:1746066753.044308:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984404736 00000100:00100000:0.0:1746066753.044310:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984404736 00000100:00100000:0.0:1746066753.044321:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15662 00000100:00100000:0.0:1746066753.044325:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3774:x1830882984404224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.044387:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3774:x1830882984404224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (195us total) trans 21474841802 rc 0/0 00000100:00100000:0.0:1746066753.044392:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15662 00000100:00100000:0.0:1746066753.044401:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15663 00000100:00100000:0.0:1746066753.044405:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3774:x1830882984404736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.044980:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066753.044983:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.044985:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066753.044986:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.044988:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:0.0:1746066753.045009:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3774:x1830882984404736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 603us (765us total) trans 21474841803 rc 0/0 00000100:00100000:0.0:1746066753.045015:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15663 00000004:00080000:1.0:1746066753.045092:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958adc00/2, rc 0, transno 17179874357 00000100:00100000:1.0:1746066753.045098:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984406016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066753.045114:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f764e00/2, rc 0, transno 21474841800 00000100:00100000:1.0:1746066753.045117:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984404608:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066753.045123:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f766300/2, rc 0, transno 21474841801 00000100:00100000:1.0:1746066753.045125:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984405120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066753.045134:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ad180/2, rc 0, transno 17179874355 00000100:00100000:1.0:1746066753.045136:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984405632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066753.045143:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ae680/2, rc 0, transno 17179874356 00000100:00100000:1.0:1746066753.045145:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984406144:0@lo:2:osp-syn-1-0.0 00000004:00010000:1.0:1746066753.045196:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011f766a00 reply state ffff88012b661000 transno 8589936538 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.045215:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.045223:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.045226:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746066753.045230:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746066753.045302:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746066753.045316:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:500:x1830882983108224:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 15165us (15300us total) trans 8589936538 rc 0/0 00000100:00100000:1.0:1746066753.045322:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16225 00000100:00100000:3.0:1746066753.045689:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.045718:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.045745:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.045760:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.045776:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984406272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.045779:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984405248 00000100:00100000:2.0:1746066753.045787:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984405248 00000100:00100000:3.0:1746066753.045790:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066753.045807:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f765c00/2, rc 0, transno 21474841802 00000100:00100000:3.0:1746066753.045810:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066753.045815:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f767480/2, rc 0, transno 21474841803 00000100:00100000:3.0:1746066753.045817:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.045820:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984405760 00000100:00100000:2.0:1746066753.045822:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984405760 00000100:00100000:3.0:1746066753.045823:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746066753.045827:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.045832:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984406272 00000100:00100000:2.0:1746066753.045834:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984406272 00000100:00100000:3.0:1746066753.045841:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.045856:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984404352 00000100:00100000:2.0:1746066753.045858:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984404352 00000100:00100000:2.0:1746066753.045875:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15664 00000100:00100000:2.0:1746066753.045901:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882984405248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.046052:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3774:x1830882984405248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (337us total) trans 17179874358 rc 0/0 00000100:00100000:2.0:1746066753.046058:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15664 00000100:00100000:2.0:1746066753.046069:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15665 00000100:00100000:2.0:1746066753.046073:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3774:x1830882984405760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066753.046114:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:2.0:1746066753.046116:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.046118:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066753.046120:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.046122:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:2.0:1746066753.046141:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3774:x1830882984405760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (380us total) trans 17179874359 rc 0/0 00000100:00100000:2.0:1746066753.046150:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15665 00000100:00100000:2.0:1746066753.046159:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15666 00000100:00100000:2.0:1746066753.046163:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3774:x1830882984406272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.046225:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882984406272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (434us total) trans 21474841804 rc 0/0 00000100:00100000:2.0:1746066753.046230:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15666 00000100:00100000:2.0:1746066753.046239:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15667 00000100:00100000:2.0:1746066753.046243:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3774:x1830882984404352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.046291:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882984404352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (448us total) trans 21474841805 rc 0/0 00000100:00100000:2.0:1746066753.046295:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15667 00010000:00010000:1.0:1746066753.046390:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.046398:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.046404:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.046409:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012155c000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.046413:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.046419:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.046430:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.046432:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.046435:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.046439:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155c000/0xf1867c21abfa65cc lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066753.046509:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.046530:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.046553:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.046568:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.046578:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.046590:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066753.046620:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f764a80/2, rc 0, transno 21474841804 00000100:00100000:3.0:1746066753.046624:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984406272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066753.046632:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958adf80/2, rc 0, transno 17179874358 00000100:00100000:3.0:1746066753.046635:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.046636:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984404864 00000100:00100000:1.0:1746066753.046640:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984404864 00000004:00080000:3.0:1746066753.046642:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958af100/2, rc 0, transno 17179874359 00000100:00100000:3.0:1746066753.046644:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066753.046653:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f767b80/2, rc 0, transno 21474841805 00000100:00100000:3.0:1746066753.046656:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.046659:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984405376 00000100:00100000:1.0:1746066753.046661:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984405376 00000100:00100000:1.0:1746066753.046671:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984405888 00000100:00100000:1.0:1746066753.046673:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984405888 00000100:00100000:3.0:1746066753.046680:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15668 00000100:00100000:3.0:1746066753.046687:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3774:x1830882984404864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.046696:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15669 00000100:00100000:1.0:1746066753.046700:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882984405376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.046713:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15670 00000100:00100000:2.0:1746066753.046719:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3774:x1830882984405888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.046756:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3774:x1830882984405376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (187us total) trans 17179874360 rc 0/0 00000100:00100000:1.0:1746066753.046760:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15669 00000100:00100000:3.0:1746066753.046775:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3774:x1830882984404864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (243us total) trans 21474841806 rc 0/0 00000100:00100000:3.0:1746066753.046782:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15668 00000100:00100000:2.0:1746066753.046784:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3774:x1830882984405888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (190us total) trans 17179874361 rc 0/0 00000100:00100000:2.0:1746066753.046794:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15670 00000004:00080000:3.0:1746066753.046805:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f765880/2, rc 0, transno 21474841806 00000100:00100000:3.0:1746066753.046808:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984404864:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066753.046816:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958ac000/2, rc 0, transno 17179874360 00000100:00100000:3.0:1746066753.046818:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066753.046825:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958aca80/2, rc 0, transno 17179874361 00000100:00100000:3.0:1746066753.046827:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984405888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.048666:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.048760:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983109632 00000100:00100000:1.0:1746066753.048767:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983109632 00000100:00100000:1.0:1746066753.048862:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16226 00000100:00100000:1.0:1746066753.048870:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:500:x1830882983109632:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066753.049055:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.049073:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1154 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.049127:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.049144:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.049160:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.049162:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.049166:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096debe00, rc 0) 00000100:00100000:1.0:1746066753.049749:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:500:x1830882983109632:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 878us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.049755:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16226 00000100:00100000:2.0:1746066753.052089:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746066753.052110:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984406400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746066753.052175:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.052512:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984406400 00000100:00100000:0.0:1746066753.052521:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984406400 00000100:00080000:2.0:1746066753.052570:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066753.052585:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:0.0:1746066753.052591:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882984406400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746066753.052721:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1083599296 pending 2990080 free 3906453504 avail 3674931200 00000100:00100000:0.0:1746066753.052773:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3774:x1830882984406400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.052778:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1746066753.052800:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984406400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066753.056035:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.056102:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983109760 00000100:00100000:1.0:1746066753.056116:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983109760 00000100:00100000:1.0:1746066753.056174:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16227 00000100:00100000:1.0:1746066753.056183:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:500:x1830882983109760:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066753.056202:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.056223:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa65da lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d115b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.056381:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfa65e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.056394:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfa65e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.056405:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfa65e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066753.056434:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066753.056438:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066753.056454:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfa65e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.056477:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa65da lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d115b expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.056492:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfa65e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d115b expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.056500:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.056503:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066753.056505:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496400, rc 0) 00000100:00100000:1.0:1746066753.056718:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:500:x1830882983109760:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 535us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.056724:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16227 00000100:00100000:0.0:1746066753.062278:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.062377:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983109888 00000100:00100000:2.0:1746066753.062387:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983109888 00000100:00100000:2.0:1746066753.062435:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15671 00000100:00100000:2.0:1746066753.062443:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983109888:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066753.062465:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066753.063036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.063087:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110016 00000100:00100000:0.0:1746066753.063090:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110016 00000100:00100000:0.0:1746066753.063115:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15672 00000100:00100000:0.0:1746066753.063120:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983110016:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066753.063129:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.063146:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1169 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066753.063177:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd41, atime: 0x6812dd41, ctime: 0x6812dd41, blocks: 0x808 00010000:00010000:0.0:1746066753.063199:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.063201:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.063210:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 16 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.063229:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 16 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.063240:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cc0800, rc 0) 00010000:00010000:2.0:1746066753.063323:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1162 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066753.063343:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd40, atime: 0x6812dd40, ctime: 0x6812dd40, blocks: 0x7b0 00010000:00010000:2.0:1746066753.063353:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.063355:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.063359:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.063369:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 10 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.063375:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944800, rc 0) 00000100:00100000:2.0:1746066753.063392:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983109888:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 950us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.063398:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15671 00000100:00100000:0.0:1746066753.063516:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983110016:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 167us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.063521:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15672 00000100:00100000:0.0:1746066753.063563:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.063602:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.063647:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.063995:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.064229:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110272 00000100:00100000:1.0:1746066753.064233:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110272 00000100:00100000:1.0:1746066753.064257:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110528 00000100:00100000:1.0:1746066753.064259:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110528 00000100:00100000:1.0:1746066753.064270:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110144 00000100:00100000:1.0:1746066753.064271:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110144 00000100:00100000:1.0:1746066753.064281:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110400 00000100:00100000:1.0:1746066753.064282:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110400 00000100:00100000:1.0:1746066753.064295:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15673 00000100:00100000:1.0:1746066753.064300:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983110272:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066753.064309:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.064319:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1177 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066753.064337:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd40, atime: 0x6812dd40, ctime: 0x6812dd40, blocks: 0x800 00010000:00010000:1.0:1746066753.064346:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.064347:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.064352:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.064362:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 12 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.064368:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a4b000, rc 0) 00000100:00100000:0.0:1746066753.064908:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15674 00000100:00100000:0.0:1746066753.064916:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983110528:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066753.064917:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15675 00000100:00100000:2.0:1746066753.064924:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983110144:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066753.064925:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.064931:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.064935:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1185 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.064940:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1170 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066753.064951:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd41, atime: 0x6812dd3d, ctime: 0x6812dd41, blocks: 0x800 00002000:00010000:0.0:1746066753.064951:0:12233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd41, atime: 0x6812dd41, ctime: 0x6812dd41, blocks: 0x1000 00010000:00010000:0.0:1746066753.064959:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.064960:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.064961:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.064962:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.064965:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.064967:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.064974:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 19 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.064976:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.064981:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0bc00, rc 0) 00010000:00010000:2.0:1746066753.064983:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b944a00, rc 0) 00000100:00100000:3.0:1746066753.065041:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15676 00000100:00100000:3.0:1746066753.065049:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983110400:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066753.065309:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.065320:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d117e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066753.065331:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd41, atime: 0x6812dd41, ctime: 0x6812dd41, blocks: 0x1668 00010000:00010000:3.0:1746066753.065340:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.065341:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.065346:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.065354:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 13 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.065361:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899000, rc 0) 00000100:00100000:1.0:1746066753.065427:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983110272:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1126us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.065427:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983110528:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 511us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.065434:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15674 00000100:00100000:1.0:1746066753.065579:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15673 00000100:00100000:2.0:1746066753.065596:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983110144:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 671us (1946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.065603:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15675 00000100:00100000:3.0:1746066753.065682:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983110400:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 633us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.065688:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15676 00000100:00100000:0.0:1746066753.069205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.069511:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.069558:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.069575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.069591:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.069679:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.069746:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110656 00000100:00100000:2.0:1746066753.069757:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110656 00000100:00100000:2.0:1746066753.069798:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110912 00000100:00100000:2.0:1746066753.069800:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110912 00000100:00100000:2.0:1746066753.069812:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111168 00000100:00100000:2.0:1746066753.069814:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111168 00000100:00100000:2.0:1746066753.069824:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983110784 00000100:00100000:2.0:1746066753.069826:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983110784 00000100:00100000:2.0:1746066753.069834:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111040 00000100:00100000:2.0:1746066753.069835:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111040 00000100:00100000:2.0:1746066753.069848:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15677 00000100:00100000:2.0:1746066753.069856:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983110656:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066753.069914:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111296 00000100:00100000:1.0:1746066753.069919:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111296 00000100:00100000:1.0:1746066753.069938:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15678 00000100:00100000:1.0:1746066753.069944:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882983110912:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066753.069987:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983110656:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 130us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.069990:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2015:x1830882983110912:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 46us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.069994:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15677 00000100:00100000:1.0:1746066753.069997:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15678 00000100:00100000:3.0:1746066753.070010:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15679 00000100:00100000:1.0:1746066753.070648:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15680 00000100:00100000:2.0:1746066753.070675:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15681 00000100:00100000:3.0:1746066753.070699:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983111168:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066753.070743:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983111168:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 47us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.070748:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15679 00000100:00100000:3.0:1746066753.070760:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15682 00000100:00100000:3.0:1746066753.070765:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983111296:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066753.070793:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983111296:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 28us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.070797:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15682 00000100:00100000:1.0:1746066753.070837:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882983110784:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066753.070870:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2015:x1830882983110784:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 35us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.070879:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15680 00000100:00100000:2.0:1746066753.070970:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983111040:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066753.071015:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983111040:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 48us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.071021:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15681 00000100:00100000:0.0:1746066753.073786:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.073816:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.073831:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.073840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.073848:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.073938:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111424 00000100:00100000:0.0:1746066753.073944:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.073949:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111424 00000100:00100000:2.0:1746066753.073985:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111552 00000100:00100000:2.0:1746066753.073987:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111552 00000100:00100000:2.0:1746066753.073998:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111808 00000100:00100000:0.0:1746066753.073998:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111680 00000100:00100000:2.0:1746066753.074000:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111808 00000100:00100000:0.0:1746066753.074003:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111680 00000100:00100000:2.0:1746066753.074009:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983111936 00000100:00100000:2.0:1746066753.074010:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983111936 00000100:00100000:0.0:1746066753.074023:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983112064 00000100:00100000:0.0:1746066753.074025:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983112064 00000100:00100000:2.0:1746066753.074028:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15683 00000100:00100000:2.0:1746066753.074035:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983111424:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066753.074127:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983111424:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.075261:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15684 00000100:00100000:3.0:1746066753.075274:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882983111552:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066753.075337:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2013:x1830882983111552:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 68us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.075343:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15684 00000100:00100000:3.0:1746066753.075361:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15685 00000100:00100000:3.0:1746066753.075366:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983111808:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066753.075396:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983111808:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 30us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.075401:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15685 00000100:00100000:3.0:1746066753.075410:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15686 00000100:00100000:3.0:1746066753.075415:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882983111680:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066753.075442:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882983111680:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 27us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.075447:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15686 00000100:00100000:3.0:1746066753.075458:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15687 00000100:00100000:3.0:1746066753.075462:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983111936:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066753.075487:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983111936:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 25us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.075496:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15687 00000100:00100000:3.0:1746066753.075504:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15688 00000100:00100000:3.0:1746066753.075508:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2013:x1830882983112064:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066753.075534:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2013:x1830882983112064:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 26us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.075540:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15688 00000100:00100000:2.0:1746066753.075560:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15683 00000100:00100000:0.0:1746066753.078034:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.078153:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983112192 00000100:00100000:2.0:1746066753.078162:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983112192 00000100:00100000:2.0:1746066753.078348:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15689 00000100:00100000:2.0:1746066753.078356:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2013:x1830882983112192:12345-192.168.204.16@tcp:22:lfs.0 00002000:00010000:2.0:1746066753.078570:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066753.078573:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.078575:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066753.078577:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.078579:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:2.0:1746066753.079105:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2013:x1830882983112192:12345-192.168.204.16@tcp:22:lfs.0 Request processed in 748us (1077us total) trans 17179874362 rc 0/0 00000100:00100000:2.0:1746066753.079112:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15689 00000100:00100000:0.0:1746066753.082471:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.082579:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983112320 00000100:00100000:2.0:1746066753.082590:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983112320 00000100:00100000:2.0:1746066753.082641:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15690 00000100:00100000:2.0:1746066753.082648:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983112320:12345-192.168.204.16@tcp:22:lfs.0 00002000:00010000:2.0:1746066753.082855:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066753.082858:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066753.082860:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066753.082862:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066753.082863:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:2.0:1746066753.082942:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983112320:12345-192.168.204.16@tcp:22:lfs.0 Request processed in 293us (481us total) trans 21474841807 rc 0/0 00000100:00100000:2.0:1746066753.082948:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15690 00000100:00100000:0.0:1746066753.086205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.086260:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.086355:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983112576 00000100:00100000:1.0:1746066753.086365:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983112576 00000100:00100000:2.0:1746066753.086401:0:29520:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983112832 00000100:00100000:2.0:1746066753.086406:0:29520:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983112832 00000100:00100000:1.0:1746066753.086436:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4104 00000100:00100000:1.0:1746066753.086444:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882983112576:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:2.0:1746066753.086445:0:29520:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4105 00000100:00100000:2.0:1746066753.086450:0:29520:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983112832:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066753.086480:0:20357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.086494:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.086495:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.086501:0:20357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.086513:0:20357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.086668:0:29520:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.086677:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.086679:0:29520:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.086682:0:29520:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.086691:0:29520:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.087875:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.087945:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983113088 00000100:00100000:3.0:1746066753.087950:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983113088 00000100:00100000:3.0:1746066753.087986:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4106 00000100:00100000:3.0:1746066753.087992:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2014:x1830882983113088:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066753.088014:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.088023:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.088025:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.088028:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.088037:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.089527:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.089622:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983113344 00000100:00100000:3.0:1746066753.089629:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983113344 00000100:00100000:3.0:1746066753.089685:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4107 00000100:00100000:3.0:1746066753.089692:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983113344:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066753.089724:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.089737:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.089739:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.089742:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.089752:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.090506:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.090536:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.090575:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983113600 00000100:00100000:2.0:1746066753.090578:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.090579:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983113600 00000100:00100000:1.0:1746066753.090602:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983113856 00000100:00100000:1.0:1746066753.090605:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983113856 00000100:00100000:2.0:1746066753.090610:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983114112 00000100:00100000:2.0:1746066753.090612:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983114112 00000100:00100000:1.0:1746066753.090621:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4108 00000100:00100000:1.0:1746066753.090626:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983113600:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:2.0:1746066753.090631:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4109 00000100:00100000:2.0:1746066753.090635:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2015:x1830882983113856:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066753.090641:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.090649:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.090649:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.090650:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.090654:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.090655:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.090656:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.090659:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.090662:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.090666:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.091017:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4110 00000100:00100000:3.0:1746066753.091023:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983114112:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066753.091035:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.091042:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.091043:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.091046:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.091052:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.092086:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.092169:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983114368 00000100:00100000:3.0:1746066753.092176:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983114368 00000100:00100000:3.0:1746066753.092226:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4111 00000100:00100000:3.0:1746066753.092232:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+25:2015:x1830882983114368:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066753.092248:0:20360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.092260:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.092261:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.092265:0:20360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.092273:0:20360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.097705:0:29520:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.097719:0:29520:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.097727:0:29520:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.097733:0:29520:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091cb4400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066753.097736:0:29520:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.097744:0:29520:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.097760:0:29520:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.097766:0:29520:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4400/0xf1867c21abfa6619 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29520 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.097848:0:29520:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+25:2014:x1830882983112832:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 11393us (11583us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.097857:0:29520:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4105 00010000:00010000:1.0:1746066753.101101:0:20357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.101113:0:20357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.101120:0:20357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.101124:0:20357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012155ce00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066753.101127:0:20357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.101133:0:20357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.101148:0:20357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.101152:0:20357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa6612 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [45056->1048575] (req 45056->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.101226:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983112576:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 14779us (15028us total) trans 0 rc 1003520/1003520 00000100:00100000:1.0:1746066753.101235:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4104 00010000:00010000:3.0:1746066753.106380:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.106395:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.106402:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.106408:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5898400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066753.106412:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.106418:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.106433:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.106439:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898400/0xf1867c21abfa6620 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.106533:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2014:x1830882983113088:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18536us (18658us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.106541:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4106 00010000:00010000:3.0:1746066753.108077:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.108093:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.108100:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.108105:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5899e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066753.108109:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.108115:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.108131:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.108137:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6627 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.108206:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983113344:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 18511us (18682us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.108219:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4107 00010000:00010000:1.0:1746066753.114759:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.114776:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.114783:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.114790:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c6200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066753.114793:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.114800:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.114815:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.114821:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa662e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.115620:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983113600:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 24988us (25109us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066753.115630:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4108 00010000:00010000:3.0:1746066753.119995:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.120012:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.120020:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.120027:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5898e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066753.120032:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.120039:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.120059:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.120065:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa663c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.120150:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983114112:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 29121us (29564us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.120160:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4110 00010000:00010000:2.0:1746066753.121367:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.121380:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.121387:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.121394:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091cb4000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066753.121397:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.121404:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.121419:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.121425:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb4000/0xf1867c21abfa6635 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.121506:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882983113856:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 30867us (30966us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.121519:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4109 00010000:00010000:3.0:1746066753.127223:0:20360:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.127242:0:20360:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.127250:0:20360:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.127257:0:20360:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5899200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066753.127261:0:20360:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.127269:0:20360:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.127289:0:20360:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.127295:0:20360:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899200/0xf1867c21abfa6643 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.127403:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2015:x1830882983114368:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 35165us (35317us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.127414:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4111 00000100:00100000:0.0:1746066753.133967:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.134063:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983114624 00000100:00100000:1.0:1746066753.134075:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983114624 00000100:00100000:1.0:1746066753.134136:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16228 00000100:00100000:1.0:1746066753.134144:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:500:x1830882983114624:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066753.134196:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.134224:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496400/0xf1867c21abfa65e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d115b expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.134245:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.134250:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.134296:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.134308:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.134317:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00010000:1.0:1746066753.134418:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880096ecb100 reply state ffff8800a7d34000 transno 8589936539 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.134426:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.134430:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.134433:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746066753.134435:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746066753.135777:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:500:x1830882983114624:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 1627us (1813us total) trans 8589936539 rc 0/0 00000100:00100000:1.0:1746066753.135786:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16228 00000100:00100000:1.0:1746066753.139436:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.139678:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983114752 00000100:00100000:2.0:1746066753.139688:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983114752 00000100:00100000:2.0:1746066753.139744:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15691 00000100:00100000:2.0:1746066753.139752:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:500:x1830882983114752:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066753.139772:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.139791:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d118c expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.139821:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.139829:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.139831:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.139834:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.139864:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.139878:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.139908:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984406528:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.140010:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.142031:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984406528:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.142062:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.142079:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992800, rc 0) 00000100:00100000:2.0:1746066753.142133:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:500:x1830882983114752:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2381us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.142142:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15691 00000100:00100000:1.0:1746066753.142325:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.142478:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983114880 00000100:00100000:2.0:1746066753.142486:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983114880 00010000:00010000:2.0:1746066753.142511:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.142554:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7047 00000100:00100000:2.0:1746066753.142561:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983114880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.142573:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.142593:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.142685:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.142709:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b944800/0xf1867c21abfa65ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1162 expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.143658:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.143661:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.143671:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.143680:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.143717:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.143730:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984406656:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.143820:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.145160:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.145170:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984406656:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066753.145188:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.145297:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115008 00000100:00100000:3.0:1746066753.145304:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115008 00000100:00100000:3.0:1746066753.145341:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15692 00000100:00100000:3.0:1746066753.145347:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:500:x1830882983115008:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066753.145379:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983114880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2818us (3055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.145387:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7047 00010000:00010000:3.0:1746066753.146745:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.146770:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1193 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.146803:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.146812:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.146814:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.146817:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.146851:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 20 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.146864:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 20 pid: 1893 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.146877:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984406784:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.148302:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.151731:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984406784:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.151788:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.151808:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898000, rc 0) 00000100:00100000:3.0:1746066753.152203:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:500:x1830882983115008:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6853us (7045us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.152212:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15692 00000100:00100000:0.0:1746066753.152470:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.152599:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115136 00000100:00100000:2.0:1746066753.152606:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115136 00010000:00010000:2.0:1746066753.152642:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 20 pid: 1893 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.152664:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7048 00000100:00100000:2.0:1746066753.152670:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983115136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.152683:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.152703:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 20 pid: 1893 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.152713:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 20 pid: 1893 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.152738:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cc0800/0xf1867c21abfa65e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1169 expref: 20 pid: 1893 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.152762:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.152764:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.152769:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.152778:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.152815:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.153018:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984406912:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.153092:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.153918:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984406912:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066753.153933:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.154040:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983115136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1368us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.154047:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7048 00000100:00100000:1.0:1746066753.154447:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.154577:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115264 00000100:00100000:3.0:1746066753.154582:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115264 00000100:00100000:3.0:1746066753.154672:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15693 00000100:00100000:3.0:1746066753.154680:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:500:x1830882983115264:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066753.154695:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.154709:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d119a expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.154730:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.154737:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.154739:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.154742:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.154762:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.154772:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 20 pid: 12255 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.154782:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984407040:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.155118:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.156181:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984407040:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.156201:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.156212:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898c00, rc 0) 00000100:00100000:3.0:1746066753.156250:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:500:x1830882983115264:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1570us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.156256:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15693 00000100:00100000:0.0:1746066753.156520:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.156670:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115392 00000100:00100000:2.0:1746066753.156675:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115392 00010000:00010000:2.0:1746066753.156695:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 20 pid: 12255 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.156714:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7049 00000100:00100000:2.0:1746066753.156719:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983115392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.156729:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.156746:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 20 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.156756:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 20 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.156781:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b944a00/0xf1867c21abfa6604 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1170 expref: 20 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.156793:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.156795:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.156800:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.156812:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.156836:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.156846:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984407168:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.156912:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.159333:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984407168:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066753.159350:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.159392:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983115392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2672us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.159401:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7049 00000100:00100000:0.0:1746066753.161198:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.161474:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115520 00000100:00100000:3.0:1746066753.161484:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115520 00000100:00100000:3.0:1746066753.161523:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15694 00000100:00100000:3.0:1746066753.161532:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:500:x1830882983115520:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066753.161565:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.161583:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11a1 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.161615:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.161622:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.161624:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.161637:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.161668:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.161680:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 14 pid: 20361 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.161693:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984407296:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.161779:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.164326:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984407296:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.164354:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.164371:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899800, rc 0) 00000100:00100000:3.0:1746066753.164415:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:500:x1830882983115520:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2884us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.164423:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15694 00000100:00100000:0.0:1746066753.165698:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.166612:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115648 00000100:00100000:2.0:1746066753.166622:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115648 00010000:00010000:2.0:1746066753.166658:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 14 pid: 20361 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.166705:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7050 00000100:00100000:2.0:1746066753.166712:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983115648:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.166725:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.166741:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 14 pid: 20361 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.166757:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 14 pid: 20361 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.166774:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a4b000/0xf1867c21abfa65f6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1177 expref: 14 pid: 20361 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.166804:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.166806:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.166811:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.166819:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.166847:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.166859:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984407424:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.166968:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.170568:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.170626:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115776 00000100:00100000:3.0:1746066753.170638:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115776 00000100:00100000:2.0:1746066753.170660:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984407424:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066753.170677:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.170709:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983115648:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3998us (5016us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.170714:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15695 00000100:00100000:2.0:1746066753.170720:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7050 00000100:00100000:3.0:1746066753.170723:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:500:x1830882983115776:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066753.170742:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.170759:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11a8 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.170788:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.170796:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.170798:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.170801:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.170834:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.170846:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.170857:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984407552:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.170939:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.174838:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984407552:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.174873:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.174919:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899200, rc 0) 00000100:00100000:3.0:1746066753.174973:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:500:x1830882983115776:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4250us (4410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.174981:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15695 00000100:00100000:0.0:1746066753.175291:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.175375:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983115904 00000100:00100000:2.0:1746066753.175382:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983115904 00010000:00010000:2.0:1746066753.175406:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.175428:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7051 00000100:00100000:2.0:1746066753.175435:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983115904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.175447:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.175467:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.175477:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.175497:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899000/0xf1867c21abfa660b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d117e expref: 14 pid: 9590 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.175523:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.175525:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.175531:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.175538:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.175572:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.175583:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984407680:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.176443:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.177169:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984407680:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066753.177184:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.177241:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983115904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1806us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.177249:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7051 00000100:00100000:0.0:1746066753.178193:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.178252:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116032 00000100:00100000:3.0:1746066753.178260:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116032 00000100:00100000:3.0:1746066753.178314:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15696 00000100:00100000:3.0:1746066753.178321:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:500:x1830882983116032:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066753.178339:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.178357:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11af expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.178388:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 20 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.178395:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.178397:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.178400:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.178428:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 20 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.178439:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 20 pid: 12233 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.178451:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984407808:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.179326:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.182090:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.182372:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116160 00000100:00100000:2.0:1746066753.182384:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116160 00010000:00010000:2.0:1746066753.182420:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 21 pid: 12233 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.182451:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7052 00000100:00100000:2.0:1746066753.182458:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882983116160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.182471:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.182487:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 21 pid: 12233 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.182499:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 21 pid: 12233 timeout: 821 lvb_type: 1 00010000:00010000:2.0:1746066753.182520:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.182522:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.182527:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.182535:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.182580:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.182591:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984407936:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.182676:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fe40 going to sleep for 11 seconds 00010000:00010000:3.0:1746066753.182696:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa65fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1185 expref: 21 pid: 12233 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.182730:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984407808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.182754:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.182765:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898e00, rc 0) 00000100:00100000:3.0:1746066753.182798:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:500:x1830882983116032:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4477us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.182806:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15696 00000100:00100000:2.0:1746066753.188021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.188046:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.188067:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.188068:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984407936:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.188087:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116288 00010000:00010000:0.0:1746066753.188090:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.188093:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116288 00000100:00100000:1.0:1746066753.188113:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116416 00000100:00100000:1.0:1746066753.188120:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116416 00000100:00100000:2.0:1746066753.188125:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116544 00000100:00100000:2.0:1746066753.188127:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116544 00000100:00100000:2.0:1746066753.188141:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15697 00000100:00100000:0.0:1746066753.188143:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e208050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2015:x1830882983116160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5684us (6061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.188149:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983116288:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066753.188153:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7052 00000100:00100000:1.0:1746066753.188169:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15698 00000100:00100000:1.0:1746066753.188176:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983116544:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066753.188206:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15699 00000100:00100000:0.0:1746066753.188212:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+20:2016:x1830882983116416:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066753.188346:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746066753.188349:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066752 -> 1746066753 00002000:00010000:2.0:1746066753.188351:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066752 -> 1746066753 00002000:00010000:2.0:1746066753.188353:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066752 -> 1746066754 00002000:00010000:2.0:1746066753.188355:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:2.0:1746066753.188391:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983116288:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 242us (377us total) trans 21474841808 rc 0/0 00000100:00100000:2.0:1746066753.188398:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15697 00000100:00100000:2.0:1746066753.188428:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.188478:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.188555:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.188572:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116672 00002000:00010000:1.0:1746066753.188572:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066753.188572:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746066753.188575:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116672 00002000:00010000:1.0:1746066753.188575:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.188575:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.188577:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066749 -> 1746066753 00002000:00010000:0.0:1746066753.188577:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.188579:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066753 -> 1746066754 00002000:00010000:0.0:1746066753.188579:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066753 -> 1746066754 00002000:00010000:1.0:1746066753.188581:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746066753.188582:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066753.188589:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116800 00000100:00100000:2.0:1746066753.188591:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116800 00000100:00100000:2.0:1746066753.188600:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983116928 00000100:00100000:2.0:1746066753.188602:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983116928 00000100:00100000:1.0:1746066753.188605:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2016:x1830882983116544:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 429us (537us total) trans 17179874363 rc 0/0 00000100:00100000:0.0:1746066753.188605:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+23:2016:x1830882983116416:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 393us (557us total) trans 17179874364 rc 0/0 00000100:00100000:0.0:1746066753.188611:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15699 00000100:00100000:1.0:1746066753.188615:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15698 00000100:00100000:2.0:1746066753.190134:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15700 00000100:00100000:0.0:1746066753.190145:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15701 00000100:00100000:2.0:1746066753.190147:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983116672:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:0.0:1746066753.190163:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983116800:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746066753.190165:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15702 00000100:00100000:1.0:1746066753.190180:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+21:2016:x1830882983116928:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066753.190226:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066753.190228:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.190230:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066753.190230:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.190231:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066753 -> 1746066754 00002000:00010000:2.0:1746066753.190232:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066752 -> 1746066753 00002000:00010000:1.0:1746066753.190232:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00002000:00010000:0.0:1746066753.190232:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:0.0:1746066753.190234:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.190235:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066752 -> 1746066753 00002000:00010000:2.0:1746066753.190237:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066752 -> 1746066754 00002000:00010000:0.0:1746066753.190237:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.190238:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066753 -> 1746066754 00002000:00010000:2.0:1746066753.190239:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746066753.190240:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:1.0:1746066753.190252:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+22:2016:x1830882983116928:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 75us (1699us total) trans 17179874365 rc 0/0 00000100:00100000:1.0:1746066753.190256:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15702 00000100:00100000:2.0:1746066753.190274:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983116672:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 132us (1844us total) trans 21474841809 rc 0/0 00000100:00100000:0.0:1746066753.190275:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983116800:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 116us (1796us total) trans 21474841810 rc 0/0 00000100:00100000:2.0:1746066753.190281:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15700 00000100:00100000:0.0:1746066753.190285:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15701 00000001:00080000:2.0:1746066753.194833:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874365 is committed 00000001:00080000:2.0:1746066753.194954:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874361 is committed 00000001:00080000:2.0:1746066753.194969:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874353 is committed 00000001:00080000:2.0:1746066753.194977:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874352 is committed 00000100:00100000:2.0:1746066753.195740:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.195832:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983117184 00000100:00100000:3.0:1746066753.195843:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983117184 00000100:00100000:3.0:1746066753.197031:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5904 00000100:00100000:3.0:1746066753.197043:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:500:x1830882983117184:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:3.0:1746066753.197109:0:11615:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6594 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d114d expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.197156:0:11615:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11615 initiator: MDT0 00010000:00010000:3.0:1746066753.197168:0:11615:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.197175:0:11615:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11615 initiator: MDT0 00010000:00010000:3.0:1746066753.197210:0:11615:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.197221:0:11615:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 11 pid: 7244 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.197233:0:11615:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11615:1830882984408064:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.197414:0:11615:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.199737:0:11615:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11615:1830882984408064:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.199760:0:11615:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11615 initiator: MDT0 00000100:00100000:0.0:1746066753.199962:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.200219:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983117312 00000100:00100000:2.0:1746066753.200226:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983117312 00010000:00010000:2.0:1746066753.200257:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 12 pid: 7244 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.200292:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7053 00000100:00100000:2.0:1746066753.200298:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983117312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.200312:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.200318:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 12 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.200327:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 12 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.200349:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096debe00/0xf1867c21abfa65d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1154 expref: 12 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.201084:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.201090:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11615 initiator: MDT0 00010000:00010000:2.0:1746066753.201098:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 11615 initiator: MDT0 00010000:00010000:2.0:1746066753.201105:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 11615 initiator: MDT0 00010000:00010000:2.0:1746066753.201136:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.201179:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983117312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 879us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.201185:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7053 00010000:00010000:3.0:1746066753.201213:0:11615:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11615 initiator: MDT0 00010000:00010000:3.0:1746066753.201221:0:11615:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11615 initiator: MDT0 00000040:00080000:3.0:1746066753.201590:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].599, 88 off60424 00000004:00080000:3.0:1746066753.201597:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721412712828ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.201633:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].536, 88 off54960 00000004:00080000:3.0:1746066753.201636:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721412752903ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066753.201880:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].537, 88 off55048 00000004:00080000:3.0:1746066753.201900:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721413016554ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066753.201916:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].600, 88 off60512 00000004:00080000:3.0:1746066753.201919:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413035524ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.201929:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].601, 88 off60600 00000004:00080000:3.0:1746066753.201931:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413048122ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.201940:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].538, 88 off55136 00000004:00080000:3.0:1746066753.201942:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721413058978ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066753.201965:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].539, 88 off55224 00000004:00080000:3.0:1746066753.201968:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721413084441ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066753.201975:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].540, 88 off55312 00000004:00080000:3.0:1746066753.201977:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721413094091ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066753.201984:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].602, 88 off60688 00000004:00080000:3.0:1746066753.201987:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413104098ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.201997:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].541, 88 off55400 00000004:00080000:3.0:1746066753.201999:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721413116112ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066753.202006:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].603, 88 off60776 00000004:00080000:3.0:1746066753.202010:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413126293ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.202016:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].542, 88 off55488 00000004:00080000:3.0:1746066753.202018:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721413135296ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066753.202027:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].604, 88 off60864 00000004:00080000:3.0:1746066753.202030:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413146407ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.202036:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].605, 88 off60952 00000004:00080000:3.0:1746066753.202039:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413155848ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.202046:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].606, 88 off61040 00000004:00080000:3.0:1746066753.202049:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413165362ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.202055:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].607, 88 off61128 00000004:00080000:3.0:1746066753.202058:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721413174778ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066753.202067:0:11615:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].543, 88 off55576 00000004:00080000:3.0:1746066753.202069:0:11615:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721413185752ns, next at 665959948938ns, rc = 0 00000001:00080000:2.0:1746066753.204268:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936540 is committed 00000004:00080000:2.0:1746066753.204278:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 534 committed 00000004:00080000:2.0:1746066753.204296:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 596 committed 00000004:00080000:2.0:1746066753.204302:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 595 committed 00000004:00080000:2.0:1746066753.204303:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 594 committed 00000004:00080000:2.0:1746066753.204305:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 593 committed 00000004:00080000:2.0:1746066753.204307:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 533 committed 00000004:00080000:2.0:1746066753.204309:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 592 committed 00000004:00080000:2.0:1746066753.204310:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 532 committed 00000004:00080000:2.0:1746066753.204312:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 591 committed 00000004:00080000:2.0:1746066753.204313:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 531 committed 00000004:00080000:2.0:1746066753.204314:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 530 committed 00000004:00080000:2.0:1746066753.204316:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 529 committed 00000004:00080000:2.0:1746066753.204317:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 590 committed 00000004:00080000:2.0:1746066753.204319:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 589 committed 00000004:00080000:2.0:1746066753.204320:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 528 committed 00000004:00080000:2.0:1746066753.204322:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 527 committed 00000004:00080000:2.0:1746066753.204323:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 588 committed 00010000:00010000:1.0:1746066753.204377:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.204388:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.204395:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.204401:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984ba800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.204405:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.204412:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.204428:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.204432:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.204435:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.204440:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984ba800/0xf1867c21abfa664a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066753.204700:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.204743:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984408576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.204768:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.204805:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.204821:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.204834:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746066753.204838:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.204850:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.204860:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.204872:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.204914:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984408320 00000100:00100000:1.0:1746066753.204921:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984408320 00000100:00100000:1.0:1746066753.204953:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984408832 00000100:00100000:1.0:1746066753.204955:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984408832 00000100:00100000:1.0:1746066753.204964:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984408192 00000100:00100000:1.0:1746066753.204965:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984408192 00000100:00100000:1.0:1746066753.204973:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984408704 00000100:00100000:1.0:1746066753.204975:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984408704 00000100:00100000:1.0:1746066753.204987:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15703 00000100:00100000:1.0:1746066753.204993:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984408320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066753.205119:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066753.205122:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.205124:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.205126:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.205128:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066753.205155:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984408320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (388us total) trans 17179874366 rc 0/0 00000100:00100000:1.0:1746066753.205161:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15703 00000100:00100000:1.0:1746066753.205172:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15704 00000100:00100000:1.0:1746066753.205176:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984408832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.205226:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984408832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (404us total) trans 17179874367 rc 0/0 00000100:00100000:1.0:1746066753.205231:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15704 00000100:00100000:1.0:1746066753.205239:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15705 00000100:00100000:1.0:1746066753.205243:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3777:x1830882984408192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066753.205276:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066753.205279:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.205281:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.205282:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.205284:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066753.205299:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984408192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (447us total) trans 17179874368 rc 0/0 00000100:00100000:2.0:1746066753.205372:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15706 00000100:00100000:2.0:1746066753.205380:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984408704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.205383:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15705 00002000:00010000:2.0:1746066753.205427:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:2.0:1746066753.205430:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.205432:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066753.205433:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.205435:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:2.0:1746066753.205459:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3777:x1830882984408704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (586us total) trans 17179874369 rc 0/0 00000100:00100000:1.0:1746066753.205460:0:3777:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874361 gen 2 00000100:00100000:2.0:1746066753.205463:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15706 00000004:00080000:1.0:1746066753.205465:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb6d80, transno 17179874278 00000004:00080000:1.0:1746066753.205480:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb5180, transno 17179874279 00000004:00080000:1.0:1746066753.205482:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098480000, transno 17179874280 00000004:00080000:1.0:1746066753.205485:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d89180, transno 17179874281 00000004:00080000:1.0:1746066753.205487:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb6680, transno 17179874282 00000004:00080000:1.0:1746066753.205488:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098481500, transno 17179874283 00000004:00080000:1.0:1746066753.205490:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7b80, transno 17179874284 00000004:00080000:1.0:1746066753.205492:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098483480, transno 17179874285 00000004:00080000:1.0:1746066753.205495:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096424380, transno 17179874290 00000004:00080000:1.0:1746066753.205496:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096425180, transno 17179874291 00000004:00080000:1.0:1746066753.205498:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096424e00, transno 17179874292 00000004:00080000:1.0:1746066753.205500:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096425c00, transno 17179874293 00000004:00080000:1.0:1746066753.205502:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096424700, transno 17179874294 00000004:00080000:1.0:1746066753.205504:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096425500, transno 17179874295 00000004:00080000:1.0:1746066753.205505:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096425880, transno 17179874296 00000004:00080000:1.0:1746066753.205507:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096424a80, transno 17179874297 00000004:00080000:1.0:1746066753.205510:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd5c00, transno 17179874298 00000004:00080000:1.0:1746066753.205511:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd6a00, transno 17179874299 00000004:00080000:1.0:1746066753.205513:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd4000, transno 17179874300 00000004:00080000:1.0:1746066753.205515:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b5c00, transno 17179874301 00000004:00080000:1.0:1746066753.205518:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd4380, transno 17179874302 00000004:00080000:1.0:1746066753.205520:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd6d80, transno 17179874303 00000004:00080000:1.0:1746066753.205522:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd7480, transno 17179874304 00000004:00010000:3.0:1746066753.205523:0:11615:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008a4ed450 reply state ffff8800a7cfd400 transno 8589936540 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11615 initiator: MDT0 00000004:00080000:1.0:1746066753.205524:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095dd5f80, transno 17179874305 00000004:00080000:1.0:1746066753.205527:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78d180, transno 17179874308 00000004:00080000:1.0:1746066753.205529:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78df80, transno 17179874309 00000004:00080000:1.0:1746066753.205531:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78d500, transno 17179874310 00000004:00080000:1.0:1746066753.205533:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78e300, transno 17179874311 00000004:00080000:1.0:1746066753.205535:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78c000, transno 17179874312 00010000:00010000:3.0:1746066753.205537:0:11615:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11615 initiator: MDT0 00000004:00080000:1.0:1746066753.205538:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78dc00, transno 17179874313 00000004:00080000:1.0:1746066753.205550:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78c380, transno 17179874314 00010000:00010000:3.0:1746066753.205553:0:11615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000004:00080000:1.0:1746066753.205553:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f78d880, transno 17179874315 00010000:00010000:3.0:1746066753.205556:0:11615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:1.0:1746066753.205556:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098480e00, transno 17179874320 00000004:00080000:1.0:1746066753.205558:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7800, transno 17179874321 00000100:00100000:3.0:1746066753.205559:0:11615:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1746066753.205559:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098483800, transno 17179874322 00000004:00080000:1.0:1746066753.205561:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb4000, transno 17179874323 00000004:00080000:1.0:1746066753.205563:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb5f80, transno 17179874324 00010000:00010000:3.0:1746066753.205564:0:11615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000004:00080000:1.0:1746066753.205565:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb6300, transno 17179874325 00010000:00010000:3.0:1746066753.205566:0:11615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000004:00080000:1.0:1746066753.205567:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7480, transno 17179874326 00000004:00080000:1.0:1746066753.205570:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c7fd500, transno 17179874327 00010000:00010000:3.0:1746066753.205571:0:11615:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9200/0xf1867c21abfa6594 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d114d expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746066753.205572:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b7480, transno 17179874328 00000004:00080000:1.0:1746066753.205574:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093acb100, transno 17179874329 00000004:00080000:1.0:1746066753.205576:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b6d80, transno 17179874330 00000004:00080000:1.0:1746066753.205578:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093acb800, transno 17179874331 00000004:00080000:1.0:1746066753.205580:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ac9c00, transno 17179874332 00000004:00080000:1.0:1746066753.205582:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093ac9180, transno 17179874333 00000004:00080000:1.0:1746066753.205584:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b6300, transno 17179874334 00000004:00080000:1.0:1746066753.205586:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d0d500, transno 17179874335 00000004:00080000:1.0:1746066753.205588:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ace00, transno 17179874354 00000004:00080000:1.0:1746066753.205590:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ad180, transno 17179874355 00000004:00080000:1.0:1746066753.205593:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ae680, transno 17179874356 00000004:00080000:1.0:1746066753.205595:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958adc00, transno 17179874357 00000004:00080000:1.0:1746066753.205597:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958adf80, transno 17179874358 00000004:00080000:1.0:1746066753.205599:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958af100, transno 17179874359 00000004:00080000:1.0:1746066753.205601:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958ac000, transno 17179874360 00000100:00100000:0.0:1746066753.205602:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984409216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066753.205603:0:3777:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958aca80, transno 17179874361 00000100:00100000:1.0:1746066753.205610:0:3777:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880098fb5500 x1830882984408192/t17179874368(17179874368) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066769 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746066753.205621:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb5500/2, rc 0, transno 17179874368 00000100:00100000:1.0:1746066753.205626:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.205641:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1746066753.205642:0:11615:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066753.205653:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:500:x1830882983117184:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 8613us (9918us total) trans 8589936540 rc 0/0 00000100:00100000:0.0:1746066753.205655:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984409728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.205660:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5904 00000100:00100000:2.0:1746066753.205674:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984408448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066753.205685:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb6a00/2, rc 0, transno 17179874369 00000100:00100000:1.0:1746066753.205689:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.205694:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066753.205697:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d80000/2, rc 0, transno 17179874367 00000100:00100000:1.0:1746066753.205700:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.205707:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984408960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066753.205709:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb5880/2, rc 0, transno 17179874366 00000100:00100000:1.0:1746066753.205712:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984408320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.205714:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409216 00000100:00100000:3.0:1746066753.205717:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409216 00000100:00100000:2.0:1746066753.205722:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.205728:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984409344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.205732:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984408448 00000100:00100000:3.0:1746066753.205734:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984408448 00000100:00100000:2.0:1746066753.205737:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984409472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.205743:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984408960 00000100:00100000:3.0:1746066753.205745:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984408960 00000100:00100000:2.0:1746066753.205754:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.205755:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15707 00000100:00100000:3.0:1746066753.205760:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882984409216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.205823:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066753.205825:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:3.0:1746066753.205827:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:3.0:1746066753.205829:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:3.0:1746066753.205831:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:2.0:1746066753.206023:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984409984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.206082:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.206094:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746066753.206098:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984409600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.206111:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.206117:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984410112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.206128:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.206420:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409472 00000100:00100000:2.0:1746066753.206424:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409472 00000100:00100000:2.0:1746066753.206439:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409984 00000100:00100000:2.0:1746066753.206441:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409984 00000100:00100000:2.0:1746066753.206447:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409600 00000100:00100000:2.0:1746066753.206448:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409600 00000100:00100000:2.0:1746066753.206453:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984410112 00000100:00100000:2.0:1746066753.206455:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984410112 00000100:00100000:2.0:1746066753.206462:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15708 00000100:00100000:2.0:1746066753.206467:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3774:x1830882984408448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.206962:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746066753.206988:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746066753.206988:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984409856:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066753.206991:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.206993:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.206995:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:2.0:1746066753.206997:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066753.207026:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3774:x1830882984408448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 559us (1331us total) trans 17179874370 rc 0/0 00000100:00100000:2.0:1746066753.207032:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15708 00000100:00100000:1.0:1746066753.207039:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.207046:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409344 00000100:00100000:2.0:1746066753.207049:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409344 00010000:00010000:1.0:1746066753.207071:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11615 initiator: MDT0 00010000:00010000:1.0:1746066753.207081:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11615 initiator: MDT0 00010000:00010000:1.0:1746066753.207087:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11615 initiator: MDT0 00010000:00010000:1.0:1746066753.207093:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5899e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.207097:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11615 initiator: MDT0 00010000:00010000:1.0:1746066753.207103:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11615 initiator: MDT0 00010000:00010000:1.0:1746066753.207115:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.207118:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.207122:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11615 initiator: MDT0 00010000:00010000:1.0:1746066753.207127:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa667b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11615 initiator: MDT0 00000004:00080000:1.0:1746066753.207372:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 56 done 00000100:00100000:1.0:1746066753.207395:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409856 00000100:00100000:1.0:1746066753.207400:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409856 00000100:00100000:1.0:1746066753.207422:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15709 00000100:00100000:1.0:1746066753.207428:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3774:x1830882984408960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.207521:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15710 00000100:00100000:3.0:1746066753.207522:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984409216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1760us (1884us total) trans 21474841811 rc 0/0 00000100:00100000:2.0:1746066753.207528:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882984409472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.207529:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15707 00000100:00100000:1.0:1746066753.207534:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3774:x1830882984408960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (1810us total) trans 17179874371 rc 0/0 00000100:00100000:1.0:1746066753.207552:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15709 00000100:00100000:0.0:1746066753.207586:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746066753.207593:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:2.0:1746066753.207596:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.207598:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.207599:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:2.0:1746066753.207601:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000004:00080000:0.0:1746066753.207616:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecbb80/2, rc 0, transno 21474841811 00000100:00100000:2.0:1746066753.207623:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882984409472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (1868us total) trans 21474841812 rc 0/0 00000100:00100000:0.0:1746066753.207625:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984409216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.207653:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15711 00000100:00100000:3.0:1746066753.207659:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882984409984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.207659:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15712 00000100:00100000:2.0:1746066753.207665:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15710 00000100:00100000:1.0:1746066753.207667:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882984409600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.207678:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409728 00000100:00100000:2.0:1746066753.207681:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409728 00000100:00100000:2.0:1746066753.207690:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15713 00000100:00100000:2.0:1746066753.207695:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882984410112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.207704:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066753.207707:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066753.207709:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.207711:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066753.207712:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00002000:00010000:1.0:1746066753.207727:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00000100:00100000:3.0:1746066753.207730:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3774:x1830882984409984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1647us total) trans 21474841813 rc 0/0 00002000:00010000:1.0:1746066753.207730:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.207732:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066753.207734:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00000100:00100000:3.0:1746066753.207736:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15711 00002000:00010000:1.0:1746066753.207736:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00002000:00010000:2.0:1746066753.207741:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:2.0:1746066753.207744:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.207745:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746066753.207746:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15714 00002000:00010000:2.0:1746066753.207747:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.207749:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066753.207751:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3777:x1830882984409856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.207758:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984409600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1645us total) trans 21474841814 rc 0/0 00000100:00100000:1.0:1746066753.207765:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15712 00000100:00100000:2.0:1746066753.207770:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984410112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (1640us total) trans 21474841815 rc 0/0 00000100:00100000:2.0:1746066753.207775:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15713 00000100:00100000:1.0:1746066753.207779:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15715 00000100:00100000:1.0:1746066753.207784:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3777:x1830882984409344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.207786:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15716 00000100:00100000:2.0:1746066753.207791:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984409728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.207803:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3777:x1830882984409856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (764us total) trans 21474841816 rc 0/0 00000100:00100000:3.0:1746066753.207809:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15714 00002000:00010000:1.0:1746066753.207827:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746066753.207829:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746066753.207830:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.207832:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.207833:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:1.0:1746066753.207833:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.207835:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746066753.207836:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.207838:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066753.207839:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.207841:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:3.0:1746066753.207844:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984409088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.207861:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3777:x1830882984409344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (901us total) trans 21474841817 rc 0/0 00000100:00100000:3.0:1746066753.207866:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.207867:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15715 00000100:00100000:1.0:1746066753.207877:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984408576 00000100:00100000:1.0:1746066753.207880:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984408576 00000100:00100000:1.0:1746066753.207914:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984409088 00000100:00100000:1.0:1746066753.207916:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984409088 00000100:00100000:1.0:1746066753.207924:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15717 00000100:00100000:1.0:1746066753.207927:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882984408576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066753.207964:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066753.207966:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.207968:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00000100:00100000:0.0:1746066753.207968:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15718 00002000:00010000:1.0:1746066753.207970:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.207972:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:0.0:1746066753.207978:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984409088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.208193:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984409728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 401us (611us total) trans 21474841818 rc 0/0 00000100:00100000:2.0:1746066753.208199:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15716 00000100:00100000:1.0:1746066753.208212:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984408576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 282us (381us total) trans 17179874372 rc 0/0 00000100:00100000:0.0:1746066753.208212:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984409088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (345us total) trans 17179874373 rc 0/0 00000100:00100000:1.0:1746066753.208219:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15717 00000100:00100000:0.0:1746066753.208223:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15718 00000004:00080000:2.0:1746066753.208237:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec9500/2, rc 0, transno 21474841814 00000100:00100000:0.0:1746066753.208239:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984410240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.208241:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984409600:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066753.208253:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8380/2, rc 0, transno 21474841815 00000004:00080000:1.0:1746066753.208253:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8000/2, rc 0, transno 21474841817 00000100:00100000:2.0:1746066753.208256:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984410112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.208256:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.208258:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984409344:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066753.208263:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8e00/2, rc 0, transno 21474841812 00000100:00100000:2.0:1746066753.208266:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984409472:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066753.208269:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec9880/2, rc 0, transno 21474841816 00000100:00100000:1.0:1746066753.208272:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984409856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066753.208272:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec9f80/2, rc 0, transno 21474841818 00000004:00080000:2.0:1746066753.208273:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecb480/2, rc 0, transno 21474841813 00000100:00100000:2.0:1746066753.208276:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984409984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.208277:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984409728:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066753.208285:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb7100/2, rc 0, transno 17179874370 00000100:00100000:0.0:1746066753.208287:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984410240 00000100:00100000:2.0:1746066753.208288:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984408448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.208290:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984410240 00000004:00080000:2.0:1746066753.208295:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d81500/2, rc 0, transno 17179874371 00000100:00100000:2.0:1746066753.208298:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984408960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.208306:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15719 00000100:00100000:0.0:1746066753.208309:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984410240:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066753.208369:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fb4380/2, rc 0, transno 17179874372 00000100:00100000:3.0:1746066753.208378:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984408576:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066753.208385:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d83800/2, rc 0, transno 17179874373 00000100:00100000:3.0:1746066753.208387:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984409088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.208468:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882984410240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (210us total) trans 21474841819 rc 0/0 00000100:00100000:0.0:1746066753.208474:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15719 00000004:00080000:2.0:1746066753.208501:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed4a80/2, rc 0, transno 21474841819 00000100:00100000:2.0:1746066753.208507:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984410240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.213818:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.214145:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983117440 00000100:00100000:1.0:1746066753.214154:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983117440 00000100:00100000:1.0:1746066753.214216:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16229 00000100:00100000:1.0:1746066753.214225:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:500:x1830882983117440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066753.214251:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.214270:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11b6 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.214330:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.214343:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.214359:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.214362:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.214365:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984baa00, rc 0) 00000100:00100000:1.0:1746066753.214421:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:500:x1830882983117440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 197us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.214428:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16229 00000100:00100000:0.0:1746066753.218345:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.218428:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983117696 00000100:00100000:3.0:1746066753.218440:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983117696 00000100:00100000:3.0:1746066753.218504:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5905 00000100:00100000:3.0:1746066753.218512:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:500:x1830882983117696:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066753.218739:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:500:x1830882983117696:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 228us (400us total) trans 8589936541 rc 0/0 00000100:00100000:3.0:1746066753.218746:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5905 00000100:00100000:0.0:1746066753.250253:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.250334:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983117952 00000100:00100000:1.0:1746066753.250347:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983117952 00000100:00100000:1.0:1746066753.250423:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16230 00000100:00100000:1.0:1746066753.250432:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+7:508:x1830882983117952:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066753.250520:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.250552:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa6689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11bd expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.250635:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250648:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250659:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250672:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250678:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250683:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250800:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa669e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250812:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa669e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250818:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa669e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066753.250829:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.250920:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250924:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250928:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250931:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250935:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5899e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.250938:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250941:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250948:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066753.250950:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.250952:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250955:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5899e00/0xf1867c21abfa6690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250972:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250977:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250985:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250989:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097cc0800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.250991:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.250996:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.251001:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097855900) 00010000:00010000:1.0:1746066753.251003:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.251005:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.251010:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097cc0800/0xf1867c21abfa6697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.251045:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa6689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11bd expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.251058:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa669e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11bd expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.251064:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.251066:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066753.251068:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945a00, rc 0) 00000100:00100000:1.0:1746066753.251346:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+9:508:x1830882983117952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 914us (1882us total) trans 8589936542 rc 0/0 00000100:00100000:1.0:1746066753.251353:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16230 00000100:00100000:2.0:1746066753.256120:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.256434:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983118720 00000100:00100000:1.0:1746066753.256445:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983118720 00000100:00100000:1.0:1746066753.256507:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16231 00000100:00100000:1.0:1746066753.256515:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:512:x1830882983118720:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.256558:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.256579:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfa66ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11d2 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.256646:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.256657:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066753.256661:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983118208 00000100:00100000:0.0:1746066753.256665:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983118208 00010000:00010000:1.0:1746066753.256670:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256682:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066753.256685:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16232 00000100:00100000:0.0:1746066753.256690:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:508:x1830882983118208:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066753.256697:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066753.256700:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.256702:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066753.256703:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256708:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066753.256721:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945a00/0xf1867c21abfa669e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11bd expref: 9 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.256740:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066753.256745:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066753.256752:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7a00/0xf1867c21abfa66c1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11c4 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.256779:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066753.256793:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.256800:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066753.256807:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256815:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256821:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066753.256833:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.256943:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256950:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256956:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256961:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984bb200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.256965:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256971:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256978:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.256981:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1746066753.256984:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.256989:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984bb200/0xf1867c21abfa66cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066753.257002:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 8 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.257014:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 8 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.257019:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257024:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066753.257027:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984410368:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.257028:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257037:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257041:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b944a00 already unused, calling callback (ffffffffa0f1c690) 00000100:00100000:0.0:1746066753.257108:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.257113:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.257130:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983118464 00000100:00100000:2.0:1746066753.257134:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983118464 00000100:00100000:2.0:1746066753.257154:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16233 00000100:00100000:2.0:1746066753.257159:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:513:x1830882983118464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.257166:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.257173:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa66dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11cb expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.257219:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993600/0xf1867c21abfa66e4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066753.257226:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993600/0xf1867c21abfa66e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066753.257232:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993600/0xf1867c21abfa66e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066753.257238:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066753.257287:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa66dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11cb expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.257316:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993600/0xf1867c21abfa66e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11cb expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.257322:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.257324:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066753.257326:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993600, rc 0) 00000100:00100000:2.0:1746066753.257352:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:513:x1830882983118464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 192us (239us total) trans 8589936544 rc 0/0 00000100:00100000:2.0:1746066753.257358:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16233 00010000:00010000:1.0:1746066753.257392:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257400:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257407:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066753.257409:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.257412:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257416:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944a00/0xf1867c21abfa66b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257427:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257432:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257437:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257440:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b944800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.257442:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257447:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257455:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097855c00) 00010000:00010000:1.0:1746066753.257457:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.257458:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257461:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b944800/0xf1867c21abfa66ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.257479:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfa66ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d2 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.257483:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945e00/0xf1867c21abfa66ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d2 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.257488:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945e00, rc 0) 00000100:00100000:1.0:1746066753.257515:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:512:x1830882983118720:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1002us (1408us total) trans 8589936543 rc 301/301 00000100:00100000:1.0:1746066753.257519:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16231 00000100:00100000:2.0:1746066753.259797:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984410368:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.259820:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066753.259844:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.259916:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983118848 00000100:00100000:1.0:1746066753.259921:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983118848 00000100:00100000:1.0:1746066753.259964:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16234 00000100:00100000:1.0:1746066753.259971:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+12:513:x1830882983118848:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.259984:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.259999:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa66f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11d9 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.260069:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.260082:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066753.260088:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.260101:0:7244:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066753.260110:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066753.260388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.260421:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983118976 00000100:00100000:2.0:1746066753.260425:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983118976 00010000:00010000:2.0:1746066753.260442:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 9 pid: 7244 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.260458:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7054 00000100:00100000:2.0:1746066753.260463:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983118976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.260472:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.260476:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 9 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.260484:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 9 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.260499:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984baa00/0xf1867c21abfa6682 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11b6 expref: 9 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.260509:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.260513:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.260518:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.260523:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.260531:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.260536:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.260551:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.260560:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066753.260569:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066753.260575:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066753.260607:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983118976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 143us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.260612:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7054 00000004:02000000:0.0:1746066753.260613:0:7245:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:0.0:1746066753.260838:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].608, 88 off61216 00000004:00080000:0.0:1746066753.260846:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721471962084ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066753.260872:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].544, 88 off55664 00000004:00080000:0.0:1746066753.260875:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721471991362ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066753.260908:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].545, 88 off55752 00000004:00080000:0.0:1746066753.260911:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721472027896ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066753.260920:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].609, 88 off61304 00000004:00080000:0.0:1746066753.260922:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472039293ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066753.260930:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].610, 88 off61392 00000004:00080000:0.0:1746066753.260933:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472049731ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066753.260941:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].546, 88 off55840 00000004:00080000:0.0:1746066753.260991:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721472060482ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066753.261007:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].547, 88 off55928 00000004:00080000:0.0:1746066753.261010:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721472126426ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066753.261018:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].548, 88 off56016 00000004:00080000:0.0:1746066753.261021:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721472137611ns, next at 665959948938ns, rc = 0 00000100:00100000:2.0:1746066753.261109:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000040:00080000:0.0:1746066753.261121:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].611, 88 off61480 00000004:00080000:0.0:1746066753.261125:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472241702ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066753.261136:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].549, 88 off56104 00000004:00080000:0.0:1746066753.261138:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721472255152ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066753.261150:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].612, 88 off61568 00000004:00080000:1.0:1746066753.261171:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472287838ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.261187:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].550, 88 off56192 00000004:00080000:1.0:1746066753.261190:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721472306942ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.261201:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].613, 88 off61656 00000004:00080000:1.0:1746066753.261204:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472320811ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.261212:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].614, 88 off61744 00000004:00080000:1.0:1746066753.261215:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472331591ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.261223:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].615, 88 off61832 00000004:00080000:1.0:1746066753.261226:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472342497ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.261233:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].616, 88 off61920 00000004:00080000:1.0:1746066753.261236:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721472352832ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.261245:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].551, 88 off56280 00000004:00080000:1.0:1746066753.261247:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721472363857ns, next at 665959948938ns, rc = 0 00000100:00100000:3.0:1746066753.261673:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983119104 00000100:00100000:3.0:1746066753.261681:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983119104 00000100:00100000:3.0:1746066753.261718:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16235 00000100:00100000:3.0:1746066753.261724:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:512:x1830882983119104:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066753.261761:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.261775:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa6700 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11e0 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.261850:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.261859:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.261868:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.262340:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.262427:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983119360 00000100:00100000:3.0:1746066753.262430:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983119360 00000100:00100000:3.0:1746066753.262457:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16236 00000100:00100000:3.0:1746066753.262461:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:507:x1830882983119360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066753.262468:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.262475:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04a00/0xf1867c21abfa670e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11e7 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.262523:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262531:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262551:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262563:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262572:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262577:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262646:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262653:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262658:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066753.262665:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066753.262714:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262720:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262725:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262729:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066753.262732:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262737:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262745:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066753.262748:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746066753.262751:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066753.262755:0:7243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066753.262760:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262764:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05800/0xf1867c21abfa6723 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x11/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262804:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262808:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262812:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262816:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262820:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066753.262822:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262827:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262833:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066753.262835:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066753.262837:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262842:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa6715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262849:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262857:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262861:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262865:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066753.262867:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262871:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262876:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097cfd200) 00010000:00010000:3.0:1746066753.262878:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066753.262879:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262908:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05e00/0xf1867c21abfa671c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066753.262936:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04a00/0xf1867c21abfa670e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e7 expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.262943:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04a00/0xf1867c21abfa670e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e7 expref: 31 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.262955:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04a00, rc 0) 00000100:00100000:3.0:1746066753.263046:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:507:x1830882983119360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 583us (708us total) trans 8589936546 rc 301/301 00000100:00100000:3.0:1746066753.263053:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16236 00000001:00080000:2.0:1746066753.263235:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936545 is committed 00000004:00080000:2.0:1746066753.263242:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 542 committed 00000004:00080000:2.0:1746066753.263248:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 605 committed 00000100:00100000:3.0:1746066753.263438:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984410752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.263469:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.263489:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984410752 00000100:00100000:0.0:1746066753.263494:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984410752 00000100:00100000:3.0:1746066753.263497:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984411264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.263507:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.263519:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411264 00000100:00100000:3.0:1746066753.263520:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066753.263522:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411264 00000100:00100000:3.0:1746066753.263524:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984410624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.263535:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15720 00000100:00100000:3.0:1746066753.263537:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.263553:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984410752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.263563:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984411136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.263577:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.263597:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984410624 00000100:00100000:3.0:1746066753.263601:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984410624 00000100:00100000:3.0:1746066753.263618:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411136 00000100:00100000:3.0:1746066753.263620:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411136 00000100:00100000:3.0:1746066753.263631:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15721 00000100:00100000:3.0:1746066753.263636:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984411264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066753.263651:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066753.263654:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.263656:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.263657:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:0.0:1746066753.263659:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:0.0:1746066753.263697:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984410752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (227us total) trans 17179874374 rc 0/0 00000100:00100000:0.0:1746066753.263702:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15720 00000100:00100000:1.0:1746066753.263711:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984410496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.263714:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15722 00000100:00100000:0.0:1746066753.263718:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984410624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.263727:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984411264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (218us total) trans 17179874375 rc 0/0 00000100:00100000:1.0:1746066753.263730:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.263733:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15721 00000100:00100000:1.0:1746066753.263746:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984411008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.263751:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984410496 00002000:00010000:0.0:1746066753.263751:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746066753.263753:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984410496 00002000:00010000:0.0:1746066753.263753:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.263755:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.263756:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:0.0:1746066753.263758:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066753.263759:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.263774:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411008 00000100:00100000:3.0:1746066753.263777:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411008 00000100:00100000:1.0:1746066753.263784:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746066753.263787:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15723 00000004:00080000:2.0:1746066753.263788:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 604 committed 00000100:00100000:1.0:1746066753.263788:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984410880:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066753.263790:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 603 committed 00000100:00100000:3.0:1746066753.263791:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882984411136:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066753.263792:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 602 committed 00000004:00080000:2.0:1746066753.263793:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 541 committed 00000004:00080000:2.0:1746066753.263795:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 601 committed 00000004:00080000:2.0:1746066753.263797:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 540 committed 00000004:00080000:2.0:1746066753.263799:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 600 committed 00000004:00080000:2.0:1746066753.263800:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 539 committed 00000004:00080000:2.0:1746066753.263801:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 538 committed 00000004:00080000:2.0:1746066753.263802:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 537 committed 00000100:00100000:1.0:1746066753.263802:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746066753.263804:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 599 committed 00000004:00080000:2.0:1746066753.263805:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 598 committed 00000004:00080000:2.0:1746066753.263806:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 536 committed 00000004:00080000:2.0:1746066753.263808:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 535 committed 00000100:00100000:1.0:1746066753.263808:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984411392:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066753.263811:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 597 committed 00000100:00100000:1.0:1746066753.263819:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1746066753.263820:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936543 is committed 00000001:00080000:2.0:1746066753.263827:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936541 is committed 00000100:00100000:1.0:1746066753.263833:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984410880 00000100:00100000:1.0:1746066753.263836:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984410880 00000100:00100000:3.0:1746066753.263840:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984411136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (262us total) trans 17179874377 rc 0/0 00000100:00100000:3.0:1746066753.263845:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15723 00000100:00100000:2.0:1746066753.263845:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411392 00000100:00100000:2.0:1746066753.263848:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411392 00000100:00100000:1.0:1746066753.263851:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15724 00000100:00100000:3.0:1746066753.263853:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15725 00000100:00100000:1.0:1746066753.263855:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984410496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.263856:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984411008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.263862:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15726 00000100:00100000:2.0:1746066753.263867:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3777:x1830882984410880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.263912:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15727 00002000:00010000:3.0:1746066753.263917:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00000100:00100000:1.0:1746066753.263917:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3777:x1830882984411392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066753.263920:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.263921:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.263923:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.263925:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00002000:00010000:2.0:1746066753.263927:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066753.263930:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.263932:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066753.263933:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.263935:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:3.0:1746066753.263958:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3777:x1830882984411008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (197us total) trans 17179874378 rc 0/0 00000100:00100000:2.0:1746066753.263959:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3777:x1830882984410880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (156us total) trans 17179874380 rc 0/0 00000100:00100000:3.0:1746066753.263963:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15725 00000100:00100000:2.0:1746066753.263966:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15726 00000100:00100000:1.0:1746066753.263969:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3777:x1830882984411392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (148us total) trans 17179874381 rc 0/0 00000100:00100000:1.0:1746066753.263974:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15727 00002000:00010000:1.0:1746066753.263995:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066753.263998:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.263999:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.264001:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.264002:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066753.264016:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3777:x1830882984410496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (286us total) trans 17179874379 rc 0/0 00000100:00100000:1.0:1746066753.264020:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15724 00010000:00010000:3.0:1746066753.264028:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.264034:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066753.264036:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746066753.264038:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066753.264043:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00000004:00080000:1.0:1746066753.264045:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed4700/2, rc 0, transno 17179874380 00010000:00010000:3.0:1746066753.264047:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066753.264048:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984410880:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066753.264052:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00080000:1.0:1746066753.264056:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009677c000/2, rc 0, transno 17179874381 00010000:00010000:3.0:1746066753.264058:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00000100:00100000:1.0:1746066753.264058:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984411392:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066753.264062:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00000004:00080000:1.0:1746066753.264063:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed7800/2, rc 0, transno 17179874379 00000100:00100000:1.0:1746066753.264066:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984410496:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066753.264070:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed5f80/2, rc 0, transno 17179874378 00000100:00100000:1.0:1746066753.264072:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984411008:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746066753.264084:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962f7a00/0xf1867c21abfa66c1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 12 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066753.264084:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066753.264088:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066753.264094:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.264106:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778a00, rc 0) 00000004:00200000:1.0:1746066753.264109:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066753.264112:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066753.264121:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066753.264127:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:508:x1830882983118208:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7437us (7483us total) trans 8589936545 rc 0/0 00000100:00100000:3.0:1746066753.264132:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16232 00010000:00010000:1.0:1746066753.264138:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017400/0xf1867c21abfa66f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.264148:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.264153:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.264155:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746066753.264156:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097016a00, rc 0) 00000100:00100000:1.0:1746066753.264169:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:513:x1830882983118848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4200us (4327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.264176:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16234 00010000:00010000:2.0:1746066753.264277:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.264285:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066753.264313:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066753.264316:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066753.264327:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.264350:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa6700 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.264367:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.264373:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.264376:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746066753.264378:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04800, rc 0) 00000100:00100000:2.0:1746066753.264403:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:512:x1830882983119104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2679us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.264408:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16235 00000100:00100000:0.0:1746066753.264488:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984410624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 769us (950us total) trans 17179874376 rc 0/0 00000100:00100000:0.0:1746066753.264493:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15722 00000004:00080000:0.0:1746066753.264521:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed7480/2, rc 0, transno 17179874376 00000100:00100000:0.0:1746066753.264525:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984410624:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.264534:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed6680/2, rc 0, transno 17179874377 00000100:00100000:0.0:1746066753.264537:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984411136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.264553:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed4000/2, rc 0, transno 17179874375 00000100:00100000:0.0:1746066753.264556:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984411264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.264562:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4ed5500/2, rc 0, transno 17179874374 00000100:00100000:0.0:1746066753.264564:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984410752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.264572:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066753.264579:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984411648:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.264608:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984411520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.264711:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984411904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.264908:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984412160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.264934:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.264954:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746066753.264959:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984411776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.265009:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.265049:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984412160 00000100:00100000:0.0:1746066753.265053:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984412160 00000100:00100000:0.0:1746066753.265068:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411648 00000100:00100000:3.0:1746066753.265070:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.265070:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411648 00000100:00100000:0.0:1746066753.265082:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411904 00000100:00100000:0.0:1746066753.265084:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411904 00000100:00100000:3.0:1746066753.265089:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984412416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.265095:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15728 00000100:00100000:0.0:1746066753.265099:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3774:x1830882984412160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.265108:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.265131:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984412288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.265148:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.265168:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411776 00000100:00100000:2.0:1746066753.265171:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411776 00000100:00100000:2.0:1746066753.265188:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984412288 00000100:00100000:0.0:1746066753.265188:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882984412160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (252us total) trans 21474841820 rc 0/0 00000100:00100000:2.0:1746066753.265190:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984412288 00000100:00100000:0.0:1746066753.265193:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15728 00000100:00100000:2.0:1746066753.265202:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15729 00000100:00100000:0.0:1746066753.265207:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15730 00000100:00100000:2.0:1746066753.265208:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882984411648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.265212:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3776:x1830882984411904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.265255:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:0.0:1746066753.265258:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.265260:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066753.265261:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.265263:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00002000:00010000:2.0:1746066753.265278:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066753.265281:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00000100:00100000:0.0:1746066753.265281:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3776:x1830882984411904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (211us total) trans 21474841821 rc 0/0 00002000:00010000:2.0:1746066753.265283:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.265285:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:2.0:1746066753.265286:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066753.265286:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15730 00000100:00100000:0.0:1746066753.265296:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15731 00000100:00100000:0.0:1746066753.265300:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3774:x1830882984411776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.265309:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984411648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (299us total) trans 21474841822 rc 0/0 00000100:00100000:2.0:1746066753.265314:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15729 00000100:00100000:2.0:1746066753.265324:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15732 00000100:00100000:2.0:1746066753.265328:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3774:x1830882984412288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.265349:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00000004:00080000:2.0:1746066753.265350:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f764700/2, rc 0, transno 21474841820 00002000:00010000:0.0:1746066753.265352:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.265353:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.265355:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00000100:00100000:2.0:1746066753.265356:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f764700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984412160:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.265357:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:0.0:1746066753.265380:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3774:x1830882984411776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (405us total) trans 21474841823 rc 0/0 00000100:00100000:0.0:1746066753.265386:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15731 00002000:00010000:2.0:1746066753.265393:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066753.265395:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066753.265397:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066753.265398:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066753.265400:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:2.0:1746066753.265418:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3774:x1830882984412288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (268us total) trans 21474841824 rc 0/0 00000100:00100000:2.0:1746066753.265422:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15732 00000004:00080000:2.0:1746066753.265441:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f766d80/2, rc 0, transno 21474841823 00000100:00100000:2.0:1746066753.265443:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984411776:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066753.265448:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f766680/2, rc 0, transno 21474841824 00000100:00100000:2.0:1746066753.265451:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984412288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.265500:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066753.265518:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f764380/2, rc 0, transno 21474841821 00000100:00100000:3.0:1746066753.265520:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984411904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.265524:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746066753.265528:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984412032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.265554:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066753.265565:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54d880/2, rc 0, transno 21474841822 00000100:00100000:0.0:1746066753.265570:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984411648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.265586:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984412416 00000100:00100000:0.0:1746066753.265588:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984412416 00000100:00100000:3.0:1746066753.265589:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984412032 00000100:00100000:3.0:1746066753.265592:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984412032 00000100:00100000:3.0:1746066753.265612:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15733 00000100:00100000:3.0:1746066753.265616:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3776:x1830882984412032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.265651:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:3.0:1746066753.265653:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00000100:00100000:0.0:1746066753.265653:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15734 00002000:00010000:3.0:1746066753.265655:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.265656:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.265658:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:0.0:1746066753.265658:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882984412416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.265673:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882984412032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (118us total) trans 21474841825 rc 0/0 00000100:00100000:3.0:1746066753.265677:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15733 00000004:00080000:3.0:1746066753.265694:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011f767100/2, rc 0, transno 21474841825 00000100:00100000:3.0:1746066753.265697:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011f767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984412032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.265700:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00010000:0.0:1746066753.265700:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:0.0:1746066753.265702:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00000100:00100000:3.0:1746066753.265704:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984412544:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.265704:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066753.265706:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.265708:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066753.265716:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746066753.265731:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cec380/2, rc 0, transno 21474841826 00000100:00100000:0.0:1746066753.265731:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882984412416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (231us total) trans 21474841826 rc 0/0 00000100:00100000:3.0:1746066753.265734:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984412416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.265737:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15734 00000100:00100000:3.0:1746066753.265741:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984412544 00000100:00100000:3.0:1746066753.265743:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984412544 00000100:00100000:3.0:1746066753.265757:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15735 00000100:00100000:3.0:1746066753.265760:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3776:x1830882984412544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.265816:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.265832:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984411520 00000100:00100000:0.0:1746066753.265835:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984411520 00000100:00100000:0.0:1746066753.265851:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15736 00000100:00100000:0.0:1746066753.265854:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882984411520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.265912:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066753.265914:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.265916:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.265918:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:0.0:1746066753.265919:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:0.0:1746066753.265940:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882984411520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (123us total) trans 21474841827 rc 0/0 00000100:00100000:0.0:1746066753.265945:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15736 00000004:00080000:1.0:1746066753.266023:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54dc00/2, rc 0, transno 21474841827 00000100:00100000:1.0:1746066753.266027:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984411520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.266159:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984412544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 397us (441us total) trans 21474841828 rc 0/0 00000100:00100000:3.0:1746066753.266167:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15735 00000004:00080000:0.0:1746066753.266189:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cedf80/2, rc 0, transno 21474841828 00000100:00100000:0.0:1746066753.266193:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984412544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.266684:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.266784:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983119488 00000100:00100000:2.0:1746066753.266787:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983119488 00000100:00100000:2.0:1746066753.266808:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15737 00000100:00100000:2.0:1746066753.266811:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+5:508:x1830882983119488:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066753.266822:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.266836:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11ee expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.266859:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.266867:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.266869:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.266872:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2605056->2703359] (req 2605056->2703359) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 6 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.266919:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.266931:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 9 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.266940:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984412672:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.267808:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.268502:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.268530:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.268554:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.268567:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.268598:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.268614:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983119616 00000100:00100000:0.0:1746066753.268618:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983119616 00000100:00100000:0.0:1746066753.268640:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983119744 00000100:00100000:0.0:1746066753.268647:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983119744 00000100:00100000:0.0:1746066753.268659:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983119872 00000100:00100000:0.0:1746066753.268661:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983119872 00000100:00100000:0.0:1746066753.268669:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120000 00000100:00100000:0.0:1746066753.268670:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120000 00000100:00100000:0.0:1746066753.268678:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120128 00000100:00100000:0.0:1746066753.268680:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120128 00000100:00100000:0.0:1746066753.268690:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15738 00000100:00100000:0.0:1746066753.268696:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983119616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066753.268708:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.268720:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa6738 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11f5 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.268754:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984412800:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066753.268804:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097558d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.268819:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15739 00000100:00100000:0.0:1746066753.268824:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882983119744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066753.268830:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.268839:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa673f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d11fc expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.268865:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984412928:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066753.268876:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15740 00000100:00100000:1.0:1746066753.268902:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882983119872:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066753.268906:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066753.268908:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.268915:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017600/0xf1867c21abfa6746 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1203 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.268937:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984413056:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066753.268952:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15741 00000100:00100000:0.0:1746066753.268958:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983120000:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066753.268960:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00010000:00010000:0.0:1746066753.268963:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.268970:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa674d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d120a expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.268974:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15742 00000100:00100000:1.0:1746066753.268978:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+17:2014:x1830882983120128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.268983:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066753.268987:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984413184:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066753.268989:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097016c00/0xf1867c21abfa6754 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1211 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.269002:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.269006:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984413312:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066753.269021:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.269611:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.270376:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120256 00000100:00100000:3.0:1746066753.270381:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120256 00000100:00100000:1.0:1746066753.270520:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.271010:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15743 00000100:00100000:3.0:1746066753.271017:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882983120256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066753.271029:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.271041:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa675b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1218 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.271079:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984413440:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066753.271141:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970829c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066753.271370:0:12233:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.271397:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984412928:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066753.271422:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa673f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11fc expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066753.271430:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120384 00010000:00010000:1.0:1746066753.271431:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf800/0xf1867c21abfa673f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11fc expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066753.271434:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120384 00010000:00010000:1.0:1746066753.271440:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf800, rc 0) 00000100:00100000:2.0:1746066753.271462:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16237 00000100:00100000:1.0:1746066753.271463:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882983119744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2639us (2933us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.271466:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:512:x1830882983120384:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066753.271470:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15739 00010000:00010000:2.0:1746066753.271479:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.271490:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d121f expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.271511:0:1893:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.271522:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984413056:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066753.271538:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097017600/0xf1867c21abfa6746 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1203 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.271549:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.271558:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017600/0xf1867c21abfa6746 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1203 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.271561:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.271565:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017600, rc 0) 00000100:00100000:1.0:1746066753.271579:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882983119872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2698us (3024us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.271587:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15740 00010000:00010000:1.0:1746066753.271691:0:9591:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.271708:0:3528:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.271713:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984413312:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066753.271723:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984412800:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066753.271725:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097016c00/0xf1867c21abfa6754 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1211 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.271733:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097016c00/0xf1867c21abfa6754 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1211 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.271735:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa6738 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11f5 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.271740:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097016c00, rc 0) 00010000:00010000:0.0:1746066753.271743:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa6738 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11f5 expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.271754:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993c00, rc 0) 00000100:00100000:1.0:1746066753.271757:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882983120128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2778us (3160us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.271763:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15742 00000100:00100000:0.0:1746066753.271767:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983119616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3072us (3268us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066753.271771:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15738 00010000:00010000:1.0:1746066753.271784:0:9590:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.271791:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984412672:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.271796:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984413184:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066753.271803:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2605056->2703359] (req 2605056->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 8 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.271806:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa674d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d120a expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.271812:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bb200, rc 0) 00010000:00010000:1.0:1746066753.271813:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa674d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d120a expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.271823:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ece400, rc 0) 00000100:00100000:0.0:1746066753.271825:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+8:508:x1830882983119488:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5013us (5143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.271830:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15737 00000100:00100000:1.0:1746066753.271832:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882983120000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2876us (3265us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.271837:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15741 00010000:00010000:2.0:1746066753.272076:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.272079:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066753.272082:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b945c00, rc 0) 00000100:00100000:2.0:1746066753.272100:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:512:x1830882983120384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 633us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.272105:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16237 00000100:00100000:0.0:1746066753.273476:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.273551:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120512 00000100:00100000:2.0:1746066753.273556:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120512 00010000:00010000:2.0:1746066753.273579:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.273607:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7055 00000100:00100000:2.0:1746066753.273613:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983120512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.273624:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.273634:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.273644:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.273667:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.273669:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.273675:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.273684:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.273707:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.273714:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984413568:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.273968:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00010000:00010000:3.0:1746066753.274368:0:12255:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880095ceed80 x1830882984413440) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.274385:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa6674 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11af expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.274405:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984413440:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066753.274459:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984413568:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.274465:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa675b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1218 expref: 7 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.274467:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066753.274474:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009326c600/0xf1867c21abfa675b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1218 expref: 7 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.274480:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c600, rc 0) 00000100:00100000:2.0:1746066753.274484:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983120512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 872us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.274490:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7055 00000100:00100000:3.0:1746066753.274496:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+6:2013:x1830882983120256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3481us (4886us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066753.274501:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15743 00000100:00100000:2.0:1746066753.275158:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.275254:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.275344:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.275411:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.275422:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120640 00000100:00100000:3.0:1746066753.275425:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120640 00000100:00100000:3.0:1746066753.275442:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120768 00000100:00100000:3.0:1746066753.275444:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120768 00000100:00100000:3.0:1746066753.275457:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983120896 00000100:00100000:3.0:1746066753.275458:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983120896 00000100:00100000:3.0:1746066753.275476:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15744 00000100:00100000:3.0:1746066753.275481:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983120640:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066753.275493:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.275505:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa6769 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1226 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.275534:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984413696:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066753.275581:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.275592:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15745 00000100:00100000:3.0:1746066753.275597:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882983120768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066753.275603:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.275611:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa6770 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d122d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.275633:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984413824:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066753.275649:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.275691:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15746 00000100:00100000:0.0:1746066753.275697:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983120896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066753.275703:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.275709:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa6777 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1234 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.275728:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984413952:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066753.275745:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.276475:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.276500:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.276537:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983121024 00000100:00100000:0.0:1746066753.276552:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983121024 00000100:00100000:0.0:1746066753.277029:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983121152 00000100:00100000:0.0:1746066753.277032:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983121152 00000100:00100000:1.0:1746066753.277065:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983121280 00000100:00100000:1.0:1746066753.277068:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983121280 00000100:00100000:1.0:1746066753.277079:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15747 00000100:00100000:1.0:1746066753.277084:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983121024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.277092:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.277102:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097017400/0xf1867c21abfa677e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d123b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.277127:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984414080:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066753.277225:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15748 00000100:00100000:0.0:1746066753.277230:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983121152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066753.277235:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.277241:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfa6785 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1242 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.277261:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984414208:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066753.277447:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.277474:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15749 00000100:00100000:1.0:1746066753.277478:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983121280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.277485:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.277493:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa678c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1249 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.277513:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984414336:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066753.277538:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.277798:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.280242:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.280530:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983121536 00000100:00100000:3.0:1746066753.280551:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983121536 00002000:00100000:3.0:1746066753.280603:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2605056->2609151) req@ffff88009677ca80 x1830882983121536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.280613:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ca80 with x1830882983121536 ext(2605056->2609151) 00002000:00010000:3.0:1746066753.280619:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ca80 00000100:00100000:3.0:1746066753.280660:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4112 00000100:00100000:3.0:1746066753.280667:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+6:2015:x1830882983121536:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:0.0:1746066753.280808:0:9591:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.280837:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984414208:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066753.280869:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfa6785 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1242 expref: 29 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.280880:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecec00/0xf1867c21abfa6785 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1242 expref: 29 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.280928:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecec00, rc 0) 00010000:00010000:2.0:1746066753.280943:0:1893:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.280972:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984413696:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066753.280991:0:3528:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.281000:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa6769 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1226 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066753.281009:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984413952:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066753.281011:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326da00/0xf1867c21abfa6769 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1226 expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.281021:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326da00, rc 0) 00010000:00010000:1.0:1746066753.281025:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa6777 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1234 expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.281034:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa6777 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1234 expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.281045:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecfa00, rc 0) 00000100:00100000:2.0:1746066753.281069:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983120640:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5586us (5910us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.281073:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983120896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5376us (5727us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.281076:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15744 00000100:00100000:1.0:1746066753.281081:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15746 00000100:00100000:3.0:1746066753.281106:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+6:2015:x1830882983121536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 440us (874us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066753.281112:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4112 00010000:00010000:1.0:1746066753.281112:0:12233:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066753.281117:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2605056->2609151) req@ffff88009677ca80 x1830882983121536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.281124:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ca80 with x1830882983121536 ext(2605056->2609151) 00000100:00100000:1.0:1746066753.281124:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984414080:192.168.204.16@tcp:106: 00002000:00010000:3.0:1746066753.281126:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ca80 00010000:00010000:1.0:1746066753.281140:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097017400/0xf1867c21abfa677e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d123b expref: 26 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.281147:0:12255:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.281147:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097017400/0xf1867c21abfa677e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d123b expref: 26 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.281154:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017400, rc 0) 00000100:00100000:3.0:1746066753.281158:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984413824:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066753.281170:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa6770 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d122d expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066753.281170:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882983121024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4087us (5759us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066753.281179:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bca00/0xf1867c21abfa6770 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d122d expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066753.281179:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15747 00010000:00010000:3.0:1746066753.281185:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bca00, rc 0) 00000100:00100000:3.0:1746066753.281259:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983120768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5661us (6004us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066753.281265:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15745 00000100:00100000:0.0:1746066753.281733:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983121152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4501us (5256us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066753.281738:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15748 00000100:00100000:2.0:1746066753.281757:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.281774:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983121664 00000100:00100000:0.0:1746066753.281776:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983121664 00000100:00100000:0.0:1746066753.281911:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15750 00000100:00100000:0.0:1746066753.281917:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+13:513:x1830882983121664:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.282037:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.282051:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1250 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.282071:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.282082:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.282083:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.282087:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.282113:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 15 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.282125:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 15 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.282136:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984414464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.282207:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00002000:00010000:1.0:1746066753.282344:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066753 -> 1746066754 00000100:00100000:1.0:1746066753.282357:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984414336:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066753.282376:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa678c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1249 expref: 25 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.282390:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097017e00/0xf1867c21abfa678c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1249 expref: 25 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.282397:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097017e00, rc 0) 00000100:00100000:1.0:1746066753.282608:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983121280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4937us (5915us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.282615:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15749 00000100:00100000:2.0:1746066753.287831:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.288002:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983121920 00000100:00100000:3.0:1746066753.288012:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983121920 00000100:00100000:2.0:1746066753.288017:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066753.288066:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2699264->2703359) req@ffff88009666f100 x1830882983121920/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.288077:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666f100 with x1830882983121920 ext(2699264->2703359) 00002000:00010000:3.0:1746066753.288082:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666f100 00000100:00100000:1.0:1746066753.288091:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984414464:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.288104:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4113 00000100:00100000:3.0:1746066753.288112:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+6:2015:x1830882983121920:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066753.288123:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 14 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.288232:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993000, rc 0) 00000100:00100000:3.0:1746066753.288275:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+6:2015:x1830882983121920:12345-192.168.204.16@tcp:3:cat.0 Request processed in 163us (454us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066753.288282:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4113 00002000:00100000:3.0:1746066753.288287:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2699264->2703359) req@ffff88009666f100 x1830882983121920/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.288294:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666f100 with x1830882983121920 ext(2699264->2703359) 00002000:00010000:3.0:1746066753.288297:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666f100 00000100:00100000:1.0:1746066753.288360:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+14:513:x1830882983121664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6443us (6605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.288368:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15750 00000100:00100000:2.0:1746066753.288474:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983122048 00000100:00100000:2.0:1746066753.288478:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983122048 00010000:00010000:2.0:1746066753.288570:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.288652:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7056 00000100:00100000:2.0:1746066753.288659:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983122048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.288669:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.288686:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.288703:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.288725:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992800/0xf1867c21abfa6651 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d118c expref: 16 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.288738:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.288740:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.288747:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.288755:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.288785:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 13 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.288796:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984414592:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.289302:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.293069:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984414592:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066753.293093:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.293149:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983122048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4489us (5130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.293160:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7056 00000100:00100000:0.0:1746066753.293278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.293557:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983122176 00000100:00100000:1.0:1746066753.293564:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983122176 00000100:00100000:1.0:1746066753.293613:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15751 00000100:00100000:1.0:1746066753.293619:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:512:x1830882983122176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.293637:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.293653:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1257 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.293676:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.293678:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.293684:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.293698:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.293707:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05200, rc 0) 00000100:00100000:1.0:1746066753.293729:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:512:x1830882983122176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 111us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.293734:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15751 00000100:00100000:0.0:1746066753.294615:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.294668:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983122432 00000100:00100000:1.0:1746066753.294672:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983122432 00000100:00100000:1.0:1746066753.294728:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5906 00000100:00100000:1.0:1746066753.294733:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:508:x1830882983122432:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066753.295200:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:508:x1830882983122432:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 465us (584us total) trans 8589936547 rc 0/0 00000100:00100000:1.0:1746066753.295206:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5906 00000100:00100000:3.0:1746066753.296377:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.296496:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983122688 00000100:00100000:2.0:1746066753.296500:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983122688 00002000:00100000:2.0:1746066753.296529:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880095ced880 x1830882983122688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.296549:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced880 with x1830882983122688 ext(0->1048575) 00002000:00010000:2.0:1746066753.296554:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ced880 00000100:00100000:2.0:1746066753.296581:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4114 00000100:00100000:2.0:1746066753.296587:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983122688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066753.303266:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.305350:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983122944 00000100:00100000:3.0:1746066753.305361:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983122944 00002000:00100000:3.0:1746066753.305406:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009677c380 x1830882983122944/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.305415:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c380 with x1830882983122944 ext(0->1048575) 00002000:00010000:3.0:1746066753.305420:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c380 00000100:00100000:3.0:1746066753.305737:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4115 00000100:00100000:3.0:1746066753.305746:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882983122944:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.307356:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983122688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10766us (10977us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.307364:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4114 00002000:00100000:3.0:1746066753.307373:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880095ced880 x1830882983122688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.307382:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced880 with x1830882983122688 ext(0->1048575) 00002000:00010000:3.0:1746066753.307387:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ced880 00000100:00100000:3.0:1746066753.312768:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882983122944:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7011us (9500us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.312780:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4115 00002000:00100000:3.0:1746066753.312791:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009677c380 x1830882983122944/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.312802:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c380 with x1830882983122944 ext(0->1048575) 00002000:00010000:3.0:1746066753.312809:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677c380 00000100:00100000:1.0:1746066753.315225:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.315340:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983123072 00000100:00100000:2.0:1746066753.315348:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983123072 00000100:00100000:2.0:1746066753.315635:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15752 00000100:00100000:2.0:1746066753.315644:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+6:513:x1830882983123072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.315662:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.315681:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d125e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.315717:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.316863:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.316866:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.316871:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.316931:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.316945:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 8 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.316958:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984414720:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.317050:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.318078:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.318120:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983123200 00000100:00100000:1.0:1746066753.318131:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983123200 00000100:00100000:1.0:1746066753.318171:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15753 00000100:00100000:1.0:1746066753.318178:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:512:x1830882983123200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.318190:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.318203:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1265 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.318224:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.318227:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.318236:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 25 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.318246:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04a00, rc 0) 00000100:00100000:1.0:1746066753.318283:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:512:x1830882983123200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.318288:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15753 00000100:00100000:2.0:1746066753.319727:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984414720:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.319751:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.319764:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a53a00, rc 0) 00000100:00100000:2.0:1746066753.319790:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+7:513:x1830882983123072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4147us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.319796:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15752 00000100:00100000:0.0:1746066753.319936:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.320258:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983123328 00000100:00100000:3.0:1746066753.320263:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983123328 00010000:00010000:3.0:1746066753.320289:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 9 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.320310:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7057 00000100:00100000:3.0:1746066753.320316:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983123328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.320327:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.320347:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 9 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.320358:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 9 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.320377:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898000/0xf1867c21abfa6658 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1193 expref: 9 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.320965:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.320967:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.320975:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 6 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.320984:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 6 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.320993:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.320994:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.320998:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.321006:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.321033:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.321045:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984414848:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.321125:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 6 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.321134:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984414976:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.321151:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.322533:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984414848:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.322551:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984414976:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.322564:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.322600:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983123328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2282us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.322607:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7057 00000100:00100000:0.0:1746066753.325030:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.325132:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983123584 00000100:00100000:3.0:1746066753.325140:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983123584 00002000:00100000:3.0:1746066753.325183:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009677ed80 x1830882983123584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.325194:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ed80 with x1830882983123584 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.325199:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ed80 00000100:00100000:3.0:1746066753.325231:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4116 00000100:00100000:3.0:1746066753.325238:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2013:x1830882983123584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066753.330190:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.330568:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983123840 00000100:00100000:2.0:1746066753.330577:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983123840 00002000:00100000:2.0:1746066753.330624:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012ce06d80 x1830882983123840/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.330634:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06d80 with x1830882983123840 ext(1048576->2097151) 00002000:00010000:2.0:1746066753.330639:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce06d80 00000100:00100000:2.0:1746066753.330672:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4117 00000100:00100000:2.0:1746066753.330680:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882983123840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.332535:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2013:x1830882983123584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7291us (7506us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.332553:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4116 00002000:00100000:3.0:1746066753.332561:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009677ed80 x1830882983123584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.332576:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ed80 with x1830882983123584 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.332581:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ed80 00000100:00100000:0.0:1746066753.341327:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.341396:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983123968 00000100:00100000:2.0:1746066753.341406:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983123968 00000100:00100000:2.0:1746066753.341467:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15754 00000100:00100000:0.0:1746066753.343216:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+7:513:x1830882983123968:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066753.343237:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.343255:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d126c expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.343283:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.343290:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746066753.343291:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882983123840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12609us (13109us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1746066753.343293:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066753.343296:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.343305:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4117 00002000:00100000:2.0:1746066753.343315:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012ce06d80 x1830882983123840/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746066753.343323:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746066753.343325:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06d80 with x1830882983123840 ext(1048576->2097151) 00002000:00010000:2.0:1746066753.343329:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce06d80 00010000:00010000:0.0:1746066753.343335:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 7 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.343346:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984415104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.343403:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.347594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.347666:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983124096 00000100:00100000:3.0:1746066753.347675:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983124096 00010000:00010000:3.0:1746066753.347713:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 8 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.347743:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7058 00000100:00100000:3.0:1746066753.347750:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983124096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.347764:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.347785:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 8 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.347798:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 8 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.347826:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.347828:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.347836:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.347845:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.347881:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.347914:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984415232:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.348004:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00010000:00010000:2.0:1746066753.348232:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898c00/0xf1867c21abfa665f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d119a expref: 8 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.348251:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984415104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.348273:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 8 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.348283:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898e00, rc 0) 00000100:00100000:2.0:1746066753.348309:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:513:x1830882983123968:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6835us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.348316:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15754 00000100:00100000:0.0:1746066753.349175:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.349250:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984415232:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.349252:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983124224 00000100:00100000:2.0:1746066753.349256:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983124224 00010000:00010000:3.0:1746066753.349260:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.349277:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15755 00000100:00100000:2.0:1746066753.349282:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:512:x1830882983124224:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066753.349289:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2016:x1830882983124096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1539us (1704us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066753.349295:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066753.349296:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7058 00010000:00010000:2.0:1746066753.349305:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1273 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.349319:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.349321:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.349330:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.349339:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.349346:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cdc00, rc 0) 00000100:00100000:2.0:1746066753.349360:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:512:x1830882983124224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.349365:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15755 00000100:00100000:0.0:1746066753.354664:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.354786:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.354844:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983124480 00000100:00100000:3.0:1746066753.354854:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983124480 00000100:00100000:2.0:1746066753.354858:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983124736 00000100:00100000:2.0:1746066753.354863:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983124736 00002000:00100000:3.0:1746066753.354924:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a6680 x1830882983124480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.354924:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a6300 x1830882983124736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.354935:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6680 with x1830882983124480 ext(1048576->2097151) 00002000:00100000:2.0:1746066753.354935:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6300 with x1830882983124736 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.354940:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a6680 00002000:00010000:2.0:1746066753.354940:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a6300 00000100:00100000:2.0:1746066753.354966:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4118 00000100:00100000:2.0:1746066753.354974:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882983124736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.355015:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4119 00000100:00100000:3.0:1746066753.355022:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882983124480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.366459:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882983124736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11473us (11661us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.366471:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4118 00002000:00100000:2.0:1746066753.366483:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a6300 x1830882983124736/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.366492:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6300 with x1830882983124736 ext(1048576->2097151) 00002000:00010000:2.0:1746066753.366498:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a6300 00000100:00100000:3.0:1746066753.370156:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+8:2013:x1830882983124480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15125us (15495us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.370168:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4119 00002000:00100000:3.0:1746066753.370178:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800958a6680 x1830882983124480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.370187:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a6680 with x1830882983124480 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.370194:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a6680 00000100:00100000:1.0:1746066753.376356:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.376435:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983124864 00000100:00100000:0.0:1746066753.376445:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983124864 00000100:00100000:0.0:1746066753.376547:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15756 00000100:00100000:0.0:1746066753.376556:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:512:x1830882983124864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066753.376580:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.376597:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d127a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.376631:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.376639:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066753.376641:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066753.376645:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.376677:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.376689:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.376702:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984415360:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.377102:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.379491:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984415360:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.379525:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 26 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.379557:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecfa00, rc 0) 00000100:00100000:2.0:1746066753.379613:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:512:x1830882983124864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3057us (3265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.379622:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15756 00000100:00100000:0.0:1746066753.380933:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.381105:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983124992 00000100:00100000:3.0:1746066753.381113:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983124992 00010000:00010000:3.0:1746066753.381143:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 15 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.381178:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7059 00000100:00100000:3.0:1746066753.381184:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983124992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.381199:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.381219:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 15 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.381229:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 15 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.381874:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899800/0xf1867c21abfa6666 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a1 expref: 15 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.381935:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.381937:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.381946:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.381954:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.381988:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 25 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.382005:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984415488:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.382554:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.383526:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.383574:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983125120 00000100:00100000:2.0:1746066753.383581:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983125120 00000100:00100000:2.0:1746066753.383619:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15757 00000100:00100000:2.0:1746066753.383626:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+14:513:x1830882983125120:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.383642:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.383656:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1281 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.383676:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.383678:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.383684:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 15 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.383696:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 15 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.383704:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc400, rc 0) 00000100:00100000:2.0:1746066753.383747:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+15:513:x1830882983125120:12345-192.168.204.16@tcp:101:cat.0 Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.383756:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15757 00000100:00100000:3.0:1746066753.384642:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984415488:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.384659:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.384737:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983124992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3550us (3805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.384746:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7059 00000100:00100000:0.0:1746066753.385987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.386108:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983125376 00000100:00100000:3.0:1746066753.386113:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983125376 00002000:00100000:3.0:1746066753.386146:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880095ce2d80 x1830882983125376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.386156:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2d80 with x1830882983125376 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.386160:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce2d80 00000100:00100000:3.0:1746066753.386187:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4120 00000100:00100000:3.0:1746066753.386193:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983125376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066753.392354:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.392488:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983125632 00000100:00100000:2.0:1746066753.392498:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983125632 00002000:00100000:2.0:1746066753.392536:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012bb75180 x1830882983125632/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.392568:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75180 with x1830882983125632 ext(1048576->2097151) 00002000:00010000:2.0:1746066753.392573:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb75180 00000100:00100000:2.0:1746066753.392606:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4121 00000100:00100000:2.0:1746066753.392614:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983125632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.395988:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983125376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9784us (9994us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.396000:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4120 00002000:00100000:3.0:1746066753.396011:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880095ce2d80 x1830882983125376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.396020:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2d80 with x1830882983125376 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.396025:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce2d80 00000100:00100000:2.0:1746066753.406140:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983125632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13510us (13782us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.406154:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4121 00002000:00100000:2.0:1746066753.406170:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012bb75180 x1830882983125632/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.406179:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75180 with x1830882983125632 ext(1048576->2097151) 00002000:00010000:2.0:1746066753.406185:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bb75180 00000100:00100000:3.0:1746066753.410989:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.411035:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.411036:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983125760 00000100:00100000:2.0:1746066753.411046:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983125760 00000100:00100000:2.0:1746066753.411084:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983125888 00000100:00100000:2.0:1746066753.411086:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983125888 00000100:00100000:2.0:1746066753.411102:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15758 00000100:00100000:2.0:1746066753.411109:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983125760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.411127:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.411144:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc200/0xf1867c21abfa67cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1288 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.411200:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984415616:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066753.411277:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.411385:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15759 00000100:00100000:2.0:1746066753.411390:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983125888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.411397:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.411407:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc000/0xf1867c21abfa67d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d128f expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.411429:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984415744:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066753.411451:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.411989:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.412611:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983126144 00000100:00100000:2.0:1746066753.412618:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983126144 00000100:00100000:2.0:1746066753.412679:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16238 00000100:00100000:2.0:1746066753.412687:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:516:x1830882983126144:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066753.412706:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.412722:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa67d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1296 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.412804:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.412819:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.412830:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.412847:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.412854:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.412859:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413101:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413112:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413119:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066753.413130:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066753.413218:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413225:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413231:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413237:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413243:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d93da00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.413247:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413254:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413266:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066753.413268:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.413273:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413278:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93da00/0xf1867c21abfa67e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413321:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413327:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413332:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413336:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d93c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.413338:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413343:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413350:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098664e00) 00010000:00010000:2.0:1746066753.413352:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.413354:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413359:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93c800/0xf1867c21abfa67e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.413404:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93dc00/0xf1867c21abfa67d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 14 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.413416:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.413422:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.413424:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066753.413426:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93cc00, rc 0) 00000100:00100000:2.0:1746066753.413495:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:516:x1830882983126144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 807us (1506us total) trans 8589936548 rc 0/0 00000100:00100000:2.0:1746066753.413502:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16238 00000100:00100000:0.0:1746066753.415225:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.415329:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983126272 00000100:00100000:1.0:1746066753.415336:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983126272 00000100:00100000:1.0:1746066753.415391:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15760 00000100:00100000:1.0:1746066753.415400:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:513:x1830882983126272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.415416:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.415431:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d129d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.415458:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.415466:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.415467:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.415471:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.415512:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.415520:0:12255:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.415526:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 13 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.415553:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984415872:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.415558:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984415616:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066753.415581:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc200/0xf1867c21abfa67cb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1288 expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.415591:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc200/0xf1867c21abfa67cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1288 expref: 27 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.415599:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc200, rc 0) 00000100:00100000:2.0:1746066753.415618:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983125760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4510us (4640us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.415624:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15758 00000100:00100000:1.0:1746066753.415633:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00002000:00010000:3.0:1746066753.415772:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066753 -> 1746066754 00000100:00100000:3.0:1746066753.415789:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984415744:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066753.415812:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc000/0xf1867c21abfa67d2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d128f expref: 27 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.415822:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cc000/0xf1867c21abfa67d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d128f expref: 27 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.415836:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cc000, rc 0) 00000100:00100000:3.0:1746066753.415860:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983125888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4469us (4824us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066753.415867:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15759 00000100:00100000:1.0:1746066753.418234:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984415872:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.418264:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.418279:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05a00, rc 0) 00000100:00100000:1.0:1746066753.418342:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:513:x1830882983126272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2942us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.418349:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15760 00000100:00100000:0.0:1746066753.418717:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.418762:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.418835:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983126528 00000100:00100000:1.0:1746066753.418842:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983126528 00000100:00100000:1.0:1746066753.418908:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15761 00000100:00100000:1.0:1746066753.418915:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:512:x1830882983126528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.418930:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.418944:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12a4 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.418969:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.418973:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.418983:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.418991:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05e00, rc 0) 00000100:00100000:1.0:1746066753.419023:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:512:x1830882983126528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 108us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.419029:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15761 00000100:00100000:3.0:1746066753.419477:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983126400 00000100:00100000:3.0:1746066753.419482:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983126400 00010000:00010000:3.0:1746066753.419505:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.419551:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7060 00000100:00100000:3.0:1746066753.419559:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983126400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.419570:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.419590:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.419601:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.419621:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa666d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11a8 expref: 14 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.419633:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.419634:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.419641:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.419649:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.419656:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.419658:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.419661:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.419666:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.419692:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.419704:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984416000:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.419811:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.419825:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984416128:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.419853:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.423078:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984416000:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066753.424838:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.424921:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983126784 00000100:00100000:2.0:1746066753.424929:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983126784 00002000:00100000:2.0:1746066753.424976:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095ce0a80 x1830882983126784/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.424986:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0a80 with x1830882983126784 ext(2097152->3145727) 00002000:00010000:2.0:1746066753.424991:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce0a80 00000100:00100000:2.0:1746066753.425025:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4122 00000100:00100000:2.0:1746066753.425032:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983126784:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.425380:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984416128:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.425501:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.425669:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983126400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6109us (6953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.425678:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7060 00000100:00100000:0.0:1746066753.431838:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.435663:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983126912 00000100:00100000:2.0:1746066753.435677:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983126912 00000100:00100000:2.0:1746066753.435756:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15762 00000100:00100000:2.0:1746066753.435766:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:507:x1830882983126912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066753.435790:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.435809:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12ab expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.435838:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.435845:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.435847:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.435850:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.435879:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 7 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.435927:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 7 pid: 13363 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.435939:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984416256:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.436030:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.436500:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.436726:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983126784:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11692us (11890us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.436736:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4122 00002000:00100000:3.0:1746066753.436746:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095ce0a80 x1830882983126784/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.436755:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0a80 with x1830882983126784 ext(2097152->3145727) 00002000:00010000:3.0:1746066753.436759:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce0a80 00000100:00100000:3.0:1746066753.436777:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983127168 00000100:00100000:3.0:1746066753.436780:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983127168 00002000:00100000:3.0:1746066753.437134:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096ec9c00 x1830882983127168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.437141:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9c00 with x1830882983127168 ext(2097152->4194303) 00002000:00010000:3.0:1746066753.437145:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9c00 00000100:00100000:3.0:1746066753.437160:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4123 00000100:00100000:3.0:1746066753.437165:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983127168:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066753.437405:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.437499:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983127424 00000100:00100000:0.0:1746066753.437505:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983127424 00002000:00100000:0.0:1746066753.437530:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012bb77480 x1830882983127424/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 504/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.437550:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb77480 with x1830882983127424 ext(2097152->4194303) 00010000:00010000:0.0:1746066753.437557:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 8 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.437571:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 8 pid: 13363 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746066753.437577:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bb77480 00000100:00100000:0.0:1746066753.437617:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 907 00000100:00100000:0.0:1746066753.437624:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983127424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.445381:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984416256:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.445413:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.445430:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93dc00, rc 0) 00000100:00100000:2.0:1746066753.446105:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:507:x1830882983126912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10338us (14274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.446112:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15762 00000100:00100000:0.0:1746066753.450826:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.450943:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.451436:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983127552 00000100:00100000:3.0:1746066753.451446:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983127552 00002000:00100000:3.0:1746066753.451497:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2605056->2703359) req@ffff880096ecaa00 x1830882983127552/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.451508:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecaa00 with x1830882983127552 ext(2605056->2703359) 00010000:00010000:3.0:1746066753.451518:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.451532:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066753.451552:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096ecaa00 00000100:00100000:3.0:1746066753.451575:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 908 00000100:00100000:3.0:1746066753.451582:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983127552:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066753.451955:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983127680 00000100:00100000:2.0:1746066753.451969:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983127680 00000100:00100000:2.0:1746066753.452024:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15763 00000100:00100000:2.0:1746066753.452034:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:512:x1830882983127680:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.452050:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.452070:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12b2 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.452093:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.452099:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.452109:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746066753.452112:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.452141:0:12233:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.452151:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.452159:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009414dc00, rc 0) 00000100:00100000:2.0:1746066753.452214:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:512:x1830882983127680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 182us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.452219:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15763 00000100:00100000:1.0:1746066753.459039:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983127424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21405us (21625us total) trans 0 rc 1998848/1998848 00000100:00100000:1.0:1746066753.459051:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 907 00002000:00100000:1.0:1746066753.459064:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012bb77480 x1830882983127424/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 504/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 1998848/1998848 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.459073:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb77480 with x1830882983127424 ext(2097152->4194303) 00010000:00010000:1.0:1746066753.459084:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.459100:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00002000:00010000:1.0:1746066753.459107:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bb77480 00000100:00100000:3.0:1746066753.460050:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983127552:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8466us (9234us total) trans 17179874382 rc 0/0 00000100:00100000:3.0:1746066753.460057:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 908 00002000:00100000:3.0:1746066753.460063:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2605056->2703359) req@ffff880096ecaa00 x1830882983127552/t17179874382(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/448 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.460070:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecaa00 with x1830882983127552 ext(2605056->2703359) 00010000:00010000:3.0:1746066753.460076:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.460084:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066753.460094:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096ecaa00 00000100:00100000:0.0:1746066753.467857:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.467989:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983127808 00000100:00100000:3.0:1746066753.467998:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983127808 00010000:00010000:3.0:1746066753.468036:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.468492:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983127168:12345-192.168.204.16@tcp:3:cat.0 Request processed in 31325us (31991us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066753.468501:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4123 00002000:00100000:2.0:1746066753.468511:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096ec9c00 x1830882983127168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.468519:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9c00 with x1830882983127168 ext(2097152->4194303) 00002000:00010000:2.0:1746066753.468523:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9c00 00000100:00100000:3.0:1746066753.469089:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7061 00000100:00100000:3.0:1746066753.469102:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983127808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.469120:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.469142:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.469155:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.469181:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984bb200/0xf1867c21abfa6731 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2605056->2703359) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11ee expref: 10 pid: 13363 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.469423:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.469426:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.469434:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.469442:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.471073:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.471089:0:11928:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 27 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.471103:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984416512:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.471803:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.474488:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984416512:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.474508:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.474562:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983127808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5463us (6718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.474574:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7061 00000100:00100000:1.0:1746066753.475534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.475725:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983128064 00000100:00100000:2.0:1746066753.475734:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983128064 00002000:00100000:2.0:1746066753.476594:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (3133440->3137535) req@ffff88012bb75c00 x1830882983128064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.476610:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75c00 with x1830882983128064 ext(3133440->3137535) 00010000:00010000:2.0:1746066753.476622:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.476637:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746066753.476644:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bb75c00 00000100:00100000:2.0:1746066753.476690:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 909 00000100:00100000:2.0:1746066753.476701:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983128064:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066753.476876:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983128064:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 175us (1343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066753.476913:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 909 00002000:00100000:2.0:1746066753.476921:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (3133440->3137535) req@ffff88012bb75c00 x1830882983128064/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.476928:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75c00 with x1830882983128064 ext(3133440->3137535) 00010000:00010000:2.0:1746066753.476933:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.476944:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746066753.476949:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bb75c00 00000100:00100000:1.0:1746066753.477349:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.478050:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983128192 00000100:00100000:2.0:1746066753.478058:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983128192 00000100:00100000:2.0:1746066753.478377:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15764 00000100:00100000:2.0:1746066753.478385:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+9:513:x1830882983128192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.478399:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.478416:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12b9 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.478443:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.478449:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 10 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.478462:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 10 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.478473:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b200, rc 0) 00000100:00100000:2.0:1746066753.478534:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:513:x1830882983128192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 148us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.478551:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15764 00000100:00100000:0.0:1746066753.481096:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.481171:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.481346:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983128448 00000100:00100000:3.0:1746066753.481354:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983128448 00002000:00100000:3.0:1746066753.481398:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3133440->3145727) req@ffff880098480000 x1830882983128448/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 12776/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.481408:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480000 with x1830882983128448 ext(3133440->3145727) 00010000:00010000:3.0:1746066753.481417:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.481429:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 28 pid: 12233 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066753.481453:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098480000 00000100:00100000:1.0:1746066753.481664:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983128576 00000100:00100000:1.0:1746066753.481670:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983128576 00000100:00100000:1.0:1746066753.481822:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15765 00000100:00100000:1.0:1746066753.481833:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:507:x1830882983128576:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066753.481849:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.481868:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12c0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.481950:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 910 00000100:00100000:3.0:1746066753.481957:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983128448:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:1.0:1746066753.482099:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.482108:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.482115:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.482117:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.482121:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4145151] (req 3145728->4145151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.482158:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.482170:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 28 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.482183:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984416640:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.482324:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.482338:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 15 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.482347:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984416768:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.482762:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983128448:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 802us (1588us total) trans 17179874383 rc 0/0 00000100:00100000:3.0:1746066753.482771:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 910 00002000:00100000:3.0:1746066753.482779:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3133440->3145727) req@ffff880098480000 x1830882983128448/t17179874383(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 12776/448 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.482787:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480000 with x1830882983128448 ext(3133440->3145727) 00010000:00010000:3.0:1746066753.482793:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 30 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.482802:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 30 pid: 12233 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066753.482808:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098480000 00000100:00100000:1.0:1746066753.483185:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.485869:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984416640:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.486454:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984416768:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.486489:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4145151] (req 3145728->4145151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.486507:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009732aa00, rc 0) 00000100:00100000:1.0:1746066753.486569:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:507:x1830882983128576:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4737us (5481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.486579:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15765 00000100:00100000:0.0:1746066753.488124:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.488163:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.488238:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983128832 00000100:00100000:3.0:1746066753.488246:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983128832 00010000:00010000:3.0:1746066753.488279:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 30 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.488284:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983128704 00000100:00100000:3.0:1746066753.488321:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7062 00000100:00100000:3.0:1746066753.488328:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983128832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.488350:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.488370:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 30 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.488374:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983128704 00010000:00010000:3.0:1746066753.488379:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 30 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.488402:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d93dc00/0xf1867c21abfa680a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3133440->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ab expref: 30 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.488413:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 28 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.488423:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.488425:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.488433:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.488442:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.488450:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.488451:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.488456:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.488456:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7063 00010000:00010000:3.0:1746066753.488462:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.488463:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983128704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.488475:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.488492:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 9 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.488496:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 28 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.488507:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 28 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.488508:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984416896:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066753.488527:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d05e00/0xf1867c21abfa6803 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12a4 expref: 28 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.488557:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066753.488595:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 29 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.488598:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983128704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.488604:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7063 00000100:00100000:3.0:1746066753.488837:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984417024:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.489103:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.489243:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.489360:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983128960 00000100:00100000:2.0:1746066753.489364:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983128960 00010000:00010000:2.0:1746066753.489382:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 16 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.489457:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7064 00000100:00100000:2.0:1746066753.489463:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983128960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.489471:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.489483:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 16 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.489492:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 16 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.489505:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d05a00/0xf1867c21abfa67fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d129d expref: 16 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.489522:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.489523:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.489528:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.489547:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.489566:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.489574:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984417152:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.489767:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.493332:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984417152:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066753.493332:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066753.493353:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.493406:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984416896:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.493409:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882983128960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3945us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.493416:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984417024:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.493420:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7064 00010000:00010000:3.0:1746066753.493426:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.493443:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882983128832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5116us (5325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.493448:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7062 00000100:00100000:3.0:1746066753.493470:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983129216 00000100:00100000:3.0:1746066753.493475:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983129216 00002000:00100000:3.0:1746066753.493508:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012b54d500 x1830882983129216/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.493519:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54d500 with x1830882983129216 ext(2097152->3145727) 00002000:00010000:3.0:1746066753.493524:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54d500 00000100:00100000:3.0:1746066753.493568:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4124 00000100:00100000:3.0:1746066753.493575:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983129216:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.501791:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.501838:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.501923:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983129600 00000100:00100000:3.0:1746066753.501933:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983129600 00000100:00100000:1.0:1746066753.501933:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983129728 00000100:00100000:1.0:1746066753.501945:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983129728 00002000:00100000:3.0:1746066753.501979:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880098483480 x1830882983129600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.501986:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880098480e00 x1830882983129728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.501990:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098483480 with x1830882983129600 ext(2097152->4194303) 00002000:00100000:1.0:1746066753.501995:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480e00 with x1830882983129728 ext(3145728->4194303) 00002000:00010000:3.0:1746066753.501996:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098483480 00002000:00010000:1.0:1746066753.501999:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098480e00 00000100:00100000:3.0:1746066753.502019:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4125 00000100:00100000:3.0:1746066753.502027:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983129600:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066753.502036:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4126 00000100:00100000:1.0:1746066753.502047:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983129728:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066753.510190:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983129216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16603us (16853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.510203:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4124 00002000:00100000:3.0:1746066753.510217:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012b54d500 x1830882983129216/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.510227:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54d500 with x1830882983129216 ext(2097152->3145727) 00002000:00010000:3.0:1746066753.510233:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54d500 00010000:00010000:1.0:1746066753.510490:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746066753.512191:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983129728:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 10143us (10347us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066753.512200:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4126 00002000:00100000:1.0:1746066753.512207:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880098480e00 x1830882983129728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.512216:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480e00 with x1830882983129728 ext(3145728->4194303) 00002000:00010000:1.0:1746066753.512221:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098480e00 00000100:00100000:0.0:1746066753.521613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.521761:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983129856 00000100:00100000:1.0:1746066753.521773:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983129856 00000100:00100000:1.0:1746066753.522020:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15766 00000100:00100000:1.0:1746066753.522032:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:513:x1830882983129856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.522053:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.522073:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12c7 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.522104:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.522111:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.522113:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.522116:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.522146:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 26 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.522158:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 26 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.522171:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984417280:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.523568:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:3.0:1746066753.527024:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983129600:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 24986us (25231us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066753.527038:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4125 00002000:00100000:3.0:1746066753.527053:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880098483480 x1830882983129600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.527062:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098483480 with x1830882983129600 ext(2097152->4194303) 00000100:00100000:1.0:1746066753.527064:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984417280:192.168.204.16@tcp:104: 00002000:00010000:3.0:1746066753.527069:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098483480 00010000:00010000:1.0:1746066753.527094:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.527110:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:1.0:1746066753.527128:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:513:x1830882983129856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5099us (9140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.527135:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15766 00000100:00100000:0.0:1746066753.527235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.527339:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983130240 00000100:00100000:1.0:1746066753.527346:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983130240 00000100:00100000:1.0:1746066753.527387:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5907 00000100:00100000:1.0:1746066753.527393:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:507:x1830882983130240:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066753.527591:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:507:x1830882983130240:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 197us (356us total) trans 8589936549 rc 0/0 00000100:00100000:1.0:1746066753.527597:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5907 00000100:00100000:0.0:1746066753.528364:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.528652:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983130368 00000100:00100000:3.0:1746066753.528660:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983130368 00002000:00100000:3.0:1746066753.528697:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4145151) req@ffff88006e210380 x1830882983130368/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.528712:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210380 with x1830882983130368 ext(3145728->4145151) 00010000:00010000:3.0:1746066753.528719:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.528731:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066753.528737:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e210380 00000100:00100000:3.0:1746066753.528770:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 911 00000100:00100000:3.0:1746066753.528777:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983130368:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066753.532453:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.532581:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983130496 00000100:00100000:1.0:1746066753.532588:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983130496 00000100:00100000:1.0:1746066753.532634:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15767 00000100:00100000:1.0:1746066753.532641:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:512:x1830882983130496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.532657:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.532671:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12ce expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.532692:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066753.532697:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 30 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.532917:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 30 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.532929:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1e00, rc 0) 00000100:00100000:1.0:1746066753.532963:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:512:x1830882983130496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 322us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.532969:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15767 00000100:00100000:3.0:1746066753.545249:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983130368:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 16466us (16885us total) trans 21474841829 rc 0/0 00000100:00100000:3.0:1746066753.545259:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 911 00002000:00100000:3.0:1746066753.545269:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4145151) req@ffff88006e210380 x1830882983130368/t21474841829(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/448 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.545276:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210380 with x1830882983130368 ext(3145728->4145151) 00010000:00010000:3.0:1746066753.545284:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 30 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.545296:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 30 pid: 9591 timeout: 821 lvb_type: 0 00002000:00010000:3.0:1746066753.545302:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e210380 00000100:00100000:3.0:1746066753.549367:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.549414:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983130624 00000100:00100000:0.0:1746066753.549422:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983130624 00010000:00010000:0.0:1746066753.549451:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 30 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.549482:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7065 00000100:00100000:0.0:1746066753.549488:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983130624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.549500:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746066753.549513:0:11928:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066753 -> 1746066754 00010000:00010000:0.0:1746066753.549518:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 30 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.549530:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 30 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.549557:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009732aa00/0xf1867c21abfa681f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4145151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c0 expref: 30 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.549582:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.549584:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.549590:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.549597:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.549604:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.549605:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.549607:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.549613:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.549636:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.549646:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984417408:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066753.549716:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 15 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.549723:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984417536:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066753.549738:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.555140:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.555319:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984417408:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066753.555328:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984417536:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066753.555345:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.555376:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983130624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5888us (6016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.555384:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7065 00000100:00100000:3.0:1746066753.555629:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983130880 00000100:00100000:3.0:1746066753.555635:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983130880 00002000:00100000:3.0:1746066753.555666:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88006e213b80 x1830882983130880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.555674:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213b80 with x1830882983130880 ext(3145728->4194303) 00002000:00010000:3.0:1746066753.555678:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e213b80 00000100:00100000:3.0:1746066753.555706:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4127 00000100:00100000:3.0:1746066753.555712:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983130880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066753.556329:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.556363:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.556453:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983131264 00000100:00100000:2.0:1746066753.556457:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983131264 00002000:00100000:2.0:1746066753.556475:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88006e210700 x1830882983131264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.556482:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210700 with x1830882983131264 ext(3145728->4194303) 00002000:00010000:2.0:1746066753.556485:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e210700 00000100:00100000:2.0:1746066753.556496:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983131392 00000100:00100000:2.0:1746066753.556498:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983131392 00002000:00100000:2.0:1746066753.556506:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88006e210000 x1830882983131392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.556512:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882983131392 ext(3145728->4194303) 00002000:00010000:2.0:1746066753.556514:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210000 00000100:00100000:2.0:1746066753.556528:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4128 00000100:00100000:2.0:1746066753.556533:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983131264:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.557091:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4129 00000100:00100000:2.0:1746066753.557097:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882983131392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.568308:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983130880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 12585us (13165us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.568319:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4127 00002000:00100000:3.0:1746066753.568331:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88006e213b80 x1830882983130880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.568340:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213b80 with x1830882983130880 ext(3145728->4194303) 00002000:00010000:3.0:1746066753.568346:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e213b80 00000100:00100000:2.0:1746066753.571957:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983131264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15414us (15620us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.571967:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4128 00002000:00100000:2.0:1746066753.571976:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88006e210700 x1830882983131264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.571984:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210700 with x1830882983131264 ext(3145728->4194303) 00002000:00010000:2.0:1746066753.571989:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e210700 00000100:00100000:0.0:1746066753.577141:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.577346:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882983131392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20240us (20974us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.577356:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4129 00002000:00100000:2.0:1746066753.577366:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88006e210000 x1830882983131392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.577378:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210000 with x1830882983131392 ext(3145728->4194303) 00002000:00010000:2.0:1746066753.577383:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210000 00000100:00100000:2.0:1746066753.577410:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983131648 00000100:00100000:2.0:1746066753.577416:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983131648 00002000:00100000:2.0:1746066753.577440:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88006e210a80 x1830882983131648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.577447:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210a80 with x1830882983131648 ext(4194304->5033983) 00002000:00010000:2.0:1746066753.577450:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210a80 00000100:00100000:2.0:1746066753.577473:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4130 00000100:00100000:2.0:1746066753.577480:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983131648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066753.580694:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.580774:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983131776 00000100:00100000:1.0:1746066753.580783:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983131776 00000100:00100000:1.0:1746066753.580825:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15768 00000100:00100000:1.0:1746066753.580831:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:516:x1830882983131776:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066753.580849:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.580864:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12d5 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.580911:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.580917:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 11 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.580921:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.580922:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.580924:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.580952:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 11 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.580961:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 11 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.580971:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984417664:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.581156:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.581164:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 28 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.581171:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984417792:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.581190:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.581992:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983131648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4510us (4858us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066753.582001:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4130 00002000:00100000:0.0:1746066753.582101:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88006e210a80 x1830882983131648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.582111:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210a80 with x1830882983131648 ext(4194304->5033983) 00002000:00010000:0.0:1746066753.582115:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210a80 00000100:00100000:1.0:1746066753.584042:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984417664:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.584054:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984417792:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.584085:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3129344->3145727] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 11 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.584104:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0000, rc 0) 00000100:00100000:1.0:1746066753.584175:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:516:x1830882983131776:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3342us (3488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.584187:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15768 00000100:00100000:0.0:1746066753.587085:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.590075:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983131904 00000100:00100000:1.0:1746066753.590088:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983131904 00000100:00100000:1.0:1746066753.590161:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15769 00000100:00100000:1.0:1746066753.590170:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983131904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.590188:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.590206:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0600/0xf1867c21abfa683b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12dc expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.590230:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.590241:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0600/0xf1867c21abfa683b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12dc expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.590250:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0600/0xf1867c21abfa683b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12dc expref: 12 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.590282:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0600, rc 0) 00000100:00100000:1.0:1746066753.590335:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983131904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 166us (3257us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.590341:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15769 00000100:00100000:0.0:1746066753.590358:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.590385:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983132032 00000100:00100000:1.0:1746066753.590388:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983132032 00010000:00010000:1.0:1746066753.590408:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 29 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.590424:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7066 00000100:00100000:1.0:1746066753.590429:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983132032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.590438:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.590457:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 29 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.590467:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 29 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.590483:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009414dc00/0xf1867c21abfa6811 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b2 expref: 29 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.590492:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.590507:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983132032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.590513:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7066 00000100:00100000:1.0:1746066753.590611:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.590646:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983132288 00000100:00100000:0.0:1746066753.590651:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983132288 00000100:00100000:1.0:1746066753.590689:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15770 00000100:00100000:1.0:1746066753.590695:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983132288:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.590707:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.590713:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0e00/0xf1867c21abfa6842 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12e3 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.590721:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.590725:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0e00/0xf1867c21abfa6842 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12e3 expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.590731:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0e00/0xf1867c21abfa6842 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12e3 expref: 29 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.590738:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0e00, rc 0) 00000100:00100000:1.0:1746066753.590768:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983132288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (156us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.590773:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15770 00000100:00100000:0.0:1746066753.591946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.592353:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983132160 00000100:00100000:1.0:1746066753.592363:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983132160 00010000:00010000:1.0:1746066753.592398:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 11 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.592447:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7067 00000100:00100000:1.0:1746066753.592454:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2014:x1830882983132160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.592466:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.592482:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 11 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.592492:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 11 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.592509:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b200/0xf1867c21abfa6818 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12b9 expref: 11 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.592525:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.592527:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.592532:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.592555:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.592581:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.592591:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984417920:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066753.592680:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.595645:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.595749:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.596635:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983132672 00000100:00100000:1.0:1746066753.596646:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983132672 00002000:00100000:1.0:1746066753.596688:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88006e210e00 x1830882983132672/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.596696:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210e00 with x1830882983132672 ext(4194304->5033983) 00002000:00010000:1.0:1746066753.596701:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210e00 00000100:00100000:1.0:1746066753.596734:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4131 00000100:00100000:1.0:1746066753.596741:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983132672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.596774:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983132416 00000100:00100000:2.0:1746066753.596780:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983132416 00000100:00100000:2.0:1746066753.596810:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15771 00000100:00100000:2.0:1746066753.596816:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983132416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.596825:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.596838:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b400/0xf1867c21abfa6849 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12ea expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.596877:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984418048:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066753.596967:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.597217:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.597342:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983132928 00000100:00100000:3.0:1746066753.597346:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983132928 00002000:00100000:3.0:1746066753.597364:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3129344->3133439) req@ffff88006e212d80 x1830882983132928/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.597369:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e212d80 with x1830882983132928 ext(3129344->3133439) 00002000:00010000:3.0:1746066753.597372:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e212d80 00000100:00100000:3.0:1746066753.597401:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4132 00000100:00100000:3.0:1746066753.597407:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983132928:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.597479:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983132928:12345-192.168.204.16@tcp:3:cat.0 Request processed in 71us (264us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066753.597485:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4132 00002000:00100000:3.0:1746066753.597490:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (3129344->3133439) req@ffff88006e212d80 x1830882983132928/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.597497:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e212d80 with x1830882983132928 ext(3129344->3133439) 00002000:00010000:3.0:1746066753.597500:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e212d80 00000100:00100000:3.0:1746066753.597573:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984417920:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.597590:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.597610:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983132160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5157us (5666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.597616:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7067 00000100:00100000:2.0:1746066753.600484:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984418048:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066753.600511:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629b400/0xf1867c21abfa6849 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ea expref: 29 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.600523:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b400/0xf1867c21abfa6849 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ea expref: 29 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.600549:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b400, rc 0) 00000100:00100000:2.0:1746066753.600586:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983132416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3769us (4950us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.600593:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15771 00000100:00100000:2.0:1746066753.604637:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.604769:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983132672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8027us (9018us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066753.604778:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4131 00002000:00100000:1.0:1746066753.604786:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88006e210e00 x1830882983132672/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.604793:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e210e00 with x1830882983132672 ext(4194304->5033983) 00002000:00010000:1.0:1746066753.604798:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e210e00 00000100:00100000:0.0:1746066753.604854:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983133184 00000100:00100000:0.0:1746066753.604861:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983133184 00000100:00100000:0.0:1746066753.605229:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5908 00000100:00100000:0.0:1746066753.605237:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:512:x1830882983133184:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066753.605373:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:512:x1830882983133184:12345-192.168.204.16@tcp:35:cat.0 Request processed in 137us (741us total) trans 8589936550 rc 0/0 00000100:00100000:0.0:1746066753.605379:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5908 00000100:00100000:0.0:1746066753.611550:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.612181:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983133312 00000100:00100000:2.0:1746066753.612274:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983133312 00000100:00100000:2.0:1746066753.612313:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15772 00000100:00100000:2.0:1746066753.612320:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+16:516:x1830882983133312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066753.612333:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.612347:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12f1 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.612370:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.612377:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.612383:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.612384:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.612387:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4120575] (req 3145728->4120575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.612409:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 28 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.612420:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 28 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.612430:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984418176:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.612510:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.612518:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 17 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.612526:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984418304:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.612552:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.616180:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.616224:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.616283:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983133568 00000100:00100000:1.0:1746066753.616292:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983133568 00000100:00100000:1.0:1746066753.616327:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15773 00000100:00100000:1.0:1746066753.616333:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+18:513:x1830882983133568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.616348:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.616362:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12f8 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.616386:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.616388:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.616394:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.616399:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983133440 00000100:00100000:3.0:1746066753.616403:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983133440 00010000:00010000:1.0:1746066753.616405:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 19 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.616414:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0600, rc 0) 00010000:00010000:3.0:1746066753.616417:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 29 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.616433:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7068 00000100:00100000:3.0:1746066753.616437:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983133440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.616444:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066753.616447:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+19:513:x1830882983133568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 115us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.616452:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15773 00010000:00010000:3.0:1746066753.616460:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 29 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.616468:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 29 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.616480:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066753.616637:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa682d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ce expref: 29 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.616651:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984418176:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.616660:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984418304:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.616677:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4120575] (req 3145728->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 18 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.616684:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a400, rc 0) 00000100:00100000:2.0:1746066753.616700:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:516:x1830882983133312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4381us (5172us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.616704:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15772 00000100:00100000:3.0:1746066753.616837:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983133440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 398us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.616842:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7068 00000100:00100000:0.0:1746066753.617437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.617584:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983133696 00000100:00100000:3.0:1746066753.617589:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983133696 00010000:00010000:3.0:1746066753.617602:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 18 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.618179:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7069 00000100:00100000:3.0:1746066753.618186:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983133696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.618196:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.618209:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 18 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.618218:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 18 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.618232:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa6826 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12c7 expref: 18 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.618257:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.618258:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.618263:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.618270:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.618505:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 17 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.618516:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984418432:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.618726:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.618813:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.618870:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983133824 00000100:00100000:1.0:1746066753.618874:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983133824 00000100:00100000:1.0:1746066753.619046:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15774 00000100:00100000:1.0:1746066753.619052:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983133824:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.619061:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.619069:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa685e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d12ff expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.619090:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa685e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ff expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.619098:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0400/0xf1867c21abfa685e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12ff expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.619108:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0400, rc 0) 00000100:00100000:1.0:1746066753.619128:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983133824:12345-192.168.204.16@tcp:101:cat.0 Request processed in 77us (316us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066753.619134:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15774 00000100:00100000:3.0:1746066753.621833:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984418432:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.621851:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.621901:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2014:x1830882983133696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3696us (4445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.621911:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7069 00000100:00100000:2.0:1746066753.624748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.625510:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983134080 00000100:00100000:1.0:1746066753.625518:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983134080 00002000:00100000:1.0:1746066753.625565:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff880098482a00 x1830882983134080/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.625573:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098482a00 with x1830882983134080 ext(5029888->5033983) 00002000:00010000:1.0:1746066753.625577:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098482a00 00000100:00100000:1.0:1746066753.625596:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4133 00000100:00100000:1.0:1746066753.625603:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983134080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066753.625726:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983134080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 122us (983us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066753.625732:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4133 00002000:00100000:1.0:1746066753.625738:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff880098482a00 x1830882983134080/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.625748:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098482a00 with x1830882983134080 ext(5029888->5033983) 00002000:00010000:1.0:1746066753.625750:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098482a00 00000100:00100000:0.0:1746066753.626267:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.626323:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983134336 00000100:00100000:2.0:1746066753.626326:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983134336 00002000:00100000:2.0:1746066753.626343:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4116480->4120575) req@ffff88012b165880 x1830882983134336/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.626349:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882983134336 ext(4116480->4120575) 00002000:00010000:2.0:1746066753.626352:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165880 00000100:00100000:2.0:1746066753.626373:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4134 00000100:00100000:2.0:1746066753.626378:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983134336:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.626443:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983134336:12345-192.168.204.16@tcp:3:cat.0 Request processed in 63us (176us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066753.626452:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4134 00002000:00100000:2.0:1746066753.626456:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4116480->4120575) req@ffff88012b165880 x1830882983134336/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.626461:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882983134336 ext(4116480->4120575) 00002000:00010000:2.0:1746066753.626464:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165880 00000100:00100000:0.0:1746066753.631099:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.631252:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983134592 00000100:00100000:3.0:1746066753.631260:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983134592 00000100:00100000:3.0:1746066753.631307:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5909 00000100:00100000:3.0:1746066753.631314:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:516:x1830882983134592:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066753.631484:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:516:x1830882983134592:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 170us (391us total) trans 8589936551 rc 0/0 00000100:00100000:3.0:1746066753.631490:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5909 00000100:00100000:0.0:1746066753.645949:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.646723:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983134720 00000100:00100000:2.0:1746066753.646730:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983134720 00000100:00100000:2.0:1746066753.647512:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16239 00000100:00100000:2.0:1746066753.647520:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:522:x1830882983134720:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066753.647549:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.647564:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b800/0xf1867c21abfa6865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1306 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.647612:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647622:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647631:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647641:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647646:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647651:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647709:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647716:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647722:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:2.0:1746066753.647753:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066753.647756:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066753.647770:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647778:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647784:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647789:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647793:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647798:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647802:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.647805:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647811:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647820:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066753.647822:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.647826:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647830:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629a200/0xf1867c21abfa686c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647853:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647857:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647861:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647864:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629ae00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.647866:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647870:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647876:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098664b00) 00010000:00010000:2.0:1746066753.647878:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.647880:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647901:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6873 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.647923:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b800/0xf1867c21abfa6865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.647933:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.647939:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.647941:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066753.647943:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b600, rc 0) 00000100:00100000:2.0:1746066753.649409:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:522:x1830882983134720:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1885us (3461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.649416:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16239 00000100:00100000:0.0:1746066753.652205:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.652244:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.652273:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.652287:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.652311:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.652337:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.652372:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983134848 00000100:00100000:3.0:1746066753.652382:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983134848 00000100:00100000:3.0:1746066753.652428:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983134976 00000100:00100000:3.0:1746066753.652430:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983134976 00000100:00100000:3.0:1746066753.652444:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983135104 00000100:00100000:3.0:1746066753.652446:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983135104 00000100:00100000:3.0:1746066753.652459:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983135232 00000100:00100000:3.0:1746066753.652461:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983135232 00000100:00100000:3.0:1746066753.652469:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983135360 00000100:00100000:3.0:1746066753.652471:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983135360 00000100:00100000:3.0:1746066753.652480:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983135488 00000100:00100000:3.0:1746066753.652482:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983135488 00000100:00100000:3.0:1746066753.652496:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15775 00000100:00100000:3.0:1746066753.652502:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882983134848:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066753.652517:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.652543:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d130d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.652562:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.652564:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.652571:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.652583:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 16 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.652592:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2200, rc 0) 00000100:00100000:3.0:1746066753.652638:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882983134848:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 135us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.652653:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15776 00000100:00100000:1.0:1746066753.652670:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983134976:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066753.652686:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.652701:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1314 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.652720:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.652721:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.652728:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.652740:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.652749:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:1.0:1746066753.652780:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882983134976:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 119us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.652786:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15776 00000100:00100000:1.0:1746066753.652806:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15777 00000100:00100000:1.0:1746066753.652811:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983135104:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066753.652817:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.652823:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d131b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.652847:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15778 00000100:00100000:2.0:1746066753.652853:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15779 00000100:00100000:0.0:1746066753.652853:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882983135232:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746066753.652860:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2014:x1830882983135360:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066753.652860:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.652866:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.652868:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1322 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.652872:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfa689d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1329 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.652878:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.652879:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.652901:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 18 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.652905:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfa689d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1329 expref: 18 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.652910:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 18 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.652913:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629b800/0xf1867c21abfa689d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1329 expref: 18 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.652916:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9000, rc 0) 00010000:00010000:2.0:1746066753.652926:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b800, rc 0) 00000100:00100000:0.0:1746066753.652930:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882983135232:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 78us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.652935:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15778 00000100:00100000:2.0:1746066753.652938:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882983135360:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 80us (628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.652943:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15779 00000100:00100000:0.0:1746066753.652946:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15780 00000100:00100000:0.0:1746066753.652950:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882983135488:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066753.652956:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066753.652961:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfa68a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1330 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.652997:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984418560:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066753.653045:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00010000:00010000:1.0:1746066753.653102:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.653104:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.653109:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.653118:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.653125:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0400, rc 0) 00000100:00100000:1.0:1746066753.653145:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882983135104:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 334us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.653151:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15777 00000100:00100000:3.0:1746066753.653241:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15775 00000100:00100000:2.0:1746066753.655591:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984418560:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066753.656126:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfa68a4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1330 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.656139:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb9c00/0xf1867c21abfa68a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1330 expref: 10 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.656148:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098bb9c00, rc 0) 00000100:00100000:2.0:1746066753.656200:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983135488:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3244us (3857us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.656209:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15780 00000100:00100000:0.0:1746066753.657983:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.658060:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983135744 00000100:00100000:2.0:1746066753.658067:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983135744 00000100:00100000:2.0:1746066753.658119:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16240 00000100:00100000:2.0:1746066753.658126:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:522:x1830882983135744:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066753.658146:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.658163:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa68ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1337 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658264:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.658278:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658285:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658297:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658303:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658314:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 7/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.658344:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658356:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 9 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.658368:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984418688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.658456:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658465:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 13 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.658472:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984418816:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.658498:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658504:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.658511:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984418944:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.658531:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.658549:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 13 pid: 7244 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.658556:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984419072:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.658572:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.659918:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984418688:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.659927:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984418816:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.660304:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.660327:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.660351:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.660383:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.660460:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983136000 00000100:00100000:3.0:1746066753.660465:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983136000 00010000:00010000:3.0:1746066753.660492:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 14 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.660521:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983135872 00000100:00100000:3.0:1746066753.660523:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983135872 00010000:00010000:3.0:1746066753.660544:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.660552:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983136256 00000100:00100000:0.0:1746066753.660555:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983136256 00000100:00100000:3.0:1746066753.660556:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983136128 00000100:00100000:3.0:1746066753.660558:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983136128 00010000:00010000:3.0:1746066753.660566:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 31 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.660569:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 15 pid: 7244 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.660576:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7070 00000100:00100000:3.0:1746066753.660581:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983136000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066753.660584:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7071 00000100:00100000:0.0:1746066753.660588:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983135872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.660591:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066753.660593:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.660596:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 15 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.660596:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.660604:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 15 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.660654:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7072 00000100:00100000:1.0:1746066753.660660:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983136128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.660666:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.660670:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 31 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.660707:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7073 00000100:00100000:2.0:1746066753.660712:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983136256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.660719:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.660722:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 15 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.660929:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.660957:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d93cc00/0xf1867c21abfa67ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1296 expref: 15 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.660959:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b600/0xf1867c21abfa687a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1306 expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.660977:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066753.660982:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066753.660989:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:0.0:1746066753.660994:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.661028:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983135872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 438us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.661035:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7071 00010000:00010000:1.0:1746066753.661143:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 31 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.661154:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.661157:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.661162:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.661167:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.661198:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983136128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 538us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.661204:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7072 00010000:00010000:1.0:1746066753.661260:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa6707 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11e0 expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.661272:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984418944:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.661280:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984419072:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.661304:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.661355:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066753.661358:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.661364:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.661369:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.661385:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983136000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 803us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.661393:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7070 00010000:00010000:2.0:1746066753.661438:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 13 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.661453:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097016a00/0xf1867c21abfa66f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11d9 expref: 13 pid: 7244 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.661463:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.661467:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.661473:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.661480:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.661505:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.661524:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983136256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 811us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.661530:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7073 00010000:00010000:1.0:1746066753.661632:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.661638:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.661658:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.661784:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629be00/0xf1867c21abfa68ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1337 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.661796:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1337 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.661802:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.661805:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066753.661807:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ae00, rc 0) 00000100:00100000:1.0:1746066753.661869:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:522:x1830882983135744:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3742us (3890us total) trans 8589936552 rc 0/0 00000100:00100000:1.0:1746066753.661875:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16240 00000100:00100000:0.0:1746066753.664603:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.664680:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983136512 00000100:00100000:1.0:1746066753.664690:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983136512 00000100:00100000:1.0:1746066753.664750:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16241 00000100:00100000:1.0:1746066753.664759:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:522:x1830882983136512:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066753.664785:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.664789:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066753.664815:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa68b2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1337 expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.664834:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.664838:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.664848:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa68c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d133e expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.664989:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.665002:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.665010:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.665021:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.665118:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0a00/0xf1867c21abfa68c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.665135:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.665141:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.665143:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066753.665145:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1800, rc 0) 00000100:00100000:1.0:1746066753.665194:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:522:x1830882983136512:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 436us (600us total) trans 8589936553 rc 0/0 00000100:00100000:1.0:1746066753.665200:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16241 00000100:00100000:0.0:1746066753.667855:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.668070:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983136640 00000100:00100000:1.0:1746066753.668080:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983136640 00000100:00100000:1.0:1746066753.668158:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16242 00000100:00100000:1.0:1746066753.668166:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:522:x1830882983136640:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066753.668332:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.668354:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a400/0xf1867c21abfa68d5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1345 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.668469:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a400/0xf1867c21abfa68d5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1345 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.668483:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a400/0xf1867c21abfa68d5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1345 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.668500:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.668503:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.668506:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357a400, rc 0) 00000100:00100000:1.0:1746066753.668575:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:522:x1830882983136640:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 409us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.668581:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16242 00000100:00100000:0.0:1746066753.672514:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.672559:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.672585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.672607:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.672623:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.672629:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983136768 00000100:00100000:1.0:1746066753.672639:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983136768 00000100:00100000:0.0:1746066753.672646:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.672681:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983136896 00000100:00100000:1.0:1746066753.672683:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983136896 00000100:00100000:1.0:1746066753.672697:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137024 00000100:00100000:1.0:1746066753.672698:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137024 00000100:00100000:1.0:1746066753.672707:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137152 00000100:00100000:1.0:1746066753.672709:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137152 00000100:00100000:1.0:1746066753.672717:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137280 00000100:00100000:1.0:1746066753.672719:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137280 00000100:00100000:1.0:1746066753.672727:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137408 00000100:00100000:1.0:1746066753.672729:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137408 00000100:00100000:1.0:1746066753.672740:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15781 00000100:00100000:1.0:1746066753.672747:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983136768:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:2.0:1746066753.672755:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15782 00000100:00100000:2.0:1746066753.672761:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983136896:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066753.672793:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.672793:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.672809:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.672809:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.672817:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.672817:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 17 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.672824:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.672825:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.672829:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.672829:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.672831:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.672831:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.672834:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.672834:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.672862:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.672862:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.672873:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.672873:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.672903:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984419200:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.672903:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984419328:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.672969:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15783 00000100:00100000:3.0:1746066753.672976:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983137024:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:3.0:1746066753.672991:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.672999:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 17 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.673000:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.673007:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.673007:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 17 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746066753.673014:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.673015:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984419456:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.673019:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.673020:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.673022:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.673035:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673036:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.673043:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 27 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.673043:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 16 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.673050:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984419712:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.673055:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984419584:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.673062:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363540 going to sleep for 11 seconds 00010000:00010000:3.0:1746066753.673078:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066753.673080:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15784 00010000:00010000:3.0:1746066753.673085:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 11 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746066753.673085:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983137152:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746066753.673092:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984419840:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.673099:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673109:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.673112:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673115:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 17 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.673119:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 9 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.673122:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 16 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.673126:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984419968:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.673126:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.673127:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.673129:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.673137:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38540 going to sleep for 11 seconds 00010000:00010000:1.0:1746066753.673141:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 16 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673147:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 16 pid: 12255 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.673155:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984420096:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.673174:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 17 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.673184:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 17 pid: 13363 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746066753.673191:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984420224:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.673209:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 27 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673215:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 27 pid: 12255 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.673221:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984420352:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.673231:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.673247:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15785 00000100:00100000:1.0:1746066753.673252:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983137280:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066753.673267:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673276:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673283:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673289:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066753.673291:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066753.673292:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673307:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673314:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 16 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.673322:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984420480:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.673322:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15786 00000100:00100000:0.0:1746066753.673338:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983137408:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066753.673342:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.673349:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.673352:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.673356:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984420608:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066753.673360:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 9 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.673366:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460840 going to sleep for 11 seconds 00010000:00010000:0.0:1746066753.673366:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066753.673367:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066753.673368:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.673382:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 9 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.673389:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 9 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.673402:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984420736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.673418:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00010000:00010000:2.0:1746066753.673917:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.673925:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 11 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.673932:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984420864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.673956:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 9 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.673963:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 9 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.673970:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984420992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.673984:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.676772:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984419328:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.676784:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984419456:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.682494:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.682691:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984420096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.682762:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984420480:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.682773:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984420608:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.682795:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.682799:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984420736:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066753.682819:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.682831:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984419712:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.682839:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984420224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.682850:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984420352:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.682852:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.682853:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.682869:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066753.682874:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.682874:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138688 00000100:00100000:1.0:1746066753.682879:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138688 00000100:00100000:0.0:1746066753.682907:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.682920:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137920 00000100:00100000:2.0:1746066753.682924:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137920 00002000:00100000:1.0:1746066753.682933:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3129344->3145727) req@ffff88012c493b80 x1830882983138688/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 16872/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066753.682933:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746066753.682942:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493b80 with x1830882983138688 ext(3129344->3145727) 00010000:00010000:2.0:1746066753.682943:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 17 pid: 12255 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.682947:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.682948:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.682959:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.682959:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:1.0:1746066753.682966:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c493b80 00000100:00100000:3.0:1746066753.683103:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984419584:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.683113:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984419840:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.683121:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984419968:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.683136:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.683197:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137664 00000100:00100000:2.0:1746066753.683201:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137664 00000100:00100000:1.0:1746066753.683202:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138304 00000100:00100000:1.0:1746066753.683206:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138304 00000100:00100000:0.0:1746066753.683212:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138432 00000100:00100000:0.0:1746066753.683216:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138432 00010000:00010000:1.0:1746066753.683220:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746066753.683233:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137792 00000100:00100000:1.0:1746066753.683235:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137792 00010000:00010000:0.0:1746066753.683238:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 19 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.683244:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 28 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.683256:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138048 00000100:00100000:0.0:1746066753.683258:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138048 00000100:00100000:1.0:1746066753.683259:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7074 00010000:00010000:0.0:1746066753.683266:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 18 pid: 13363 timeout: 821 lvb_type: 1 00000100:00100000:1.0:1746066753.683267:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:2014:x1830882983137920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.683277:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066753.683278:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7075 00000100:00100000:0.0:1746066753.683284:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882983138304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.683293:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 19 pid: 12255 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.683294:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.683302:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 19 pid: 12255 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.683311:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746066753.683318:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cc400/0xf1867c21abfa67c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1281 expref: 19 pid: 12255 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.683326:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746066753.683335:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066753.683343:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0400/0xf1867c21abfa688f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d131b expref: 12 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066753.683360:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.683373:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983137920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.683379:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7074 00000100:00100000:0.0:1746066753.683386:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882983138304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 101us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.683392:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7075 00000100:00100000:1.0:1746066753.683396:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7076 00000100:00100000:1.0:1746066753.683401:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983138432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.683407:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066753.683407:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7077 00000100:00100000:0.0:1746066753.683412:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983137792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.683415:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 17 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.683419:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.683422:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 17 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.683427:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 28 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.683436:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 28 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.683437:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800958a0600/0xf1867c21abfa6857 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4128768->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f8 expref: 17 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.683445:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066753.683447:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a03cdc00/0xf1867c21abfa67b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1273 expref: 28 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.683455:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.683460:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983138432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.683465:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7076 00000100:00100000:0.0:1746066753.683471:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983137792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.683477:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7078 00000100:00100000:0.0:1746066753.683481:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7077 00000100:00100000:1.0:1746066753.683482:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882983138048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.683488:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.683494:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 18 pid: 13363 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746066753.683506:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 18 pid: 13363 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746066753.683515:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098bb9000/0xf1867c21abfa6896 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1322 expref: 18 pid: 13363 timeout: 821 lvb_type: 1 00010000:00010000:1.0:1746066753.683523:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.683526:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.683551:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138560 00000100:00100000:1.0:1746066753.683554:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2014:x1830882983138048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.683554:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138560 00000100:00100000:1.0:1746066753.683560:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7078 00010000:00010000:0.0:1746066753.683565:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 28 pid: 12255 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.683792:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 18 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.684632:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7079 00000100:00100000:3.0:1746066753.684640:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983138560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.684649:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.684662:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 28 pid: 12255 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.684672:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 28 pid: 12255 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.684685:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa67bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d127a expref: 28 pid: 12255 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.684700:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.684702:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.684706:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684714:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684738:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.684759:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983138560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.684770:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7079 00000100:00100000:3.0:1746066753.684784:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7080 00000100:00100000:3.0:1746066753.684789:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983137664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.684797:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.684811:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 15 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.684819:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 15 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.684831:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993000/0xf1867c21abfa6793 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1250 expref: 15 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.684841:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.684855:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983137664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.684860:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7080 00010000:00010000:3.0:1746066753.684909:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684917:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684933:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684940:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684948:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684954:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2de00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066753.684959:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684967:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684976:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.684982:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2de00/0xf1867c21abfa68f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.685139:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.685152:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983137536 00000100:00100000:0.0:1746066753.685155:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983137536 00010000:00010000:0.0:1746066753.685168:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 17 pid: 12255 timeout: 821 lvb_type: 1 00000100:00100000:0.0:1746066753.685181:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7081 00000100:00100000:0.0:1746066753.685186:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983137536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.685191:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066753.685198:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 17 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066753.685205:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 17 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066753.685215:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa6881 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d130d expref: 17 pid: 12255 timeout: 821 lvb_type: 1 00010000:00010000:0.0:1746066753.685222:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.685234:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983137536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.685240:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7081 00000100:00100000:0.0:1746066753.685265:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.685274:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138176 00000100:00100000:0.0:1746066753.685276:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138176 00010000:00010000:0.0:1746066753.685284:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.685293:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7082 00000100:00100000:0.0:1746066753.685297:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983138176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.685303:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066753.685310:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685317:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685327:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d05200/0xf1867c21abfa679a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1257 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685335:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.685336:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.685339:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685345:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685364:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.685374:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983138176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.685379:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7082 00010000:00010000:0.0:1746066753.685393:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685400:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685411:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685417:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685423:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685428:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357a600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066753.685430:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685437:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685450:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685456:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009357a600/0xf1867c21abfa68dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.685481:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983136768:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12735us (12979us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.685488:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15781 00000100:00100000:0.0:1746066753.685518:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.685549:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.685558:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138944 00000100:00100000:0.0:1746066753.685561:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138944 00010000:00010000:0.0:1746066753.685571:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 11 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.685581:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7083 00000100:00100000:0.0:1746066753.685586:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983138944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.685593:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066753.685601:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 11 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685609:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 11 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685624:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898e00/0xf1867c21abfa67af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d126c expref: 11 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685631:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.685632:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.685635:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685641:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.685658:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.685669:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983137152:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12583us (13060us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.685669:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983138944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 83us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.685674:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7083 00000100:00100000:3.0:1746066753.685675:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15784 00010000:00010000:3.0:1746066753.685698:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685705:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685716:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685722:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685729:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685734:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066753.685736:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685742:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685751:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.685757:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800960f2400/0xf1867c21abfa68ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.685759:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.685777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.685785:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983137024:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12811us (13200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.685786:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983139072 00000100:00100000:0.0:1746066753.685788:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983139072 00000100:00100000:3.0:1746066753.685791:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15783 00010000:00010000:0.0:1746066753.685797:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 10 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.685803:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983139200 00000100:00100000:3.0:1746066753.685805:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983139200 00000100:00100000:0.0:1746066753.685807:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7084 00000100:00100000:0.0:1746066753.685811:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983139072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.685815:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685816:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066753.685822:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 10 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:3.0:1746066753.685824:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7085 00000100:00100000:3.0:1746066753.685828:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983139200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066753.685830:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 10 pid: 3528 timeout: 821 lvb_type: 1 00010000:00010000:3.0:1746066753.685833:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.685837:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.685841:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066753.685843:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 27 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:0.0:1746066753.685851:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983139072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 40us (92us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066753.685853:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066753.685855:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7084 00000100:00100000:3.0:1746066753.685860:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983139200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 32us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.685865:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7085 00000100:00100000:3.0:1746066753.685879:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983138816 00000100:00100000:3.0:1746066753.685896:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983138816 00002000:00100000:3.0:1746066753.685933:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4120575) req@ffff88012c490e00 x1830882983138816/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.685942:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490e00 with x1830882983138816 ext(3145728->4120575) 00010000:00010000:3.0:1746066753.685948:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 14 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.685948:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 912 00000100:00100000:0.0:1746066753.685952:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066753.685957:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 14 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.685958:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983138688:12345-192.168.204.16@tcp:4:cat.0 00002000:00010000:3.0:1746066753.685963:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c490e00 00000100:00100000:1.0:1746066753.685978:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983139328 00000100:00100000:3.0:1746066753.685984:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 913 00000100:00100000:1.0:1746066753.685984:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983139328 00000100:00100000:3.0:1746066753.685989:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983138816:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746066753.686003:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.686022:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7086 00000100:00100000:1.0:1746066753.686026:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983139328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.686033:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.686043:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.686052:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 10 pid: 9590 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.686068:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.686069:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.686073:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.686081:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.686095:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.686123:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983139328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.686128:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7086 00010000:00010000:2.0:1746066753.686168:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa67a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1265 expref: 26 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.686180:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984419200:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.686188:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1a00/0xf1867c21abfa6888 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1314 expref: 9 pid: 3528 timeout: 821 lvb_type: 1 00000100:00100000:2.0:1746066753.686194:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984420864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.686200:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa67a1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d125e expref: 11 pid: 9590 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.686204:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984420992:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.686218:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686222:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686226:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686235:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686239:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686243:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686247:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629b800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066753.686250:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686253:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686260:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.686264:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629b800/0xf1867c21abfa68e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.686299:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983136896:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 13539us (13741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.686304:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15782 00000100:00100000:2.0:1746066753.687223:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983138688:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1265us (4737us total) trans 17179874384 rc 0/0 00000100:00100000:2.0:1746066753.687230:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 912 00002000:00100000:2.0:1746066753.687237:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3129344->3145727) req@ffff88012c493b80 x1830882983138688/t17179874384(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 16872/448 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.687244:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493b80 with x1830882983138688 ext(3129344->3145727) 00010000:00010000:2.0:1746066753.687251:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.687260:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00002000:00010000:2.0:1746066753.687265:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c493b80 00000100:00100000:2.0:1746066753.692665:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.692766:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983139456 00000100:00100000:1.0:1746066753.692777:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983139456 00010000:00010000:1.0:1746066753.692814:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.692849:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7087 00000100:00100000:1.0:1746066753.692857:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983139456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.692872:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.692917:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.692928:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.692951:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa6834 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3129344->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12d5 expref: 10 pid: 9591 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.692977:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.692979:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.692984:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.692992:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.693019:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066753.693035:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.693046:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.693065:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.693068:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882983139456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 211us (414us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066753.693072:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.693075:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7087 00010000:00010000:0.0:1746066753.693079:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.693085:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb8c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066753.693089:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.693100:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.693110:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.693116:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098bb8c00/0xf1867c21abfa68ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066753.693159:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2015:x1830882983137408:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 19822us (20511us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066753.693167:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15786 00000100:00100000:0.0:1746066753.695316:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983138816:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9318us (9788us total) trans 21474841830 rc 0/0 00000100:00100000:0.0:1746066753.695326:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 913 00002000:00100000:0.0:1746066753.695336:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4120575) req@ffff88012c490e00 x1830882983138816/t21474841830(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/448 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.695345:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490e00 with x1830882983138816 ext(3145728->4120575) 00010000:00010000:0.0:1746066753.695353:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:0.0:1746066753.695367:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 821 lvb_type: 0 00002000:00010000:0.0:1746066753.695374:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c490e00 00000100:00100000:0.0:1746066753.697818:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.698156:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983139584 00000100:00100000:1.0:1746066753.698166:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983139584 00010000:00010000:1.0:1746066753.698199:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.698280:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7088 00000100:00100000:1.0:1746066753.698289:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983139584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.698302:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066753.698318:0:11928:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066753 -> 1746066754 00010000:00010000:1.0:1746066753.698324:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.698335:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.698356:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a400/0xf1867c21abfa6850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4128767] (req 3145728->4120575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d12f1 expref: 16 pid: 12233 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.698370:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.698372:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.698375:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.698384:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.698411:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.698453:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983139584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.698462:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7088 00010000:00010000:2.0:1746066753.698510:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698522:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698545:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698552:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698558:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698564:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129d2da00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066753.698568:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698575:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698585:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.698590:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2da00/0xf1867c21abfa68f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066753.698640:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983137280:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 25387us (26015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.698648:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15785 00000100:00100000:2.0:1746066753.700548:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.701617:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983139840 00000100:00100000:1.0:1746066753.701626:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983139840 00000100:00100000:1.0:1746066753.701679:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16243 00000100:00100000:1.0:1746066753.701687:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:522:x1830882983139840:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:1.0:1746066753.701735:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.701759:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a400/0xf1867c21abfa68d5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1345 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.701773:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.701777:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.701804:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.701816:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.701822:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.701827:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.702048:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 29 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.702060:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 29 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.702076:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984421120:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.702428:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.702436:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 11 pid: 7245 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.702445:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984421248:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.702469:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.704016:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984421120:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.704027:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984421248:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.704044:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.704353:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.704416:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.704472:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140096 00000100:00100000:1.0:1746066753.704477:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140096 00000100:00100000:2.0:1746066753.704576:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983139968 00000100:00100000:2.0:1746066753.704580:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983139968 00010000:00010000:2.0:1746066753.704596:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.704624:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7089 00000100:00100000:2.0:1746066753.704630:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983139968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.704640:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.704645:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.704653:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.704670:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b945c00/0xf1867c21abfa6762 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d121f expref: 30 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.704682:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.704687:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.704693:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.704723:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983139968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.704729:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7089 00010000:00010000:1.0:1746066753.704802:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 12 pid: 7245 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.704826:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7090 00000100:00100000:1.0:1746066753.704831:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983140096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066753.704839:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066753.704842:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 12 pid: 7245 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.704854:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 12 pid: 7245 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.704866:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778a00/0xf1867c21abfa66c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11c4 expref: 12 pid: 7245 timeout: 821 lvb_type: 0 00010000:00010000:1.0:1746066753.704874:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.704877:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.704904:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.704910:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.704925:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066753.704943:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983140096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.704948:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7090 00010000:00010000:1.0:1746066753.704966:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.704971:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000040:00080000:1.0:1746066753.705202:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].617, 88 off62008 00000004:00080000:1.0:1746066753.705208:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721916324478ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.705231:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].552, 88 off56368 00000004:00080000:1.0:1746066753.705234:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721916350218ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.705266:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].553, 88 off56456 00000004:00080000:1.0:1746066753.705269:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721916385594ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.705512:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].618, 88 off62096 00000004:00080000:1.0:1746066753.705517:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721916633502ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.705551:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].619, 88 off62184 00000004:00080000:1.0:1746066753.705555:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721916671174ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.705566:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].554, 88 off56544 00000004:00080000:1.0:1746066753.705570:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721916686717ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.706279:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].555, 88 off56632 00000004:00080000:1.0:1746066753.706283:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721917399746ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.706290:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].556, 88 off56720 00000004:00080000:1.0:1746066753.706292:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721917408974ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.706300:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].620, 88 off62272 00000004:00080000:1.0:1746066753.706302:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721917418648ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.706319:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].557, 88 off56808 00000004:00080000:1.0:1746066753.706322:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721917438741ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.706328:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].621, 88 off62360 00000004:00080000:1.0:1746066753.706330:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721917446881ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.706336:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].558, 88 off56896 00000004:00080000:1.0:1746066753.706338:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721917455264ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.706348:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].622, 88 off62448 00000004:00080000:1.0:1746066753.706351:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721917467498ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.706366:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].623, 88 off62536 00000004:00080000:1.0:1746066753.706368:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721917484928ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.706374:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].624, 88 off62624 00000004:00080000:1.0:1746066753.706377:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721917493301ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.706384:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].625, 88 off62712 00000004:00080000:1.0:1746066753.706387:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721917503752ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.706395:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].559, 88 off56984 00000004:00080000:1.0:1746066753.706398:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721917515172ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066753.707454:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936554 is committed 00000004:00080000:3.0:1746066753.707461:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 550 committed 00000004:00080000:3.0:1746066753.707501:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 614 committed 00000004:00080000:3.0:1746066753.707515:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 613 committed 00000004:00080000:3.0:1746066753.707516:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 612 committed 00000004:00080000:3.0:1746066753.707517:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 611 committed 00000004:00080000:3.0:1746066753.707519:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 549 committed 00000004:00080000:3.0:1746066753.707521:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 610 committed 00000004:00080000:3.0:1746066753.707522:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 548 committed 00000004:00080000:3.0:1746066753.707523:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 609 committed 00000004:00080000:3.0:1746066753.707525:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 547 committed 00000004:00080000:3.0:1746066753.707526:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 546 committed 00000004:00080000:3.0:1746066753.707528:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 545 committed 00000004:00080000:3.0:1746066753.707529:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 608 committed 00000004:00080000:3.0:1746066753.707539:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 607 committed 00000004:00080000:3.0:1746066753.707540:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 544 committed 00000004:00080000:3.0:1746066753.707542:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 543 committed 00000004:00080000:3.0:1746066753.707543:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 606 committed 00000100:00100000:2.0:1746066753.707829:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984421376:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1746066753.707943:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936551 is committed 00000001:00080000:3.0:1746066753.707947:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936550 is committed 00000100:00100000:1.0:1746066753.707988:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984421504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.708010:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.708031:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.708058:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984421376 00000100:00100000:1.0:1746066753.708059:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984421504 00000100:00100000:2.0:1746066753.708064:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984421376 00000100:00100000:1.0:1746066753.708064:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984421504 00000100:00100000:1.0:1746066753.708095:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15787 00000100:00100000:1.0:1746066753.708101:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3775:x1830882984421504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.708189:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984421632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.708213:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.708269:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984421888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.708820:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984421632 00000100:00100000:2.0:1746066753.708823:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984421632 00000100:00100000:0.0:1746066753.708834:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.708839:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15788 00000100:00100000:2.0:1746066753.708844:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3774:x1830882984421376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.708853:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.708867:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066753.708871:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984421760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.708905:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.708916:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.708923:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:3775:x1830882984421504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 822us (891us total) trans 21474841831 rc 0/0 00000100:00100000:1.0:1746066753.708930:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15787 00000100:00100000:0.0:1746066753.708930:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.708938:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422144 00000100:00100000:2.0:1746066753.708940:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422144 00000100:00100000:0.0:1746066753.708941:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.708944:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984421760 00000100:00100000:1.0:1746066753.708946:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984421760 00000100:00100000:2.0:1746066753.708954:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422272 00000100:00100000:2.0:1746066753.708956:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422272 00000100:00100000:0.0:1746066753.708957:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.708959:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15789 00000100:00100000:2.0:1746066753.708963:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422656 00000100:00100000:1.0:1746066753.708963:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984421632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.708964:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984423168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.708965:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422656 00000100:00100000:2.0:1746066753.708975:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15790 00000100:00100000:0.0:1746066753.708976:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.708979:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984422144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.708983:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066753.708986:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.709000:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.709006:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984423296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.709015:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3776:x1830882984421632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (801us total) trans 21474841832 rc 0/0 00000100:00100000:0.0:1746066753.709017:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.709020:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15789 00002000:00010000:2.0:1746066753.709029:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:1.0:1746066753.709030:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984423168 00002000:00010000:2.0:1746066753.709032:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00000100:00100000:1.0:1746066753.709032:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984423168 00002000:00010000:2.0:1746066753.709034:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066753.709036:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066753.709038:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000004:00080000:0.0:1746066753.709039:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c493480/2, rc 0, transno 21474841832 00000100:00100000:1.0:1746066753.709040:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422784 00000100:00100000:1.0:1746066753.709042:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422784 00000100:00100000:0.0:1746066753.709046:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984421632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.709050:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984423296 00000100:00100000:1.0:1746066753.709051:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984423296 00000100:00100000:1.0:1746066753.709058:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15791 00000100:00100000:1.0:1746066753.709062:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882984421760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.709062:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15792 00000100:00100000:2.0:1746066753.709065:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882984422144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (211us total) trans 21474841833 rc 0/0 00000100:00100000:0.0:1746066753.709066:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882984422272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.709070:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15790 00000100:00100000:2.0:1746066753.709079:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15793 00000100:00100000:2.0:1746066753.709083:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3776:x1830882984422656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.709101:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422016:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066753.709103:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:1.0:1746066753.709106:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.709108:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066753.709109:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066753.709111:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:0.0:1746066753.709118:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.709126:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3776:x1830882984421760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (221us total) trans 21474841834 rc 0/0 00000100:00100000:0.0:1746066753.709126:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.709131:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15791 00000100:00100000:0.0:1746066753.709136:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.709139:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422016 00000100:00100000:1.0:1746066753.709141:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422016 00000100:00100000:0.0:1746066753.709143:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984423040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.709146:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+25:3776:x1830882984422656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (187us total) trans 17179874385 rc 0/0 00000100:00100000:1.0:1746066753.709148:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422528 00000100:00100000:1.0:1746066753.709149:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422528 00000100:00100000:2.0:1746066753.709150:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15793 00000100:00100000:0.0:1746066753.709155:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.709157:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984423040 00000100:00100000:1.0:1746066753.709157:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15794 00000100:00100000:2.0:1746066753.709159:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984423040 00000100:00100000:1.0:1746066753.709160:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3776:x1830882984423168:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.709165:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c492680/2, rc 0, transno 21474841831 00000100:00100000:2.0:1746066753.709167:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15795 00000100:00100000:0.0:1746066753.709169:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984421504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.709171:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3776:x1830882984422784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.709174:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066753.709177:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.709191:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.709198:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422912:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066753.709201:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066753.709203:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.709204:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066753.709206:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00000100:00100000:1.0:1746066753.709207:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882984423168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (230us total) trans 17179874386 rc 0/0 00002000:00010000:2.0:1746066753.709208:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:0.0:1746066753.709211:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.709212:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15794 00000100:00100000:2.0:1746066753.709222:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882984422784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (221us total) trans 17179874387 rc 0/0 00000100:00100000:2.0:1746066753.709226:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15795 00000100:00100000:1.0:1746066753.709227:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422400 00000004:00080000:0.0:1746066753.709228:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098481180/2, rc 0, transno 17179874387 00000100:00100000:1.0:1746066753.709229:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422400 00000100:00100000:0.0:1746066753.709232:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.709235:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984422912 00000100:00100000:1.0:1746066753.709237:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15796 00000100:00100000:2.0:1746066753.709238:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984422912 00000004:00080000:0.0:1746066753.709238:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098481c00/2, rc 0, transno 17179874385 00000100:00100000:0.0:1746066753.709240:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.709241:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3776:x1830882984423296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.709245:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15797 00000004:00080000:0.0:1746066753.709246:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098483100/2, rc 0, transno 17179874386 00000100:00100000:2.0:1746066753.709248:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3775:x1830882984422016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.709248:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984423168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.709254:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c493100/2, rc 0, transno 21474841834 00000100:00100000:0.0:1746066753.709256:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984421760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066753.709262:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c492300/2, rc 0, transno 21474841833 00000100:00100000:0.0:1746066753.709264:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.709290:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882984422016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (171us total) trans 21474841836 rc 0/0 00000100:00100000:1.0:1746066753.709293:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3776:x1830882984423296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (275us total) trans 17179874388 rc 0/0 00000004:00080000:0.0:1746066753.709293:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c493800/2, rc 0, transno 21474841836 00000100:00100000:2.0:1746066753.709294:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15797 00000100:00100000:0.0:1746066753.709296:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.709298:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15796 00000100:00100000:0.0:1746066753.709299:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746066753.709301:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15798 00000100:00100000:0.0:1746066753.709303:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984423424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.709305:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984422528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.709308:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15799 00000100:00100000:1.0:1746066753.709312:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984423040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.709317:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066753.709331:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098482d80/2, rc 0, transno 17179874388 00000100:00100000:0.0:1746066753.709334:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984423296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.709345:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882984422528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (207us total) trans 17179874389 rc 0/0 00000004:00080000:0.0:1746066753.709347:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098481f80/2, rc 0, transno 17179874389 00000100:00100000:2.0:1746066753.709349:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15798 00000100:00100000:0.0:1746066753.709350:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.709356:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984423424 00000100:00100000:2.0:1746066753.709358:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984423424 00000100:00100000:2.0:1746066753.709365:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15800 00000100:00100000:2.0:1746066753.709368:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984422400:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.709378:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098480700/2, rc 0, transno 17179874390 00000100:00100000:0.0:1746066753.709380:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984423040:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.709406:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882984422400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 38us (214us total) trans 17179874391 rc 0/0 00000100:00100000:2.0:1746066753.709411:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15800 00000004:00080000:0.0:1746066753.709414:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098483b80/2, rc 0, transno 17179874391 00000100:00100000:0.0:1746066753.709417:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.709418:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15801 00000100:00100000:2.0:1746066753.709420:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984422912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066753.709448:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:2.0:1746066753.709450:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.709452:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066753.709454:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066753.709455:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:2.0:1746066753.709470:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3775:x1830882984422912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (257us total) trans 17179874392 rc 0/0 00000100:00100000:2.0:1746066753.709474:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15801 00000100:00100000:2.0:1746066753.709482:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15802 00000100:00100000:2.0:1746066753.709485:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3775:x1830882984423424:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066753.709569:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098481880/2, rc 0, transno 17179874392 00000100:00100000:0.0:1746066753.709573:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984422912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.709593:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.709615:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984421888 00000100:00100000:3.0:1746066753.709617:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984421888 00000100:00100000:3.0:1746066753.709627:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15803 00000100:00100000:3.0:1746066753.709631:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882984421888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.709673:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:3.0:1746066753.709675:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.709677:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.709678:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.709680:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:3.0:1746066753.709697:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3774:x1830882984421888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (108us total) trans 21474841837 rc 0/0 00000100:00100000:3.0:1746066753.709701:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15803 00000004:00080000:3.0:1746066753.709719:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c491500/2, rc 0, transno 21474841837 00000100:00100000:3.0:1746066753.709723:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984421888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.709854:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3775:x1830882984423040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (206us total) trans 17179874390 rc 0/0 00000100:00100000:1.0:1746066753.709865:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15799 00000004:00010000:1.0:1746066753.709949:0:17253:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098482680 reply state ffff8800a5708400 transno 8589936554 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.709966:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.709975:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.709978:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746066753.709982:0:17253:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746066753.710148:0:17253:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746066753.710161:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:522:x1830882983139840:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 8474us (9616us total) trans 8589936554 rc 0/0 00000100:00100000:1.0:1746066753.710168:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16243 00010000:00010000:1.0:1746066753.710187:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.710195:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.710201:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.710207:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fae600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.710211:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.710218:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.710231:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.710233:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.710237:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.710241:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6906 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:2.0:1746066753.710353:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3775:x1830882984423424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 867us (1034us total) trans 21474841838 rc 0/0 00000100:00100000:2.0:1746066753.710358:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15802 00000004:00080000:0.0:1746066753.710366:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ea24a80/2, rc 0, transno 21474841838 00000100:00100000:0.0:1746066753.710370:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984423424:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066753.710396:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:0.0:1746066753.710398:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.710399:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066753.710401:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.710403:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:0.0:1746066753.710426:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882984422272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1359us (1494us total) trans 21474841835 rc 0/0 00000100:00100000:0.0:1746066753.710432:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15792 00000004:00080000:0.0:1746066753.710454:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c491c00/2, rc 0, transno 21474841835 00000100:00100000:0.0:1746066753.710458:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984422272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066753.710978:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3774:x1830882984421376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2133us (2967us total) trans 21474841839 rc 0/0 00000100:00100000:2.0:1746066753.710983:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15788 00000004:00080000:3.0:1746066753.711049:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c490a80/2, rc 0, transno 21474841839 00000100:00100000:3.0:1746066753.711053:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984421376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.713069:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.713265:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140224 00000100:00100000:1.0:1746066753.713272:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140224 00000100:00100000:1.0:1746066753.713315:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16244 00000100:00100000:1.0:1746066753.713322:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:522:x1830882983140224:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066753.713345:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.713361:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d134c expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.713411:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.713422:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.713436:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.713439:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.713442:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf800, rc 0) 00000100:00100000:1.0:1746066753.713487:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:522:x1830882983140224:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 166us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.713492:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16244 00000100:00100000:0.0:1746066753.717632:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.717732:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140352 00000100:00100000:1.0:1746066753.717741:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140352 00000100:00100000:1.0:1746066753.717800:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16245 00000100:00100000:1.0:1746066753.717808:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:522:x1830882983140352:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066753.717828:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.717846:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6914 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1353 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.719082:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.719096:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.719107:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.719132:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066753.719137:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066753.719151:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.719177:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6914 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 11 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.719192:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.719200:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.719202:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066753.719205:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae400, rc 0) 00000100:00100000:1.0:1746066753.719262:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:522:x1830882983140352:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 1454us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.719269:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16245 00000100:00100000:0.0:1746066753.722147:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.722179:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.722201:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.722215:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140480 00000100:00100000:0.0:1746066753.722222:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.722224:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140480 00000100:00100000:2.0:1746066753.722238:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140736 00000100:00100000:0.0:1746066753.722239:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.722240:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140736 00000100:00100000:2.0:1746066753.722269:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140992 00000100:00100000:2.0:1746066753.722271:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140992 00000100:00100000:2.0:1746066753.722281:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140608 00000100:00100000:2.0:1746066753.722282:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140608 00000100:00100000:2.0:1746066753.722290:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983140864 00000100:00100000:2.0:1746066753.722291:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983140864 00000100:00100000:0.0:1746066753.722302:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.722305:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15804 00000100:00100000:2.0:1746066753.722312:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983140736:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066753.722330:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.722348:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1368 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066753.722370:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd41, atime: 0x6812dd41, ctime: 0x6812dd42, blocks: 0x800 00010000:00010000:2.0:1746066753.722387:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722389:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722397:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.722411:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.722421:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098a53a00, rc 0) 00000100:00100000:2.0:1746066753.722460:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983140736:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 149us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.722466:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15804 00000100:00100000:2.0:1746066753.722479:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983141120 00000100:00100000:2.0:1746066753.722482:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983141120 00000100:00100000:2.0:1746066753.722743:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15805 00000100:00100000:2.0:1746066753.722749:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983140992:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066753.722757:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.722769:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1376 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066753.722771:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15806 00000100:00100000:1.0:1746066753.722777:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983140608:12345-192.168.204.16@tcp:101:mirror_io.0 00002000:00010000:2.0:1746066753.722781:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd42, atime: 0x6812dd42, ctime: 0x6812dd42, blocks: 0x1668 00010000:00010000:1.0:1746066753.722783:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.722790:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.722791:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1361 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.722792:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722796:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746066753.722801:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd41, atime: 0x6812dd41, ctime: 0x6812dd42, blocks: 0x808 00010000:00010000:2.0:1746066753.722804:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.722808:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.722809:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722810:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097bc9800, rc 0) 00010000:00010000:1.0:1746066753.722813:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.722821:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066753.722824:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983140992:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 77us (623us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066753.722828:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafa00, rc 0) 00000100:00100000:2.0:1746066753.722829:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15805 00000100:00100000:2.0:1746066753.722839:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15807 00000100:00100000:2.0:1746066753.722843:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983140864:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066753.722848:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.722856:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d136f expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066753.722864:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd41, atime: 0x6812dd41, ctime: 0x6812dd42, blocks: 0x800 00010000:00010000:2.0:1746066753.722870:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722871:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722875:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.722901:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.722908:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097bc9000, rc 0) 00000100:00100000:2.0:1746066753.722923:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983140864:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 79us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.722927:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15807 00000100:00100000:2.0:1746066753.722936:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15808 00000100:00100000:2.0:1746066753.722940:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983141120:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066753.722946:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.722952:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d137d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066753.722960:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd42, atime: 0x6812dd42, ctime: 0x6812dd42, blocks: 0x1000 00010000:00010000:2.0:1746066753.722967:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722969:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.722972:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.722979:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.722989:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14e00, rc 0) 00000100:00100000:1.0:1746066753.722994:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983140608:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 218us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.722999:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15806 00000100:00100000:2.0:1746066753.723003:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983141120:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 63us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.723007:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15808 00000100:00100000:2.0:1746066753.723033:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15809 00000100:00100000:2.0:1746066753.723037:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983140480:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066753.723042:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.723050:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d135a expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066753.723065:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd41, atime: 0x6812dd41, ctime: 0x6812dd42, blocks: 0x7b0 00010000:00010000:2.0:1746066753.723074:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.723076:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.723080:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 16 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.723088:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 16 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.723094:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14800, rc 0) 00000100:00100000:2.0:1746066753.723109:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983140480:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 71us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.723113:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15809 00000100:00100000:0.0:1746066753.753493:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.753609:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983141376 00000100:00100000:1.0:1746066753.753619:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983141376 00000100:00100000:1.0:1746066753.754144:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16246 00000100:00100000:1.0:1746066753.754154:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:524:x1830882983141376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066753.754182:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.754202:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa694c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1384 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.754488:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.754501:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.754699:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.754716:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.754722:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.754728:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.755021:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.755034:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.755041:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.755073:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 9 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.755083:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 9 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.755093:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984423552:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.757001:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066753.759197:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984423552:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.759225:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.759413:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.759627:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983141504 00000100:00100000:2.0:1746066753.759634:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983141504 00010000:00010000:2.0:1746066753.759666:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.759698:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7091 00000100:00100000:2.0:1746066753.759705:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983141504:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.759717:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.759723:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.759732:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.759752:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa68c7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d133e expref: 10 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.759768:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.759772:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.759781:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.759787:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.759802:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.759834:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983141504:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.759839:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7091 00010000:00010000:1.0:1746066753.760029:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.760036:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.760051:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.761927:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.761939:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.761945:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.761951:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fae600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.761955:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.761962:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.761976:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.761979:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066753.761983:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.761988:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa6961 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762032:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762038:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762043:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762048:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762052:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fae200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.762054:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762058:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762065:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066753.762067:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.762069:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762073:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae200/0xf1867c21abfa6953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762082:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762086:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762091:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762095:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fafe00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.762098:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762102:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762108:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097855200) 00010000:00010000:1.0:1746066753.762110:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.762112:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762117:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa695a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.762166:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa694c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1384 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.762174:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa694c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1384 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.762182:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf400, rc 0) 00000100:00100000:1.0:1746066753.762243:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:524:x1830882983141376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8090us (8759us total) trans 8589936555 rc 301/301 00000100:00100000:1.0:1746066753.762251:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16246 00000100:00100000:0.0:1746066753.768193:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.768291:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983141632 00000100:00100000:1.0:1746066753.768301:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983141632 00000100:00100000:1.0:1746066753.768413:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16247 00000100:00100000:1.0:1746066753.768422:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:524:x1830882983141632:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066753.768451:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.768471:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa696f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d138b expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.768529:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa696f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d138b expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.768552:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa696f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d138b expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.768569:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.768572:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066753.768575:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629b000, rc 0) 00000100:00100000:1.0:1746066753.769706:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:524:x1830882983141632:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1282us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.769713:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16247 00000100:00100000:0.0:1746066753.772278:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.772384:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983141888 00000100:00100000:1.0:1746066753.772394:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983141888 00000100:00100000:1.0:1746066753.773161:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16248 00000100:00100000:1.0:1746066753.773172:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:524:x1830882983141888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066753.773191:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.773194:0:17253:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066753.773222:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629b000/0xf1867c21abfa696f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d138b expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.773239:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.773243:0:17253:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.773254:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6976 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1392 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.773302:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.773315:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.773322:0:17253:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.773327:0:17253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.773542:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.773554:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 8 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.773566:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984423680:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.774926:0:17253:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 8 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.774937:0:17253:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 8 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.774946:0:17253:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984423808:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.776032:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.776230:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983142016 00000100:00100000:2.0:1746066753.776239:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983142016 00010000:00010000:2.0:1746066753.776270:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 9 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:2.0:1746066753.776296:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7092 00000100:00100000:2.0:1746066753.776303:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983142016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066753.776314:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066753.776319:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 9 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.776329:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 9 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:2.0:1746066753.776349:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.776354:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.776361:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:2.0:1746066753.776366:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066753.776397:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983142016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 94us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.776403:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7092 00000100:00100000:1.0:1746066753.776483:0:17253:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066753.776511:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf800/0xf1867c21abfa690d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d134c expref: 8 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:1.0:1746066753.776526:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984423680:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066753.776545:0:17253:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:17253:1830882984423808:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066753.776567:0:17253:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.776693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.776824:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983142144 00000100:00100000:3.0:1746066753.776828:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983142144 00010000:00010000:3.0:1746066753.776842:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 8 pid: 17253 timeout: 821 lvb_type: 0 00000100:00100000:3.0:1746066753.776856:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7093 00000100:00100000:3.0:1746066753.776860:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983142144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.776866:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.776869:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 8 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.776876:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 8 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.777998:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa691b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1353 expref: 8 pid: 17253 timeout: 821 lvb_type: 0 00010000:00010000:3.0:1746066753.778023:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066753.778028:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.778040:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.778047:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 17253 initiator: MDT0 00010000:00010000:3.0:1746066753.778073:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066753.778093:0:17253:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.778100:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000100:00100000:3.0:1746066753.778113:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2015:x1830882983142144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1252us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.778120:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7093 00000040:00080000:1.0:1746066753.778358:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].626, 88 off62800 00000004:00080000:1.0:1746066753.778364:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721989480428ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.778392:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].560, 88 off57072 00000004:00080000:1.0:1746066753.778395:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721989511773ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.778423:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].561, 88 off57160 00000004:00080000:1.0:1746066753.778426:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721989543281ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.778435:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].627, 88 off62888 00000004:00080000:1.0:1746066753.778437:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721989554003ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.778444:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].628, 88 off62976 00000004:00080000:1.0:1746066753.778446:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721989562946ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.778456:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].562, 88 off57248 00000004:00080000:1.0:1746066753.778459:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721989575378ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.778855:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].564, 88 off57432 00000004:00080000:1.0:1746066753.778861:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721989977267ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.778916:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].565, 88 off57520 00000004:00080000:1.0:1746066753.778921:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721990037331ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.778932:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].629, 88 off63064 00000004:00080000:1.0:1746066753.778934:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721990051022ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.778952:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].566, 88 off57608 00000004:00080000:1.0:1746066753.778955:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721990071771ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.778964:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].630, 88 off63152 00000004:00080000:1.0:1746066753.778966:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721990083091ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.778974:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].567, 88 off57696 00000004:00080000:1.0:1746066753.778976:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721990092992ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066753.778983:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].631, 88 off63240 00000004:00080000:1.0:1746066753.778985:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721990102267ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.778992:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].632, 88 off63328 00000004:00080000:1.0:1746066753.778995:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721990111322ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.779001:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].633, 88 off63416 00000004:00080000:1.0:1746066753.779004:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721990120571ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.779011:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].634, 88 off63504 00000004:00080000:1.0:1746066753.779013:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 721990130127ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066753.779021:0:17253:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].568, 88 off57784 00000004:00080000:1.0:1746066753.779023:0:17253:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 721990139681ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066753.781298:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936556 is committed 00000004:00080000:3.0:1746066753.781309:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 558 committed 00000004:00080000:3.0:1746066753.781325:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 623 committed 00000004:00080000:3.0:1746066753.781330:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 622 committed 00000004:00080000:3.0:1746066753.781332:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 621 committed 00000004:00080000:3.0:1746066753.781333:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 620 committed 00000004:00080000:3.0:1746066753.781334:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 557 committed 00000004:00080000:3.0:1746066753.781336:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 619 committed 00000004:00080000:3.0:1746066753.781337:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 556 committed 00000004:00080000:3.0:1746066753.781338:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 618 committed 00000004:00080000:3.0:1746066753.781341:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 555 committed 00000004:00080000:3.0:1746066753.781342:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 554 committed 00000004:00080000:3.0:1746066753.781344:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 553 committed 00000004:00080000:3.0:1746066753.781345:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 617 committed 00000004:00080000:3.0:1746066753.781346:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 616 committed 00000004:00080000:3.0:1746066753.781348:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 552 committed 00000004:00080000:3.0:1746066753.781350:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 551 committed 00000004:00080000:3.0:1746066753.781351:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 615 committed 00000100:00100000:2.0:1746066753.781503:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.781576:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.781608:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.781626:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.781644:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746066753.781648:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.781664:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.781675:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066753.781690:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066753.781713:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424064 00000100:00100000:2.0:1746066753.781720:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424064 00000100:00100000:2.0:1746066753.781750:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424576 00000100:00100000:2.0:1746066753.781752:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424576 00000100:00100000:2.0:1746066753.781767:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424192 00000100:00100000:2.0:1746066753.781769:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424192 00000100:00100000:2.0:1746066753.781777:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424704 00000100:00100000:2.0:1746066753.781779:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424704 00000100:00100000:2.0:1746066753.781792:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15810 00000100:00100000:2.0:1746066753.781798:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984424064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.782004:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984423936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.782025:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.782037:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984424448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.782047:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.782054:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984424960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.782063:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.782070:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984425472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.782079:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.782086:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984424320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066753.782094:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984423936 00000100:00100000:0.0:1746066753.782096:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984423936 00000100:00100000:0.0:1746066753.782107:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424448 00000100:00100000:0.0:1746066753.782108:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424448 00000100:00100000:3.0:1746066753.782112:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.782113:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424960 00000100:00100000:0.0:1746066753.782114:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424960 00000100:00100000:0.0:1746066753.782119:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425472 00000100:00100000:0.0:1746066753.782120:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425472 00000100:00100000:3.0:1746066753.782123:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984424832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.782135:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.782136:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424320 00000100:00100000:0.0:1746066753.782137:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424320 00000100:00100000:3.0:1746066753.782142:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984425344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.782143:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984424832 00000100:00100000:0.0:1746066753.782145:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984424832 00000100:00100000:0.0:1746066753.782151:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15811 00000100:00100000:3.0:1746066753.782154:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066753.782155:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3776:x1830882984424576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.782160:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984425856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.782171:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.782190:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425344 00000100:00100000:3.0:1746066753.782193:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425344 00000100:00100000:3.0:1746066753.782206:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425856 00000100:00100000:3.0:1746066753.782207:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425856 00000100:00100000:3.0:1746066753.782214:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15812 00000100:00100000:3.0:1746066753.782219:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984424192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.782233:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15813 00000100:00100000:3.0:1746066753.782237:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984424704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066753.782250:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066753.782253:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.782255:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066753.782257:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.782258:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066753.782282:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882984424576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (655us total) trans 17179874393 rc 0/0 00000100:00100000:0.0:1746066753.782288:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15811 00000100:00100000:3.0:1746066753.782300:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984424704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (609us total) trans 17179874394 rc 0/0 00000100:00100000:0.0:1746066753.782302:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15814 00000100:00100000:0.0:1746066753.782305:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3775:x1830882984423936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.782306:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15813 00000100:00100000:3.0:1746066753.782317:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15815 00000100:00100000:3.0:1746066753.782321:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882984424448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066753.782357:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066753.782360:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.782362:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:0.0:1746066753.782362:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066753.782364:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066753.782364:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:3.0:1746066753.782366:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00002000:00010000:0.0:1746066753.782366:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:0.0:1746066753.782367:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:0.0:1746066753.782369:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 1968 00000100:00100000:3.0:1746066753.782386:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984424448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (338us total) trans 17179874395 rc 0/0 00000100:00100000:0.0:1746066753.782387:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3775:x1830882984423936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (361us total) trans 21474841840 rc 0/0 00000100:00100000:0.0:1746066753.782391:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15814 00000100:00100000:3.0:1746066753.782394:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15815 00000100:00100000:0.0:1746066753.782402:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15816 00000100:00100000:3.0:1746066753.782405:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15817 00000100:00100000:0.0:1746066753.782405:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3775:x1830882984424960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.782409:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3775:x1830882984425472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.782446:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:3.0:1746066753.782448:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.782450:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.782452:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00000100:00100000:0.0:1746066753.782453:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3775:x1830882984424960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (388us total) trans 17179874396 rc 0/0 00002000:00010000:3.0:1746066753.782454:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:0.0:1746066753.782458:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15816 00000100:00100000:0.0:1746066753.782466:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15818 00000100:00100000:3.0:1746066753.782469:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3775:x1830882984425472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (388us total) trans 21474841841 rc 0/0 00000100:00100000:0.0:1746066753.782470:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984424320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.782474:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15817 00000100:00100000:3.0:1746066753.782483:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15819 00000100:00100000:3.0:1746066753.782487:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3774:x1830882984424832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066753.782505:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066753.782507:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066754 -> 1746066754 00002000:00010000:0.0:1746066753.782509:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066754 -> 1746066754 00002000:00010000:0.0:1746066753.782511:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:0.0:1746066753.782512:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066753.782550:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3774:x1830882984424832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (413us total) trans 17179874398 rc 0/0 00000100:00100000:3.0:1746066753.782555:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15819 00000100:00100000:3.0:1746066753.782564:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15820 00000100:00100000:3.0:1746066753.782568:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3774:x1830882984425344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.782578:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425216:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.782602:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00000100:00100000:1.0:1746066753.782602:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746066753.782604:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.782606:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.782608:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.782610:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:1.0:1746066753.782613:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.782628:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3774:x1830882984425344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (472us total) trans 21474841842 rc 0/0 00000100:00100000:1.0:1746066753.782629:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.782633:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15820 00000100:00100000:1.0:1746066753.782638:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746066753.782641:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.782643:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425216 00000100:00100000:3.0:1746066753.782645:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425216 00000100:00100000:3.0:1746066753.782652:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425728 00000100:00100000:3.0:1746066753.782654:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425728 00000100:00100000:1.0:1746066753.782655:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.782660:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425088 00000100:00100000:3.0:1746066753.782661:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425088 00000100:00100000:1.0:1746066753.782663:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.782669:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15821 00000100:00100000:3.0:1746066753.782672:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3774:x1830882984425856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.782675:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066753.782690:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425600 00000100:00100000:1.0:1746066753.782693:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425600 00000100:00100000:1.0:1746066753.782707:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15822 00002000:00010000:3.0:1746066753.782709:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00000100:00100000:1.0:1746066753.782711:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984425216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.782712:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.782713:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.782715:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066753.782717:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:3.0:1746066753.782732:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3774:x1830882984425856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (560us total) trans 21474841843 rc 0/0 00000100:00100000:3.0:1746066753.782736:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15821 00000100:00100000:3.0:1746066753.782744:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15823 00000100:00100000:3.0:1746066753.782748:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984425728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066753.782758:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:1.0:1746066753.782761:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.782763:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.782764:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.782766:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00002000:00010000:3.0:1746066753.782781:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066753.782783:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066753.782784:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746066753.782786:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:3.0:1746066753.782787:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:1.0:1746066753.782787:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882984425216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (183us total) trans 21474841844 rc 0/0 00000100:00100000:1.0:1746066753.782792:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15822 00000100:00100000:1.0:1746066753.782802:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15824 00000100:00100000:3.0:1746066753.782803:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984425728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (173us total) trans 21474841845 rc 0/0 00000100:00100000:1.0:1746066753.782806:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3777:x1830882984425088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.782811:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15823 00000100:00100000:3.0:1746066753.782820:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15825 00000100:00100000:3.0:1746066753.782824:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3777:x1830882984425600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066753.782841:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066753.782843:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.782845:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:1.0:1746066753.782846:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:1.0:1746066753.782848:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066753.782865:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882984425088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (209us total) trans 21474841846 rc 0/0 00000100:00100000:3.0:1746066753.782870:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3777:x1830882984425600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (194us total) trans 21474841847 rc 0/0 00000100:00100000:1.0:1746066753.782871:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15824 00000100:00100000:3.0:1746066753.782875:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15825 00000004:00080000:3.0:1746066753.782923:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f0380/2, rc 0, transno 21474841840 00000004:00080000:1.0:1746066753.782923:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1500/2, rc 0, transno 21474841846 00000100:00100000:3.0:1746066753.782932:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984423936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066753.782939:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b6d80/2, rc 0, transno 17179874395 00000100:00100000:3.0:1746066753.782942:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984424448:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066753.782947:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b4700/2, rc 0, transno 17179874396 00000100:00100000:3.0:1746066753.782950:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984424960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066753.782955:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3800/2, rc 0, transno 21474841841 00002000:00010000:2.0:1746066753.783144:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066753.783147:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.783149:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:2.0:1746066753.783151:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:2.0:1746066753.783152:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066753.783174:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882984424064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1376us (1599us total) trans 17179874399 rc 0/0 00000100:00100000:2.0:1746066753.783180:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15810 00000100:00100000:3.0:1746066753.783226:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984425472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.783227:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066753.783240:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3480/2, rc 0, transno 21474841847 00000100:00100000:1.0:1746066753.783243:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066753.783248:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f3100/2, rc 0, transno 21474841844 00000100:00100000:1.0:1746066753.783250:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066753.783256:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f2300/2, rc 0, transno 21474841845 00000100:00100000:1.0:1746066753.783259:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984425728:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066753.783273:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066753.783275:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066753 -> 1746066753 00002000:00010000:3.0:1746066753.783277:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066753 -> 1746066753 00002000:00010000:3.0:1746066753.783279:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066754 -> 1746066754 00002000:00010000:3.0:1746066753.783281:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066753.783300:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3776:x1830882984424192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1080us (1634us total) trans 17179874400 rc 0/0 00000100:00100000:3.0:1746066753.783305:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15812 00010000:00010000:1.0:1746066753.783309:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 28 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.783320:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.783323:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066753.783337:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009629ae00/0xf1867c21abfa6976 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 28 pid: 17253 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066753.783354:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 27 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.783379:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.783381:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746066753.783383:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fae600, rc 0) 00000004:00080000:3.0:1746066753.783409:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b7480/2, rc 0, transno 17179874397 00000100:00100000:3.0:1746066753.783412:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984424320:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066753.783418:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b6a00/2, rc 0, transno 17179874398 00000100:00100000:3.0:1746066753.783421:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984424832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066753.783423:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:524:x1830882983141888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10254us (11154us total) trans 8589936556 rc 0/0 00000004:00080000:3.0:1746066753.783427:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801310f1880/2, rc 0, transno 21474841842 00000100:00100000:3.0:1746066753.783429:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984425344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066753.783429:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16248 00000004:00080000:3.0:1746066753.783435:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098fbce00/2, rc 0, transno 21474841843 00000100:00100000:3.0:1746066753.783437:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984425856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.783848:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3774:x1830882984424320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1376us (1735us total) trans 17179874397 rc 0/0 00000100:00100000:0.0:1746066753.783853:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15818 00000004:00080000:0.0:1746066753.783877:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b5c00/2, rc 0, transno 17179874400 00000100:00100000:0.0:1746066753.784040:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.784051:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b5180/2, rc 0, transno 17179874394 00000100:00100000:0.0:1746066753.784054:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424704:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.784060:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098481500/2, rc 0, transno 17179874399 00000100:00100000:0.0:1746066753.784062:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066753.784068:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800b40b6300/2, rc 0, transno 17179874393 00000100:00100000:0.0:1746066753.784070:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984424576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066753.784192:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984425984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.784211:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066753.784228:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984425984 00000100:00100000:3.0:1746066753.784231:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984425984 00000100:00100000:3.0:1746066753.784243:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15826 00000100:00100000:3.0:1746066753.784247:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3775:x1830882984425984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066753.784302:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3775:x1830882984425984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (90us total) trans 21474841848 rc 0/0 00000100:00100000:3.0:1746066753.784306:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15826 00000004:00080000:3.0:1746066753.784320:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5d80000/2, rc 0, transno 21474841848 00000100:00100000:3.0:1746066753.784322:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984425984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066753.791306:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.791362:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983142272 00000100:00100000:2.0:1746066753.791370:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983142272 00000100:00100000:2.0:1746066753.793152:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15827 00000100:00100000:2.0:1746066753.793167:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:524:x1830882983142272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066753.793189:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.793210:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1399 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.793243:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.793250:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.793251:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.793254:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1941504->2052095] (req 1941504->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.793286:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.793298:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 9 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066753.793311:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984426112:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066753.793407:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.796711:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.796727:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984426112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.796761:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1941504->2052095] (req 1941504->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.796779:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f000, rc 0) 00000100:00100000:2.0:1746066753.796834:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:524:x1830882983142272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3671us (5539us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.796843:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15827 00000100:00100000:3.0:1746066753.796932:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983142400 00000100:00100000:3.0:1746066753.796939:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983142400 00010000:00010000:3.0:1746066753.796966:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 10 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066753.796990:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7094 00000100:00100000:3.0:1746066753.796997:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137022050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983142400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.797012:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.797033:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 10 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066753.797043:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 10 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066753.797067:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098a53a00/0xf1867c21abfa6922 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1368 expref: 10 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066753.798685:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.798689:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.798698:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.798709:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.798744:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.799828:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984426240:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.799950:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.804515:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.804625:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984426240:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.804646:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.804690:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137022050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983142400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7693us (7988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.804703:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7094 00000100:00100000:1.0:1746066753.805437:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983142656 00000100:00100000:1.0:1746066753.805446:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983142656 00002000:00100000:1.0:1746066753.805487:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1941504->1945599) req@ffff8800a5d81f80 x1830882983142656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.805502:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882983142656 ext(1941504->1945599) 00002000:00010000:1.0:1746066753.805507:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81f80 00000100:00100000:1.0:1746066753.805540:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4135 00000100:00100000:1.0:1746066753.805548:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983142656:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066753.805819:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983142656:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 271us (1312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066753.805826:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4135 00002000:00100000:1.0:1746066753.805831:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1941504->1945599) req@ffff8800a5d81f80 x1830882983142656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.805838:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882983142656 ext(1941504->1945599) 00002000:00010000:1.0:1746066753.805841:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81f80 00000100:00100000:0.0:1746066753.808965:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.809050:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983142912 00000100:00100000:1.0:1746066753.809059:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983142912 00002000:00100000:1.0:1746066753.809107:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (2048000->2052095) req@ffff8800a5d83b80 x1830882983142912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.809119:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83b80 with x1830882983142912 ext(2048000->2052095) 00002000:00010000:1.0:1746066753.809125:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83b80 00000100:00100000:1.0:1746066753.809185:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4136 00000100:00100000:1.0:1746066753.809193:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983142912:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066753.811313:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983142912:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 2112us (2348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066753.811323:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4136 00002000:00100000:1.0:1746066753.811334:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (2048000->2052095) req@ffff8800a5d83b80 x1830882983142912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/4536 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.811343:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83b80 with x1830882983142912 ext(2048000->2052095) 00002000:00010000:1.0:1746066753.811348:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d83b80 00000100:00100000:0.0:1746066753.817635:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.817852:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983143168 00000100:00100000:2.0:1746066753.817864:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983143168 00000100:00100000:2.0:1746066753.818190:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5910 00000100:00100000:2.0:1746066753.818200:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:524:x1830882983143168:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066753.819676:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:524:x1830882983143168:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 1471us (2046us total) trans 8589936557 rc 0/0 00000100:00100000:2.0:1746066753.819685:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5910 00000100:00100000:0.0:1746066753.823412:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.823507:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983143424 00000100:00100000:1.0:1746066753.823515:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983143424 00000100:00100000:1.0:1746066753.823631:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16249 00000100:00100000:1.0:1746066753.823639:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:527:x1830882983143424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.823660:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.823675:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa698b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13a0 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.823733:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823744:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823754:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823764:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823769:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823774:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823861:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823870:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.823876:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.824004:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.824060:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824067:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824072:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824077:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357a800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.824080:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824086:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824095:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.824098:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066753.824101:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824106:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a800/0xf1867c21abfa69a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824373:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824382:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824388:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824393:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824397:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.824399:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824404:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824410:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066753.824412:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.824415:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824419:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357a000/0xf1867c21abfa6992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824427:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824432:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824437:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824441:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357ba00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.824444:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824448:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824453:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097855200) 00010000:00010000:1.0:1746066753.824455:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.824457:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824461:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa6999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.824490:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa698b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a0 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.824497:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b400/0xf1867c21abfa698b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a0 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.824504:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b400, rc 0) 00000100:00100000:1.0:1746066753.825213:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:527:x1830882983143424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1573us (1805us total) trans 8589936558 rc 301/301 00000100:00100000:1.0:1746066753.825219:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16249 00000100:00100000:0.0:1746066753.829650:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.829750:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983143552 00000100:00100000:1.0:1746066753.829760:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983143552 00000100:00100000:1.0:1746066753.829801:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16250 00000100:00100000:1.0:1746066753.829808:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:527:x1830882983143552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.829827:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.829842:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa69ae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13a7 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.829957:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.829969:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.829978:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.830000:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066753.830003:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066753.830016:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.830035:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa69ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 31 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.830060:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 30 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.830068:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.830070:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066753.830073:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b600, rc 0) 00000100:00100000:1.0:1746066753.830120:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:527:x1830882983143552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 312us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.830126:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16250 00000100:00100000:1.0:1746066753.834280:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.835631:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.835666:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.835683:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.836077:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.836350:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983143680 00000100:00100000:2.0:1746066753.836353:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983143936 00000100:00100000:3.0:1746066753.836360:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983143680 00000100:00100000:2.0:1746066753.836360:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983143936 00000100:00100000:1.0:1746066753.836377:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983144192 00000100:00100000:1.0:1746066753.836380:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983144192 00000100:00100000:3.0:1746066753.836406:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983143808 00000100:00100000:3.0:1746066753.836409:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983143808 00000100:00100000:1.0:1746066753.836428:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983144064 00000100:00100000:1.0:1746066753.836431:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983144064 00000100:00100000:3.0:1746066753.836434:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15828 00000100:00100000:2.0:1746066753.836441:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15829 00000100:00100000:3.0:1746066753.836442:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983143680:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066753.836447:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983143936:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066753.836452:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15830 00000100:00100000:1.0:1746066753.836458:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983144192:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066753.836465:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15831 00010000:00010000:3.0:1746066753.836467:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.836467:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066753.836469:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983143808:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.836475:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.836483:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13ae expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.836483:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13ca expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.836485:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13b5 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.836504:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.836504:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.836504:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.836506:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.836506:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.836506:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.836514:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.836514:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 30 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.836519:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.836537:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.836540:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 30 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.836541:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.836547:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc0e800, rc 0) 00010000:00010000:1.0:1746066753.836548:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357a800, rc 0) 00010000:00010000:3.0:1746066753.836549:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629ae00, rc 0) 00000100:00100000:1.0:1746066753.836591:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983144192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 134us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.836592:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983143680:12345-192.168.204.16@tcp:101:cat.0 Request processed in 151us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.836597:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15830 00000100:00100000:3.0:1746066753.836601:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15828 00000100:00100000:1.0:1746066753.836612:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15832 00000100:00100000:1.0:1746066753.836617:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983144064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.836622:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.836630:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13c3 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.836640:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.836641:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.836645:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 29 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.836654:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 29 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066753.836660:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357b400, rc 0) 00000100:00100000:1.0:1746066753.836673:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983144064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.836678:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15832 00000100:00100000:2.0:1746066753.836777:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983143808:12345-192.168.204.16@tcp:101:cat.0 Request processed in 306us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.836783:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15831 00010000:00010000:2.0:1746066753.836798:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.836807:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13bc expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.836819:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.836821:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.836826:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 29 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.836834:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 29 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.836840:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800965fba00, rc 0) 00000100:00100000:2.0:1746066753.836854:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983143936:12345-192.168.204.16@tcp:101:cat.0 Request processed in 408us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.836859:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15829 00000100:00100000:0.0:1746066753.849876:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.849946:0:17253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983144448 00000100:00100000:1.0:1746066753.849957:0:17253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983144448 00000100:00100000:0.0:1746066753.850315:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.850351:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983144832 00000100:00100000:0.0:1746066753.850354:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983144832 00002000:00100000:0.0:1746066753.850387:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a5d80e00 x1830882983144832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.850397:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882983144832 ext(0->1048575) 00002000:00010000:0.0:1746066753.850403:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80e00 00000100:00100000:0.0:1746066753.850434:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4137 00000100:00100000:0.0:1746066753.850441:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983144832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066753.850588:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16251 00000100:00100000:1.0:1746066753.850595:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:533:x1830882983144448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.850610:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.850627:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa69df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13d1 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.850706:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850718:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850729:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850742:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850746:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850751:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850836:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850843:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850848:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.850857:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066753.850946:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850953:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850957:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.850959:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.850962:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fae400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.850965:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850971:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.850972:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.850982:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.850985:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066753.850989:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.850993:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae400/0xf1867c21abfa69f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851012:0:17253:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851015:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.851017:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066753.851018:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851022:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851025:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009357aa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066753.851027:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851030:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851035:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00000100:00100000:0.0:1746066753.851035:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983144960 00010000:00010000:1.0:1746066753.851036:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.851038:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00000100:00100000:0.0:1746066753.851038:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983144960 00010000:00010000:1.0:1746066753.851041:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357aa00/0xf1867c21abfa69e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851048:0:17253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851052:0:17253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17253 initiator: MDT0 00002000:00100000:0.0:1746066753.851052:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a5d83800 x1830882983144960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066753.851056:0:17253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851060:0:17253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098bb9400 already unused, calling callback (ffffffffa0f1c690) 00002000:00100000:0.0:1746066753.851060:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882983144960 ext(1048576->2097151) 00010000:00010000:1.0:1746066753.851062:0:17253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17253 initiator: MDT0 00002000:00010000:0.0:1746066753.851064:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83800 00010000:00010000:1.0:1746066753.851066:0:17253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851072:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097855200) 00000100:00100000:0.0:1746066753.851072:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983145344 00000100:00100000:0.0:1746066753.851073:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983145344 00010000:00010000:1.0:1746066753.851074:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066753.851076:0:17253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.851080:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098bb9400/0xf1867c21abfa69ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17253 initiator: MDT0 00002000:00100000:0.0:1746066753.851083:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800a5d82a00 x1830882983145344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 504/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.851089:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830882983145344 ext(1048576->2097151) 00002000:00010000:0.0:1746066753.851092:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:0.0:1746066753.851099:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983145216 00000100:00100000:0.0:1746066753.851101:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983145216 00000100:00100000:1.0:1746066753.851108:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4138 00002000:00100000:0.0:1746066753.851108:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a5d82300 x1830882983145216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066753.851114:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983144960:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:0.0:1746066753.851114:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882983145216 ext(1048576->2097151) 00002000:00010000:0.0:1746066753.851117:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:0.0:1746066753.851126:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4139 00000100:00100000:0.0:1746066753.851130:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983145344:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066753.851738:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4140 00000100:00100000:0.0:1746066753.851744:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983145216:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066753.851821:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa69df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d1 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.851829:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357ba00/0xf1867c21abfa69df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d1 expref: 10 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.851837:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009357ba00, rc 0) 00000100:00100000:1.0:1746066753.851860:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:533:x1830882983144448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1266us (1993us total) trans 8589936559 rc 301/301 00000100:00100000:1.0:1746066753.851866:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16251 00000100:00100000:0.0:1746066753.862950:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983145344:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11807us (11965us total) trans 0 rc 937984/937984 00000100:00100000:0.0:1746066753.862963:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4139 00002000:00100000:0.0:1746066753.862975:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800a5d82a00 x1830882983145344/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 504/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.862986:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82a00 with x1830882983145344 ext(1048576->2097151) 00002000:00010000:0.0:1746066753.862992:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82a00 00000100:00100000:0.0:1746066753.867149:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.867544:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983144960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16427us (16583us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066753.867556:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4138 00002000:00100000:1.0:1746066753.867569:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a5d83800 x1830882983144960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.867578:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882983144960 ext(1048576->2097151) 00002000:00010000:1.0:1746066753.867584:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83800 00000100:00100000:2.0:1746066753.868133:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983145728 00000100:00100000:2.0:1746066753.868141:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983145728 00000100:00100000:2.0:1746066753.868177:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5911 00000100:00100000:2.0:1746066753.868184:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:533:x1830882983145728:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066753.868360:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:533:x1830882983145728:12345-192.168.204.16@tcp:35:cat.0 Request processed in 176us (1221us total) trans 8589936560 rc 0/0 00000100:00100000:2.0:1746066753.868365:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5911 00000100:00100000:0.0:1746066753.871433:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.871478:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.871851:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983145856 00000100:00100000:2.0:1746066753.871861:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983145856 00000100:00100000:2.0:1746066753.872203:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983146112 00000100:00100000:2.0:1746066753.872206:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983146112 00000100:00100000:1.0:1746066753.872276:0:17253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16252 00000100:00100000:1.0:1746066753.872287:0:17253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:533:x1830882983145856:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.872313:0:17253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.872334:0:17253:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa6a02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13d8 expref: -99 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.872426:0:17253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.872441:0:17253:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.872451:0:17253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00000004:00200000:1.0:1746066753.872481:0:17253:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:1.0:1746066753.872485:0:17253:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746066753.872501:0:17253:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17253 initiator: MDT0 00010000:00010000:1.0:1746066753.872523:0:17253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098faf400/0xf1867c21abfa6a02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 13 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.872558:0:17253:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 12 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.872567:0:17253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066753.872569:0:17253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746066753.872573:0:17253:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fafe00, rc 0) 00000100:00100000:1.0:1746066753.872616:0:17253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:533:x1830882983145856:12345-192.168.204.16@tcp:101:cat.0 Request processed in 332us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.872623:0:17253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16252 00000100:00100000:2.0:1746066753.872869:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16253 00000100:00100000:2.0:1746066753.872875:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:531:x1830882983146112:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066753.872899:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.872907:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13df expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.872947:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.872955:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.872961:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.872972:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.872978:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.872983:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873052:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873058:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873064:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066753.873070:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066753.873134:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873141:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873146:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873152:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d80fa00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.873156:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873162:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873170:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.873172:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066753.873175:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873179:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80fa00/0xf1867c21abfa6a25 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873209:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873214:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873218:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873227:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873231:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.873233:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873238:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873244:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066753.873246:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.873248:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873252:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873259:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873263:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873268:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873271:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.873273:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873278:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873288:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098b5bb00) 00010000:00010000:2.0:1746066753.873290:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.873292:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873296:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6a1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066753.873323:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6a10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13df expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.873329:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13df expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.873336:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3800, rc 0) 00000100:00100000:2.0:1746066753.873359:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+12:531:x1830882983146112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 483us (1880us total) trans 8589936561 rc 301/301 00000100:00100000:2.0:1746066753.873365:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16253 00000100:00100000:0.0:1746066753.874068:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983145216:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22321us (23047us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066753.874077:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4140 00002000:00100000:0.0:1746066753.874086:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a5d82300 x1830882983145216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.874095:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882983145216 ext(1048576->2097151) 00002000:00010000:0.0:1746066753.874099:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:3.0:1746066753.876323:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983144832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 25875us (26000us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.876334:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4137 00002000:00100000:3.0:1746066753.876344:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a5d80e00 x1830882983144832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.876354:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882983144832 ext(0->1048575) 00002000:00010000:3.0:1746066753.876359:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80e00 00000100:00100000:0.0:1746066753.878706:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.878742:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.878773:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.878786:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.878810:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.878837:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.878935:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983146368 00000100:00100000:3.0:1746066753.878945:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983146624 00000100:00100000:2.0:1746066753.878946:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983146368 00000100:00100000:3.0:1746066753.878951:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983146624 00000100:00100000:3.0:1746066753.878982:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983146880 00000100:00100000:3.0:1746066753.878983:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983146880 00000100:00100000:3.0:1746066753.879001:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983146240 00000100:00100000:3.0:1746066753.879002:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983146240 00000100:00100000:2.0:1746066753.879003:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983146496 00000100:00100000:2.0:1746066753.879006:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983146496 00000100:00100000:3.0:1746066753.879019:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983146752 00000100:00100000:1.0:1746066753.879035:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15833 00000100:00100000:1.0:1746066753.879045:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983146624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.879064:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.879081:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13fb expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.879105:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.879112:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.879121:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066753.879138:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15834 00000100:00100000:0.0:1746066753.879146:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983146368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.879154:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.879155:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.879165:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf200, rc 0) 00010000:00010000:0.0:1746066753.879165:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13ed expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066753.879177:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.879179:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066753.879184:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066753.879204:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066753.879209:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983146624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 165us (465us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066753.879211:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71800, rc 0) 00000100:00100000:1.0:1746066753.879215:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15833 00000100:00100000:0.0:1746066753.879229:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983146368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 84us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066753.879234:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15835 00000100:00100000:1.0:1746066753.879239:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983146880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.879245:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066753.879246:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15834 00010000:00010000:1.0:1746066753.879253:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1409 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.879255:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983146752 00000100:00100000:2.0:1746066753.879257:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15836 00000100:00100000:0.0:1746066753.879262:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15837 00000100:00100000:2.0:1746066753.879266:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983146240:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066753.879268:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983146496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066753.879270:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066753.879271:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066753.879272:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15838 00010000:00010000:0.0:1746066753.879274:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.879276:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066753.879279:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983146752:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066753.879281:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa6a48 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13f4 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.879283:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.879286:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066753.879286:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.879293:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1402 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066753.879293:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf400, rc 0) 00010000:00010000:2.0:1746066753.879298:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d13e6 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.879304:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.879306:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066753.879308:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983146880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 69us (535us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066753.879311:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066753.879314:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15835 00010000:00010000:3.0:1746066753.879320:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.879320:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.879321:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.879327:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1a00, rc 0) 00010000:00010000:2.0:1746066753.879329:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.879340:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 19 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066753.879348:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983146752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 70us (510us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066753.879349:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3000, rc 0) 00000100:00100000:3.0:1746066753.879363:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15838 00000100:00100000:2.0:1746066753.879391:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983146240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 126us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.879396:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15836 00000100:00100000:0.0:1746066753.879410:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130d8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984426368:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066753.879476:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1180 going to sleep for 11 seconds 00002000:00010000:2.0:1746066753.880260:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066753 -> 1746066754 00002000:00010000:2.0:1746066753.880264:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066753 -> 1746066754 00000100:00100000:2.0:1746066753.880277:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130d8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984426368:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066753.880299:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa6a48 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13f4 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.880309:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa6a48 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13f4 expref: 12 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.880336:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70400, rc 0) 00000100:00100000:2.0:1746066753.880369:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983146496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1100us (1557us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066753.880374:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15837 00000100:00100000:0.0:1746066753.887772:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.887859:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.888053:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983147136 00000100:00100000:3.0:1746066753.888064:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983147136 00002000:00100000:3.0:1746066753.888144:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880130d8a300 x1830882983147136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.888156:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8a300 with x1830882983147136 ext(0->1048575) 00002000:00010000:3.0:1746066753.888163:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d8a300 00000100:00100000:3.0:1746066753.888189:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983147392 00000100:00100000:3.0:1746066753.888193:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983147392 00002000:00100000:3.0:1746066753.888211:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130d8b800 x1830882983147392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.888218:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b800 with x1830882983147392 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.888221:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8b800 00000100:00100000:3.0:1746066753.888240:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4141 00000100:00100000:3.0:1746066753.888249:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983147136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066753.888308:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4142 00000100:00100000:1.0:1746066753.888318:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983147392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066753.897495:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.897639:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983147136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9389us (9878us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066753.897648:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4141 00000100:00100000:1.0:1746066753.897654:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983147776 00002000:00100000:3.0:1746066753.897657:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880130d8a300 x1830882983147136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066753.897661:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983147776 00002000:00100000:3.0:1746066753.897665:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8a300 with x1830882983147136 ext(0->1048575) 00002000:00010000:3.0:1746066753.897670:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d8a300 00002000:00100000:1.0:1746066753.897690:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096fd4e00 x1830882983147776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746066753.897690:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746066753.897696:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4e00 with x1830882983147776 ext(2097152->4194303) 00002000:00010000:1.0:1746066753.897700:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd4e00 00000100:00100000:1.0:1746066753.897716:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983147904 00000100:00100000:1.0:1746066753.897719:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983147904 00002000:00100000:1.0:1746066753.897731:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880096fd7480 x1830882983147904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.897738:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7480 with x1830882983147904 ext(2097152->4194303) 00002000:00010000:1.0:1746066753.897741:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd7480 00000100:00100000:1.0:1746066753.897758:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4143 00000100:00100000:1.0:1746066753.897764:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983147776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.897780:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4144 00000100:00100000:3.0:1746066753.897787:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983147904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066753.898954:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983147392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10635us (11094us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066753.898962:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4142 00002000:00100000:1.0:1746066753.898968:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130d8b800 x1830882983147392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066753.898975:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b800 with x1830882983147392 ext(1048576->2097151) 00002000:00010000:1.0:1746066753.898978:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8b800 00000100:00100000:1.0:1746066753.911108:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.911282:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148032 00000100:00100000:2.0:1746066753.911293:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148032 00000100:00100000:2.0:1746066753.911354:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15839 00000100:00100000:2.0:1746066753.911363:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+11:533:x1830882983148032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.911385:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.911404:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1410 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.911434:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 30 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.911442:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.911444:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066753.911447:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.911478:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 30 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.911490:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 30 pid: 9590 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066753.911503:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984426496:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.912299:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983147776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14532us (14807us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066753.912309:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4143 00002000:00100000:3.0:1746066753.912319:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096fd4e00 x1830882983147776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.912338:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4e00 with x1830882983147776 ext(2097152->4194303) 00002000:00010000:3.0:1746066753.912343:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd4e00 00000100:00100000:2.0:1746066753.912465:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.913932:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984426496:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066753.913960:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.913982:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894600, rc 0) 00000100:00100000:2.0:1746066753.914025:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:533:x1830882983148032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2662us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.914033:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15839 00000100:00100000:0.0:1746066753.918252:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.918389:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148160 00000100:00100000:3.0:1746066753.918400:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148160 00002000:00100000:3.0:1746066753.918444:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1941504->2052095) req@ffff880096fd4a80 x1830882983148160/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.918453:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4a80 with x1830882983148160 ext(1941504->2052095) 00010000:00010000:3.0:1746066753.918462:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066753.918477:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066753.918489:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096fd4a80 00000100:00100000:3.0:1746066753.918615:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 914 00000100:00100000:3.0:1746066753.918623:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983148160:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066753.918659:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983147904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20871us (20966us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066753.918668:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4144 00002000:00100000:2.0:1746066753.918674:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880096fd7480 x1830882983147904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.918682:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7480 with x1830882983147904 ext(2097152->4194303) 00002000:00010000:2.0:1746066753.918685:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096fd7480 00000100:00100000:3.0:1746066753.921149:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882983148160:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2519us (2900us total) trans 17179874401 rc 0/0 00000100:00100000:3.0:1746066753.921160:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 914 00002000:00100000:3.0:1746066753.921172:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1941504->2052095) req@ffff880096fd4a80 x1830882983148160/t17179874401(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/448 e 0 to 0 dl 1746066764 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.921180:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd4a80 with x1830882983148160 ext(1941504->2052095) 00010000:00010000:3.0:1746066753.921190:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066753.921203:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066753.921209:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096fd4a80 00000100:00100000:0.0:1746066753.923682:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.923783:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148288 00000100:00100000:3.0:1746066753.923792:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148288 00010000:00010000:3.0:1746066753.923830:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066753.923870:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7095 00000100:00100000:3.0:1746066753.923878:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983148288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.923921:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.923941:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066753.923953:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066753.923977:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa6984 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1941504->2052095) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1399 expref: 31 pid: 9590 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066753.924002:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.924004:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.924011:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.924019:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.924050:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066753.924063:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984426624:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066753.924567:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066753.924964:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.925034:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148416 00000100:00100000:2.0:1746066753.925039:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148416 00000100:00100000:2.0:1746066753.925074:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15840 00000100:00100000:2.0:1746066753.925080:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983148416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066753.925096:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.925109:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1417 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.925124:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.925126:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066753.925130:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.925143:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066753.925152:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895000, rc 0) 00000100:00100000:2.0:1746066753.925181:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983148416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 101us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.925187:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15840 00000100:00100000:3.0:1746066753.927569:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984426624:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066753.927591:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.927748:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983148288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3868us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.927759:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7095 00000100:00100000:0.0:1746066753.933829:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.933939:0:8138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148544 00000100:00100000:2.0:1746066753.933949:0:8138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148544 00000100:00100000:2.0:1746066753.933995:0:8138:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 183 00000100:00100000:2.0:1746066753.934003:0:8138:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009673c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882983148544:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066753.934080:0:8138:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009673c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882983148544:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.934086:0:8138:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 183 00000100:00100000:1.0:1746066753.934491:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.934536:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066753.934655:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.934746:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148800 00000100:00100000:2.0:1746066753.934750:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148800 00000100:00100000:2.0:1746066753.934782:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 901 00000100:00100000:2.0:1746066753.934788:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882983148800:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1746066753.935588:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983149184 00000100:00100000:3.0:1746066753.935593:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983149184 00002000:00100000:3.0:1746066753.935626:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012b54c000 x1830882983149184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.935636:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c000 with x1830882983149184 ext(4194304->5033983) 00002000:00010000:3.0:1746066753.935642:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c000 00000100:00100000:3.0:1746066753.935654:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983149568 00000100:00100000:3.0:1746066753.935658:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983149568 00002000:00100000:3.0:1746066753.935669:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800a4ed6300 x1830882983149568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.935677:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed6300 with x1830882983149568 ext(1048576->2097151) 00002000:00010000:3.0:1746066753.935679:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ed6300 00000100:00100000:3.0:1746066753.935697:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4145 00000100:00100000:3.0:1746066753.935702:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882983149184:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.937712:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882983148800:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 2914us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066753.937724:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 901 00000100:00080000:2.0:1746066753.937761:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746066753.937795:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4146 00000100:00100000:2.0:1746066753.937804:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983149568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066753.940007:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.940043:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.940070:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.940084:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983149696 00000100:00100000:0.0:1746066753.940091:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983149696 00002000:00100000:0.0:1746066753.940127:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012de5ed80 x1830882983149696/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066753.940136:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ed80 with x1830882983149696 ext(1048576->2097151) 00002000:00010000:0.0:1746066753.940142:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ed80 00000100:00100000:0.0:1746066753.940164:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4147 00000100:00100000:0.0:1746066753.940169:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983149696:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066753.940672:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148672 00000100:00100000:3.0:1746066753.940676:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148672 00000100:00100000:3.0:1746066753.940718:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983148928 00000100:00100000:3.0:1746066753.940720:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983148928 00000100:00100000:3.0:1746066753.940737:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 902 00000100:00100000:3.0:1746066753.940743:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882983148672:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1746066753.940796:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882983148672:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 53us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.940801:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 902 00000100:00100000:3.0:1746066753.940816:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 903 00000100:00100000:3.0:1746066753.940820:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882983148928:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:3.0:1746066753.940844:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882983148928:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 23us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.940849:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 903 00000100:00080000:3.0:1746066753.940866:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746066753.941948:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.943369:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983149952 00000100:00100000:2.0:1746066753.943377:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983149952 00000100:00100000:2.0:1746066753.943424:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16254 00000100:00100000:2.0:1746066753.943431:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:536:x1830882983149952:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066753.943451:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066753.943469:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d141e expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.943551:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943563:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943573:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943586:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943591:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943596:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943683:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943690:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943694:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066753.943702:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066753.943770:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943777:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943783:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943787:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.943790:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943795:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943805:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066753.943807:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066753.943810:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943816:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a80 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943840:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943844:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943848:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943852:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943856:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.943858:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943862:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943868:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066753.943870:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.943872:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943877:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894400/0xf1867c21abfa6a72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943901:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943906:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943910:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943914:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066753.943916:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943920:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943926:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098b5be00) 00010000:00010000:2.0:1746066753.943927:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066753.943930:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943937:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6a79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066753.943968:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d141e expref: 32 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.943974:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d141e expref: 32 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066753.943981:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:2.0:1746066753.944018:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:536:x1830882983149952:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 587us (2072us total) trans 8589936562 rc 301/301 00000100:00100000:2.0:1746066753.944024:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16254 00000100:00100000:3.0:1746066753.945371:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882983149184:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9662us (10874us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066753.945379:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4145 00002000:00100000:3.0:1746066753.945392:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012b54c000 x1830882983149184/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066753.945401:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c000 with x1830882983149184 ext(4194304->5033983) 00002000:00010000:3.0:1746066753.945407:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c000 00000100:00100000:2.0:1746066753.951551:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983149696:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11357us (11456us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.951563:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4147 00002000:00100000:2.0:1746066753.951576:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012de5ed80 x1830882983149696/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.951586:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5ed80 with x1830882983149696 ext(1048576->2097151) 00002000:00010000:2.0:1746066753.951592:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5ed80 00000100:00100000:1.0:1746066753.952551:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.952603:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983150208 00000100:00100000:2.0:1746066753.952612:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983150208 00000100:00100000:2.0:1746066753.952662:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5912 00000100:00100000:2.0:1746066753.952670:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:527:x1830882983150208:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066753.952942:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:527:x1830882983150208:12345-192.168.204.16@tcp:35:cat.0 Request processed in 272us (398us total) trans 8589936563 rc 0/0 00000100:00100000:2.0:1746066753.952949:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5912 00000100:00100000:2.0:1746066753.954183:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983149568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16377us (19524us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066753.954191:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4146 00002000:00100000:2.0:1746066753.954199:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800a4ed6300 x1830882983149568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.954210:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed6300 with x1830882983149568 ext(1048576->2097151) 00002000:00010000:2.0:1746066753.954215:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ed6300 00000100:00100000:0.0:1746066753.972981:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066753.973036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066753.973218:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983150464 00000100:00100000:2.0:1746066753.973229:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983150464 00002000:00100000:2.0:1746066753.973277:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012de5fb80 x1830882983150464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.973288:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5fb80 with x1830882983150464 ext(2097152->4194303) 00002000:00010000:2.0:1746066753.973293:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5fb80 00000100:00100000:2.0:1746066753.973326:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983150720 00000100:00100000:2.0:1746066753.973328:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983150720 00002000:00100000:2.0:1746066753.973342:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012de5df80 x1830882983150720/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/0 e 0 to 0 dl 1746066764 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.973348:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5df80 with x1830882983150720 ext(2097152->4194303) 00000100:00100000:0.0:1746066753.973351:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4148 00002000:00010000:2.0:1746066753.973352:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5df80 00000100:00100000:0.0:1746066753.973361:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983150464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.973364:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4149 00000100:00100000:2.0:1746066753.973369:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983150720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066753.987841:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.987912:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983150848 00000100:00100000:3.0:1746066753.987922:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983150848 00000100:00100000:3.0:1746066753.987981:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15841 00000100:00100000:3.0:1746066753.987989:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+20:531:x1830882983150848:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066753.988009:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066753.988027:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1425 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.988058:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.988065:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 21 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.988072:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.988079:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.988080:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066753.988084:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066753.988115:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 28 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.988128:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 28 pid: 1893 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066753.988141:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984426752:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.988242:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 21 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.988250:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 21 pid: 12233 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066753.988258:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984426880:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066753.988280:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066753.988287:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 15 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066753.988295:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.988308:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066753.993049:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983150720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19666us (20000us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066753.993062:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4149 00002000:00100000:2.0:1746066753.993075:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012de5df80 x1830882983150720/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066753.993085:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5df80 with x1830882983150720 ext(2097152->4194303) 00002000:00010000:2.0:1746066753.993092:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de5df80 00000100:00100000:3.0:1746066753.996933:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984426752:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066753.997607:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984426880:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066753.997920:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066753.999469:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983151104 00000100:00100000:3.0:1746066753.999477:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983151104 00010000:00010000:3.0:1746066753.999510:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 22 pid: 12233 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066753.999546:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7096 00000100:00100000:3.0:1746066753.999553:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983151104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066753.999567:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066753.999587:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 22 pid: 12233 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066753.999597:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 22 pid: 12233 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066753.999614:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf200/0xf1867c21abfa6a33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13fb expref: 22 pid: 12233 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066753.999638:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066753.999671:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882983151104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066753.999676:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7096 00000100:00100000:2.0:1746066754.000394:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.000417:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1699840->2097151] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.000427:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1e00, rc 0) 00000100:00100000:2.0:1746066754.000601:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+20:531:x1830882983150848:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12613us (12772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.000607:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15841 00000100:00100000:0.0:1746066754.000701:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.000969:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983150976 00000100:00100000:2.0:1746066754.000973:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983150976 00010000:00010000:2.0:1746066754.000988:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 29 pid: 1893 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.001324:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983150464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 27964us (28355us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066754.001331:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4148 00002000:00100000:3.0:1746066754.001338:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012de5fb80 x1830882983150464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:159/0 lens 488/440 e 0 to 0 dl 1746066764 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.001345:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5fb80 with x1830882983150464 ext(2097152->4194303) 00002000:00010000:3.0:1746066754.001349:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5fb80 00000100:00100000:3.0:1746066754.001414:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.002120:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983151232 00000100:00100000:2.0:1746066754.002124:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983151232 00010000:00010000:2.0:1746066754.002149:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 16 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.002173:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7097 00000100:00100000:2.0:1746066754.002179:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882983150976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.002188:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.002199:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 29 pid: 1893 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.002207:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 29 pid: 1893 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.002221:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800965fba00/0xf1867c21abfa69d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13bc expref: 29 pid: 1893 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.002234:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.002250:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882983150976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.002254:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7097 00000100:00100000:2.0:1746066754.002262:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7098 00000100:00100000:2.0:1746066754.002266:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882983151232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.002270:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.002275:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 16 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.002281:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 16 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.002290:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9000/0xf1867c21abfa6937 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d136f expref: 16 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.002300:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.002302:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.002307:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.002313:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.002334:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.002342:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984427136:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.002375:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00080000:3.0:1746066754.002501:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066754.004415:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984427136:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.004430:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.004508:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882983151232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2239us (3092us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.004516:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7098 00000100:00100000:0.0:1746066754.005228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.005307:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983151488 00000100:00100000:3.0:1746066754.005312:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983151488 00002000:00100000:3.0:1746066754.005339:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1699840->1703935) req@ffff88012de5d180 x1830882983151488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.005347:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d180 with x1830882983151488 ext(1699840->1703935) 00002000:00010000:3.0:1746066754.005351:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5d180 00000100:00100000:3.0:1746066754.005419:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4150 00000100:00100000:3.0:1746066754.005425:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983151488:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066754.005649:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983151488:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 223us (421us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.005655:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4150 00002000:00100000:3.0:1746066754.005660:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1699840->1703935) req@ffff88012de5d180 x1830882983151488/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.005666:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de5d180 with x1830882983151488 ext(1699840->1703935) 00002000:00010000:3.0:1746066754.005669:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de5d180 00000100:00100000:0.0:1746066754.012986:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.013268:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983151744 00000100:00100000:3.0:1746066754.013278:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983151744 00002000:00100000:3.0:1746066754.013328:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095800a80 x1830882983151744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.013338:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800a80 with x1830882983151744 ext(4194304->5033983) 00002000:00010000:3.0:1746066754.013345:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095800a80 00000100:00100000:3.0:1746066754.013376:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4151 00000100:00100000:3.0:1746066754.013384:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983151744:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.017612:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983151744:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4216us (4625us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066754.017624:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4151 00002000:00100000:3.0:1746066754.017635:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095800a80 x1830882983151744/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.017644:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800a80 with x1830882983151744 ext(4194304->5033983) 00002000:00010000:3.0:1746066754.017651:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095800a80 00000100:00100000:0.0:1746066754.019912:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.020018:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983151872 00000100:00100000:2.0:1746066754.020030:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983151872 00000100:00100000:2.0:1746066754.020098:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15842 00000100:00100000:2.0:1746066754.020107:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:531:x1830882983151872:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.020123:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.020138:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d142c expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.020168:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.020176:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.020183:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 27 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.020189:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.020190:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.020194:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->2441215] (req 2097152->2441215) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.020219:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 27 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.020229:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 27 pid: 13363 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.020239:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427264:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.020337:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.020345:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.020353:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427392:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.021459:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 14 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.021467:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 14 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.021475:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427520:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.021493:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.022360:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427264:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.022940:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427392:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.022947:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427520:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.022967:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->2441215] (req 2097152->2441215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.022978:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:2.0:1746066754.023000:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+19:531:x1830882983151872:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2895us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.023006:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15842 00000100:00100000:0.0:1746066754.027946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.028149:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983152128 00000100:00100000:2.0:1746066754.028157:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983152128 00010000:00010000:2.0:1746066754.028190:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 15 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.028220:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7099 00000100:00100000:2.0:1746066754.028227:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983152128:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.028240:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.028256:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 15 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.028266:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 15 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.028285:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097bc9800/0xf1867c21abfa6929 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1376 expref: 15 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.028300:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.028448:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983152128:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 221us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.028455:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7099 00000100:00100000:1.0:1746066754.028542:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.028629:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.028685:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983152000 00000100:00100000:0.0:1746066754.028689:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983152000 00010000:00010000:0.0:1746066754.028702:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 28 pid: 13363 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746066754.028721:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983152256 00000100:00100000:0.0:1746066754.028722:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983152256 00010000:00010000:0.0:1746066754.028729:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 822 lvb_type: 1 00000100:00100000:0.0:1746066754.028740:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7100 00000100:00100000:0.0:1746066754.028744:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983152000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066754.028751:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066754.028759:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 28 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746066754.028767:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 28 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746066754.028777:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009357b400/0xf1867c21abfa69d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13c3 expref: 28 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746066754.028788:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066754.028810:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983152000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066754.028815:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7100 00000100:00100000:0.0:1746066754.028826:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7101 00000100:00100000:0.0:1746066754.028830:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983152256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066754.028836:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066754.028842:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746066754.028850:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746066754.028860:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6a4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1402 expref: 19 pid: 1893 timeout: 822 lvb_type: 1 00010000:00010000:0.0:1746066754.028867:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066754.028869:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066754.028874:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066754.028881:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066754.028925:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066754.028935:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984427648:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066754.028980:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.031700:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095803b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984427648:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066754.031717:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066754.031748:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137022850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983152256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2917us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.031756:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7101 00000100:00100000:0.0:1746066754.033397:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.033470:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983152512 00000100:00100000:3.0:1746066754.033477:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983152512 00002000:00100000:3.0:1746066754.033509:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2437120->2441215) req@ffff880095802a00 x1830882983152512/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.033518:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802a00 with x1830882983152512 ext(2437120->2441215) 00002000:00010000:3.0:1746066754.033522:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095802a00 00000100:00100000:3.0:1746066754.033560:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4152 00000100:00100000:3.0:1746066754.033567:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983152512:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.033666:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983152512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 99us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.033672:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4152 00002000:00100000:3.0:1746066754.033677:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2437120->2441215) req@ffff880095802a00 x1830882983152512/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.033684:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802a00 with x1830882983152512 ext(2437120->2441215) 00002000:00010000:3.0:1746066754.033686:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095802a00 00000100:00100000:0.0:1746066754.036034:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.037579:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983152768 00000100:00100000:2.0:1746066754.037588:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983152768 00000100:00100000:2.0:1746066754.037660:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5913 00000100:00100000:2.0:1746066754.037667:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+12:531:x1830882983152768:12345-192.168.204.16@tcp:35:multiop.0 00000100:00080000:3.0:1746066754.037798:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066754.037877:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:531:x1830882983152768:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 210us (1849us total) trans 8589936564 rc 0/0 00000100:00100000:2.0:1746066754.037920:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5913 00000100:00100000:0.0:1746066754.059381:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.059483:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983152896 00000100:00100000:2.0:1746066754.059492:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983152896 00000100:00100000:2.0:1746066754.059545:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15843 00000100:00100000:2.0:1746066754.059554:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:536:x1830882983152896:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.059578:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.059597:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1433 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.059628:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 13 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.059640:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 17 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.059646:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 28 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.059652:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.059654:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.059657:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->737279] (req 0->737279) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.059687:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 28 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.059698:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 28 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.059709:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427776:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.062087:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 17 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.062101:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 17 pid: 12255 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.062113:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427904:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.062168:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 13 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.062177:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 13 pid: 13363 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.062184:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984428032:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.062381:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.066136:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427776:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.066152:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984427904:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066754.066493:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.066534:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.066583:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983153024 00000100:00100000:2.0:1746066754.066590:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983153024 00010000:00010000:2.0:1746066754.066629:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 29 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.066656:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983153152 00000100:00100000:2.0:1746066754.066658:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983153152 00010000:00010000:2.0:1746066754.066669:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 18 pid: 12255 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.066688:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7102 00000100:00100000:2.0:1746066754.066696:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983153024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066754.066699:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7103 00000100:00100000:1.0:1746066754.066707:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882983153152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.066709:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066754.066715:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.066728:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 29 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.066728:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 18 pid: 12255 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.066738:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 29 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.066802:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984428032:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066754.066900:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 18 pid: 12255 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.066927:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629ae00/0xf1867c21abfa69c3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ae expref: 29 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.066947:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.066988:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983153024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 293us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.066995:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7102 00000100:00100000:0.0:1746066754.067006:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066754.067054:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->737279] (req 0->737279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.067065:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895c00, rc 0) 00000100:00100000:3.0:1746066754.067099:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:536:x1830882983152896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7547us (7728us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.067106:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15843 00000100:00100000:2.0:1746066754.067151:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983153280 00000100:00100000:2.0:1746066754.067154:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983153280 00010000:00010000:1.0:1746066754.067162:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3000/0xf1867c21abfa6a56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13e6 expref: 18 pid: 12255 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.067165:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 14 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.067180:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.067181:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7104 00000100:00100000:2.0:1746066754.067186:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983153280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.067191:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.067198:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 14 pid: 13363 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746066754.067205:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882983153152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 499us (679us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066754.067207:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 14 pid: 13363 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746066754.067214:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7103 00010000:00010000:2.0:1746066754.067224:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14800/0xf1867c21abfa6945 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d135a expref: 14 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.067234:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.067236:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.067243:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.067251:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.067277:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.067288:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984428160:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.067332:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.069190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.069217:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984428160:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.069235:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.069273:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983153280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2085us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.069281:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7104 00000100:00100000:3.0:1746066754.069343:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983153536 00000100:00100000:3.0:1746066754.069349:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983153536 00002000:00100000:3.0:1746066754.069382:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->4095) req@ffff880095802680 x1830882983153536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.069392:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802680 with x1830882983153536 ext(0->4095) 00002000:00010000:3.0:1746066754.069396:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095802680 00000100:00100000:3.0:1746066754.069418:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4153 00000100:00100000:3.0:1746066754.069425:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983153536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066754.069579:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983153536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 154us (392us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.069584:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4153 00002000:00100000:3.0:1746066754.069589:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->4095) req@ffff880095802680 x1830882983153536/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.069595:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802680 with x1830882983153536 ext(0->4095) 00002000:00010000:3.0:1746066754.069598:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095802680 00000100:00100000:0.0:1746066754.076063:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.076112:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983153792 00000100:00100000:3.0:1746066754.076122:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983153792 00002000:00100000:3.0:1746066754.076168:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (733184->737279) req@ffff880095803800 x1830882983153792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.076178:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803800 with x1830882983153792 ext(733184->737279) 00002000:00010000:3.0:1746066754.076185:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095803800 00000100:00100000:3.0:1746066754.076215:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4154 00000100:00100000:3.0:1746066754.076226:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983153792:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066754.076374:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983153792:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 148us (420us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.076381:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4154 00002000:00100000:3.0:1746066754.076386:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (733184->737279) req@ffff880095803800 x1830882983153792/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.076393:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803800 with x1830882983153792 ext(733184->737279) 00002000:00010000:3.0:1746066754.076396:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095803800 00000100:00100000:1.0:1746066754.082335:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.083346:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983154048 00000100:00100000:2.0:1746066754.083356:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983154048 00000100:00100000:2.0:1746066754.083415:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5914 00000100:00080000:3.0:1746066754.083420:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746066754.083422:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:536:x1830882983154048:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066754.083815:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:536:x1830882983154048:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 392us (1491us total) trans 8589936565 rc 0/0 00000100:00100000:2.0:1746066754.083821:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5914 00000100:00100000:0.0:1746066754.139036:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.139211:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983154304 00000100:00100000:3.0:1746066754.139221:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983154304 00000100:00100000:3.0:1746066754.139288:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16255 00000100:00100000:3.0:1746066754.139298:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:543:x1830882983154304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.139322:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.139342:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfa6aa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d143a expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.139423:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139437:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139448:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139462:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139468:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139473:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139600:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139609:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139615:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066754.139624:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066754.139692:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139699:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139704:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139710:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.139714:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139723:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139733:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066754.139736:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066754.139740:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.139745:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0800/0xf1867c21abfa6ab8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140128:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140134:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140138:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140143:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140267:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa1600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.140271:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140280:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140288:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066754.140290:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.140293:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140297:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140305:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140309:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140313:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140317:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.140319:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140323:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140328:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0f300) 00010000:00010000:3.0:1746066754.140330:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.140332:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140337:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6ab1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.140371:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfa6aa3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d143a expref: 15 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.140379:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0c00/0xf1867c21abfa6aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d143a expref: 15 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.140391:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0c00, rc 0) 00000100:00100000:3.0:1746066754.140449:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:543:x1830882983154304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1151us (1424us total) trans 8589936566 rc 301/301 00000100:00100000:3.0:1746066754.140455:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16255 00000100:00100000:0.0:1746066754.141858:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.141964:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983154560 00000100:00100000:2.0:1746066754.141972:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983154560 00000100:00100000:2.0:1746066754.142014:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5915 00000100:00100000:2.0:1746066754.142021:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:543:x1830882983154560:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066754.142168:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:543:x1830882983154560:12345-192.168.204.16@tcp:35:cat.0 Request processed in 146us (312us total) trans 8589936567 rc 0/0 00000100:00100000:2.0:1746066754.142174:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5915 00000100:00100000:0.0:1746066754.143668:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.143741:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983154688 00000100:00100000:3.0:1746066754.143746:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983154688 00000100:00100000:3.0:1746066754.143788:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15844 00000100:00100000:3.0:1746066754.143795:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983154688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.143807:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.143824:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ac6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1441 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.143870:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984428288:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066754.144305:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f386c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746066754.145489:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066753 -> 1746066755 00002000:00010000:3.0:1746066754.145492:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066753 -> 1746066754 00002000:00010000:3.0:1746066754.145495:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746066754 -> 1746066755 00000100:00100000:3.0:1746066754.145514:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984428288:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066754.145554:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ac6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1441 expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.145564:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ac6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1441 expref: 18 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.145575:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0600, rc 0) 00000100:00100000:3.0:1746066754.145617:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983154688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1822us (1953us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066754.145624:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15844 00000100:00100000:0.0:1746066754.148260:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.148346:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983154816 00000100:00100000:3.0:1746066754.148355:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983154816 00000100:00100000:3.0:1746066754.148405:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15845 00000100:00100000:3.0:1746066754.148413:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:543:x1830882983154816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.148431:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.148448:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1448 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.148478:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.148485:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.148486:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.148490:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.148519:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 26 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.148544:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 26 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.148556:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984428416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.148717:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f386c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.151087:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984428416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.151115:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.151131:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1a00, rc 0) 00000100:00100000:3.0:1746066754.151178:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:543:x1830882983154816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2765us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.151186:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15845 00000100:00100000:0.0:1746066754.151647:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.151833:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983154944 00000100:00100000:2.0:1746066754.151840:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983154944 00002000:00100000:2.0:1746066754.151876:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->737279) req@ffff88009d9b1880 x1830882983154944/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.151921:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1880 with x1830882983154944 ext(0->737279) 00010000:00010000:2.0:1746066754.151929:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 27 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.151942:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 27 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.151948:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d9b1880 00000100:00100000:2.0:1746066754.151976:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 915 00000100:00100000:2.0:1746066754.151983:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983154944:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066754.158024:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983154944:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6031us (6367us total) trans 21474841850 rc 0/0 00000100:00100000:0.0:1746066754.158036:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 915 00002000:00100000:0.0:1746066754.158049:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->737279) req@ffff88009d9b1880 x1830882983154944/t21474841850(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066754.158058:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1880 with x1830882983154944 ext(0->737279) 00010000:00010000:0.0:1746066754.158067:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 30 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746066754.158078:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 30 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:0.0:1746066754.158085:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d9b1880 00000100:00100000:0.0:1746066754.162015:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.162117:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983155200 00000100:00100000:3.0:1746066754.162125:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983155200 00000100:00100000:3.0:1746066754.162174:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16256 00000100:00100000:3.0:1746066754.162181:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:545:x1830882983155200:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066754.162200:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.162212:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfa6ad4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d144f expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.162284:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066754.162510:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066754.162580:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.162591:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.162604:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.162609:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.162617:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:2.0:1746066754.162630:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983155328 00000100:00100000:2.0:1746066754.162634:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983155328 00010000:00010000:2.0:1746066754.162649:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 30 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.162673:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7105 00000100:00100000:2.0:1746066754.162677:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983155328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.162684:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066754.162692:0:7231:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 1968 -> 2056 00010000:00010000:2.0:1746066754.162696:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 30 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.162704:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 30 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.162715:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6a9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->737279) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1433 expref: 30 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.162734:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.162736:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.162742:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.162756:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.162785:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.162796:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984428544:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.162848:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746066754.162966:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.162975:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.162979:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066754.162986:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066754.163035:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163039:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163044:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163049:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.163052:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163057:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163063:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066754.163066:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066754.163068:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163075:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6ae9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163098:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163103:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163107:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163111:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163114:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa1200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.163116:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163120:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163125:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066754.163281:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.163285:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163289:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163298:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163302:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163306:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163310:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.163311:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163315:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163322:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0f400) 00010000:00010000:3.0:1746066754.163323:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.163325:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163329:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0000/0xf1867c21abfa6ae2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.163355:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfa6ad4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d144f expref: 17 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.163361:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1c00/0xf1867c21abfa6ad4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d144f expref: 17 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.163367:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1c00, rc 0) 00000100:00100000:3.0:1746066754.163404:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:545:x1830882983155200:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1223us (1396us total) trans 8589936568 rc 301/301 00000100:00100000:3.0:1746066754.163410:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16256 00000100:00100000:2.0:1746066754.164305:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984428544:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.164318:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.164402:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983155328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1723us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.164409:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7105 00000100:00100000:0.0:1746066754.167981:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.168083:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.168284:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983155584 00000100:00100000:2.0:1746066754.168284:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983155712 00000100:00100000:3.0:1746066754.168291:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983155584 00000100:00100000:2.0:1746066754.168291:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983155712 00002000:00100000:3.0:1746066754.168323:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d4380 x1830882983155584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.168323:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1699839) req@ffff88009d9b1f80 x1830882983155712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.168332:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4380 with x1830882983155584 ext(0->1048575) 00002000:00100000:2.0:1746066754.168332:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1f80 with x1830882983155712 ext(1048576->1699839) 00002000:00010000:3.0:1746066754.168336:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d4380 00002000:00010000:2.0:1746066754.168336:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1f80 00000100:00100000:3.0:1746066754.168351:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4155 00000100:00100000:2.0:1746066754.168362:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4156 00000100:00100000:2.0:1746066754.168366:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983155712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.168369:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983155584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.174071:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.174172:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983156096 00000100:00100000:3.0:1746066754.174179:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983156096 00000100:00100000:2.0:1746066754.174311:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983155712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5943us (6335us total) trans 0 rc 651264/651264 00000100:00100000:2.0:1746066754.174320:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4156 00002000:00100000:2.0:1746066754.174329:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1699839) req@ffff88009d9b1f80 x1830882983155712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.174351:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1f80 with x1830882983155712 ext(1048576->1699839) 00002000:00010000:2.0:1746066754.174355:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1f80 00000100:00100000:1.0:1746066754.174418:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16257 00000100:00100000:1.0:1746066754.174427:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:548:x1830882983156096:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.174449:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.174465:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa6af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1456 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.174540:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174552:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174560:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174571:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174576:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174581:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174655:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174663:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174671:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066754.174678:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066754.174725:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174731:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174736:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174741:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0152c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066754.174744:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174749:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174757:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066754.174760:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066754.174763:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174767:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152c00/0xf1867c21abfa6b0c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174795:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174800:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174808:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174812:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174816:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0152400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066754.174818:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174823:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174828:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066754.174830:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066754.174832:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174836:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152400/0xf1867c21abfa6afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174842:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174846:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174850:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174853:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0153800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066754.174855:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174862:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174866:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097855400) 00010000:00010000:1.0:1746066754.174868:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066754.174869:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174873:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153800/0xf1867c21abfa6b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.174917:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa6af7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1456 expref: 35 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.174924:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa6af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1456 expref: 35 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.174931:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152600, rc 0) 00000100:00100000:1.0:1746066754.174951:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:548:x1830882983156096:12345-192.168.204.16@tcp:101:cat.0 Request processed in 527us (887us total) trans 8589936569 rc 301/301 00000100:00100000:1.0:1746066754.174957:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16257 00000100:00100000:3.0:1746066754.181165:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983155584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12798us (13072us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.181177:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4155 00002000:00100000:3.0:1746066754.181186:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d4380 x1830882983155584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.181195:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4380 with x1830882983155584 ext(0->1048575) 00002000:00010000:3.0:1746066754.181200:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d4380 00000100:00100000:1.0:1746066754.181645:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.181792:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.181878:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.182234:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983156224 00000100:00100000:3.0:1746066754.182241:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983156224 00000100:00100000:3.0:1746066754.182269:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983156480 00000100:00100000:3.0:1746066754.182271:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983156480 00000100:00100000:3.0:1746066754.182290:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983156352 00000100:00100000:3.0:1746066754.182292:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983156352 00000100:00100000:2.0:1746066754.182300:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15846 00000100:00100000:2.0:1746066754.182308:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983156224:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066754.182309:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15847 00000100:00100000:3.0:1746066754.182313:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983156480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.182326:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066754.182326:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15848 00000100:00100000:2.0:1746066754.182329:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983156352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.182333:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.182339:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fa1c00/0xf1867c21abfa6b1a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d146b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.182339:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa6b21 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1464 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.182378:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984428672:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.182378:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984428800:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.182432:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066754.182442:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.182448:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d145d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.182458:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.182459:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.182466:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.182478:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.182485:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0ca00, rc 0) 00000100:00100000:3.0:1746066754.182520:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.182521:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983156224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 213us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.182540:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15846 00002000:00010000:3.0:1746066754.183735:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066754 -> 1746066755 00002000:00010000:3.0:1746066754.183740:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066754 -> 1746066755 00002000:00010000:3.0:1746066754.183742:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066754 -> 1746066755 00000100:00100000:3.0:1746066754.183756:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984428672:192.168.204.16@tcp:106: 00002000:00010000:2.0:1746066754.183762:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066753 -> 1746066755 00002000:00010000:2.0:1746066754.183768:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066753 -> 1746066755 00002000:00010000:2.0:1746066754.183770:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066754 -> 1746066755 00010000:00010000:3.0:1746066754.183774:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1c00/0xf1867c21abfa6b1a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d146b expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.183783:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1c00/0xf1867c21abfa6b1a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d146b expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066754.183785:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984428800:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066754.183807:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1c00, rc 0) 00010000:00010000:2.0:1746066754.183808:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa6b21 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1464 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.183820:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa6b21 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1464 expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.183834:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c800, rc 0) 00000100:00100000:3.0:1746066754.183836:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983156480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1521us (2043us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066754.183841:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15847 00000100:00100000:2.0:1746066754.183866:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983156352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1535us (1987us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.183874:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15848 00000100:00100000:0.0:1746066754.200741:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.200924:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983156736 00000100:00100000:3.0:1746066754.200934:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983156736 00002000:00100000:3.0:1746066754.200975:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2441216->4194303) req@ffff8800945d5880 x1830882983156736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.200987:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5880 with x1830882983156736 ext(2441216->4194303) 00002000:00010000:3.0:1746066754.200992:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5880 00000100:00100000:3.0:1746066754.201400:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4157 00000100:00100000:3.0:1746066754.201407:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983156736:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.202635:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.202730:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983156992 00000100:00100000:2.0:1746066754.202736:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983156992 00002000:00100000:2.0:1746066754.202763:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d4700 x1830882983156992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.202771:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4700 with x1830882983156992 ext(0->1048575) 00002000:00010000:2.0:1746066754.202775:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d4700 00000100:00100000:2.0:1746066754.202797:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4158 00000100:00100000:2.0:1746066754.202803:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983156992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066754.203476:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.203607:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983157248 00000100:00100000:2.0:1746066754.203612:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983157248 00002000:00100000:2.0:1746066754.203630:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096426300 x1830882983157248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.203832:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426300 with x1830882983157248 ext(1048576->2097151) 00002000:00010000:2.0:1746066754.203836:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096426300 00000100:00100000:2.0:1746066754.203863:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4159 00000100:00100000:2.0:1746066754.203869:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983157248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.213608:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.213717:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983157504 00000100:00100000:3.0:1746066754.213729:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983157504 00000100:00100000:3.0:1746066754.213784:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16258 00000100:00100000:3.0:1746066754.213793:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:550:x1830882983157504:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066754.213820:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.213839:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6b2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1472 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.213940:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.213953:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.213964:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.213977:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.213983:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.213988:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:2.0:1746066754.214005:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983156736:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12596us (13274us total) trans 0 rc 1753088/1753088 00000100:00100000:2.0:1746066754.214015:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4157 00002000:00100000:2.0:1746066754.214024:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2441216->4194303) req@ffff8800945d5880 x1830882983156736/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1753088/1753088 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.214032:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5880 with x1830882983156736 ext(2441216->4194303) 00002000:00010000:2.0:1746066754.214038:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5880 00010000:00010000:3.0:1746066754.214084:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214093:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214098:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066754.214108:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066754.214178:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214184:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214190:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214195:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa1600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.214199:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214205:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214214:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066754.214216:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066754.214220:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214225:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1600/0xf1867c21abfa6b44 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214263:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214268:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214272:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214280:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214284:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.214286:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214291:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214297:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066754.214299:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.214301:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214305:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0200/0xf1867c21abfa6b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214312:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214316:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214320:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214324:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fa0600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.214326:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214330:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214338:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0f600) 00010000:00010000:3.0:1746066754.214340:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.214342:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214345:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa0600/0xf1867c21abfa6b3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.214376:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6b2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1472 expref: 36 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.214383:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fa1200/0xf1867c21abfa6b2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1472 expref: 36 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.214389:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1200, rc 0) 00000100:00100000:3.0:1746066754.214444:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:550:x1830882983157504:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 652us (843us total) trans 8589936570 rc 301/301 00000100:00100000:3.0:1746066754.214450:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16258 00000100:00100000:2.0:1746066754.218948:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983156992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16132us (16302us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066754.218962:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4158 00002000:00100000:2.0:1746066754.218974:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800945d4700 x1830882983156992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.218985:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4700 with x1830882983156992 ext(0->1048575) 00002000:00010000:2.0:1746066754.218991:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d4700 00000100:00100000:2.0:1746066754.224495:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983157248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20614us (21007us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066754.224507:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4159 00002000:00100000:2.0:1746066754.224518:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096426300 x1830882983157248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.224538:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096426300 with x1830882983157248 ext(1048576->2097151) 00002000:00010000:2.0:1746066754.224544:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096426300 00000100:00100000:0.0:1746066754.226501:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.226682:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983157760 00000100:00100000:2.0:1746066754.226691:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983157760 00002000:00100000:2.0:1746066754.226729:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800945d5180 x1830882983157760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.226738:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5180 with x1830882983157760 ext(4194304->5033983) 00002000:00010000:2.0:1746066754.226742:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5180 00000100:00100000:2.0:1746066754.226761:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4160 00000100:00100000:2.0:1746066754.226769:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983157760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.232609:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.233005:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983157888 00000100:00100000:2.0:1746066754.233020:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983157888 00000100:00100000:2.0:1746066754.233068:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15849 00000100:00100000:2.0:1746066754.233075:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:548:x1830882983157888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.233090:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.233104:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1479 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.233128:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.233139:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.233141:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.233144:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.233169:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.233179:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 19 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.233189:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984428928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.233281:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.233377:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+18:2014:x1830882983157760:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6605us (6876us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066754.233387:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4160 00002000:00100000:3.0:1746066754.233398:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800945d5180 x1830882983157760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.233430:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d5180 with x1830882983157760 ext(4194304->5033983) 00002000:00010000:3.0:1746066754.233435:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800945d5180 00000100:00100000:0.0:1746066754.235756:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.235869:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984428928:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.235925:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.235941:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d200, rc 0) 00000100:00100000:2.0:1746066754.235976:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:548:x1830882983157888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2901us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.235985:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15849 00000100:00100000:3.0:1746066754.236061:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983158016 00000100:00100000:3.0:1746066754.236069:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983158016 00002000:00100000:3.0:1746066754.236104:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1699840->2097151) req@ffff8800967a8e00 x1830882983158016/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.236112:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882983158016 ext(1699840->2097151) 00010000:00010000:3.0:1746066754.236118:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 18 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.236130:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 18 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.236136:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a8e00 00000100:00100000:3.0:1746066754.236160:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 916 00000100:00100000:3.0:1746066754.236167:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882983158016:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066754.237032:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.237811:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983158144 00000100:00100000:2.0:1746066754.237818:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983158144 00000100:00100000:2.0:1746066754.238135:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15850 00000100:00100000:2.0:1746066754.238144:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882983158144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.238160:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.238177:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d600/0xf1867c21abfa6b59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1480 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.238229:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984429056:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.238333:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.245342:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984429056:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.245379:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d600/0xf1867c21abfa6b59 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1480 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.245394:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d600/0xf1867c21abfa6b59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1480 expref: 21 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.245411:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d600, rc 0) 00000100:00100000:2.0:1746066754.245473:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882983158144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7328us (8439us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.245482:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15850 00000100:00100000:3.0:1746066754.247909:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882983158016:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11737us (12155us total) trans 21474841851 rc 0/0 00000100:00100000:3.0:1746066754.247920:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 916 00002000:00100000:3.0:1746066754.247930:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1699840->2097151) req@ffff8800967a8e00 x1830882983158016/t21474841851(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.247939:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882983158016 ext(1699840->2097151) 00010000:00010000:3.0:1746066754.247949:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 20 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.247962:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 20 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.247969:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a8e00 00000100:00100000:1.0:1746066754.252362:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.252459:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.252539:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983158272 00000100:00100000:2.0:1746066754.252548:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983158272 00000100:00100000:2.0:1746066754.252592:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15851 00000100:00100000:2.0:1746066754.252600:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882983158272:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.252621:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.252639:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa6b60 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1487 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.252699:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984429184:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.252779:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.252863:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983158400 00000100:00100000:3.0:1746066754.252867:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983158400 00010000:00010000:3.0:1746066754.252905:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 22 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.252927:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7106 00000100:00100000:3.0:1746066754.252932:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983158400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.252941:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.252960:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 22 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.252972:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 22 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.252990:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.252992:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.253001:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.253008:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.253030:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.253037:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984429312:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.253090:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.253875:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984429312:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.253905:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.253942:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983158400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1009us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.253948:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7106 00010000:00010000:2.0:1746066754.254089:0:12255:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880093cced80 x1830882984429184) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.254121:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1e00/0xf1867c21abfa6a8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1425 expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.254144:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984429184:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.254167:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa6b60 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1487 expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.254177:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c800/0xf1867c21abfa6b60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1487 expref: 20 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.254183:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c800, rc 0) 00000100:00100000:2.0:1746066754.254240:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882983158272:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1639us (1889us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.254246:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15851 00000100:00100000:0.0:1746066754.255778:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.255999:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983158656 00000100:00100000:3.0:1746066754.256006:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983158656 00002000:00100000:3.0:1746066754.256044:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a9180 x1830882983158656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.256053:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9180 with x1830882983158656 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.256058:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a9180 00000100:00100000:3.0:1746066754.256085:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4161 00000100:00100000:3.0:1746066754.256092:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983158656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.265960:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983158656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9857us (10174us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.265971:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4161 00002000:00100000:3.0:1746066754.265982:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a9180 x1830882983158656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.265991:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9180 with x1830882983158656 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.265997:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a9180 00000100:00100000:0.0:1746066754.272293:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.272664:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.272735:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983158784 00000100:00100000:2.0:1746066754.272737:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983158912 00000100:00100000:2.0:1746066754.272745:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983158912 00000100:00100000:1.0:1746066754.272745:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983158784 00000100:00100000:1.0:1746066754.272804:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15852 00000100:00100000:2.0:1746066754.272810:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15853 00000100:00100000:1.0:1746066754.272811:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:548:x1830882983158784:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066754.272816:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:550:x1830882983158912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.272847:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.272847:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.272863:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1495 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.272863:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d148e expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.272918:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.272919:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.272926:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.272926:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066754.272927:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.272928:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.272931:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.272931:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.272959:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.272960:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 18 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.272971:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 18 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746066754.272983:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984429440:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.273010:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 34 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.273019:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984429568:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066754.273065:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.273494:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.274410:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984429440:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066754.274439:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.274454:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418000, rc 0) 00000100:00100000:1.0:1746066754.274496:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:548:x1830882983158784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1685us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.274501:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984429568:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066754.274503:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15852 00010000:00010000:2.0:1746066754.274514:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.274536:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0da00, rc 0) 00000100:00100000:0.0:1746066754.274541:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.274554:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:550:x1830882983158912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1738us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.274559:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15853 00000100:00100000:3.0:1746066754.274680:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983159040 00000100:00100000:3.0:1746066754.274686:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983159040 00002000:00100000:3.0:1746066754.274728:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2441215) req@ffff8800967a9880 x1830882983159040/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.274736:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9880 with x1830882983159040 ext(2097152->2441215) 00010000:00010000:3.0:1746066754.274743:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 19 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.274751:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 19 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.274756:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9880 00000100:00100000:3.0:1746066754.274786:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 917 00000100:00100000:3.0:1746066754.274791:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882983159040:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066754.275694:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.275776:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983159168 00000100:00100000:3.0:1746066754.275782:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983159168 00010000:00010000:3.0:1746066754.275806:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.276149:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7107 00000100:00100000:3.0:1746066754.276156:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983159168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.276169:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.276184:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.276194:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.276211:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1479 expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.276465:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.276468:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.276474:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.276482:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.276508:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.276519:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984429696:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.276829:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.277996:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984429696:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.278008:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.278177:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983159168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2020us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.278185:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7107 00000100:00100000:2.0:1746066754.278343:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983159040:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3550us (3800us total) trans 21474841852 rc 0/0 00000100:00100000:2.0:1746066754.278351:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 917 00002000:00100000:2.0:1746066754.278359:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2441215) req@ffff8800967a9880 x1830882983159040/t21474841852(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.278367:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9880 with x1830882983159040 ext(2097152->2441215) 00010000:00010000:2.0:1746066754.278374:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.278384:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.278390:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9880 00000100:00100000:0.0:1746066754.278561:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.278729:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983159424 00000100:00100000:2.0:1746066754.278734:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983159424 00002000:00100000:2.0:1746066754.278759:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1523712->1527807) req@ffff8800967aa680 x1830882983159424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.278766:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882983159424 ext(1523712->1527807) 00002000:00010000:2.0:1746066754.278769:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aa680 00000100:00100000:2.0:1746066754.278792:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4162 00000100:00100000:2.0:1746066754.278798:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983159424:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066754.278984:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983159424:12345-192.168.204.16@tcp:3:cat.0 Request processed in 185us (424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066754.278990:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4162 00002000:00100000:2.0:1746066754.278995:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1523712->1527807) req@ffff8800967aa680 x1830882983159424/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.279007:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882983159424 ext(1523712->1527807) 00002000:00010000:2.0:1746066754.279009:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aa680 00000100:00100000:0.0:1746066754.283058:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.283281:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983159552 00000100:00100000:3.0:1746066754.283288:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983159552 00010000:00010000:3.0:1746066754.283314:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.283612:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7108 00000100:00100000:3.0:1746066754.283623:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137020c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983159552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.283635:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.283651:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.283663:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.283680:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6a95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2441215) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d142c expref: 21 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.283855:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.283858:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.283864:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.284170:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.284199:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.284210:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984429824:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.284401:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.286654:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984429824:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.286670:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.286706:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137020c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983159552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3085us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.286717:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7108 00000100:00100000:0.0:1746066754.289328:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.289535:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983159680 00000100:00100000:2.0:1746066754.289547:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983159680 00000100:00100000:0.0:1746066754.289603:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.289682:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15854 00000100:00100000:2.0:1746066754.289690:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+12:545:x1830882983159680:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.289706:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.289725:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d149c expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.289750:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.289758:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 13 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.289765:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.289771:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.289773:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.289775:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.289808:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 30 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.289823:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 30 pid: 12255 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.289834:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984429952:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.289949:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 13 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.289957:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 13 pid: 11630 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.289965:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430080:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.289991:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.289999:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 8 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.290006:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.290024:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.290160:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983159936 00000100:00100000:3.0:1746066754.290167:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983159936 00002000:00100000:3.0:1746066754.290204:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800967a8000 x1830882983159936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.290214:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882983159936 ext(2097152->4194303) 00002000:00010000:3.0:1746066754.290219:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:3.0:1746066754.290250:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4163 00000100:00100000:3.0:1746066754.290257:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983159936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.291418:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.291447:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160064 00000100:00100000:3.0:1746066754.291450:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160064 00000100:00100000:2.0:1746066754.291482:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984429952:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.291488:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 9 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.291493:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430080:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.291502:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430208:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.291515:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7109 00000100:00100000:3.0:1746066754.291531:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2013:x1830882983160064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.291540:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1499136->2097151] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.291541:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.291554:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d000, rc 0) 00010000:00010000:3.0:1746066754.291558:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 9 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.291569:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 9 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.291589:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fafa00/0xf1867c21abfa6930 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1361 expref: 9 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.291593:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+13:545:x1830882983159680:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1903us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.291600:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15854 00010000:00010000:3.0:1746066754.291616:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.291640:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2013:x1830882983160064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.291647:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7109 00000100:00080000:0.0:1746066754.291829:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066754.294365:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.294417:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.294430:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160192 00000100:00100000:3.0:1746066754.294437:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160192 00010000:00010000:3.0:1746066754.294465:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 13 pid: 11630 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.294495:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160320 00000100:00100000:3.0:1746066754.294497:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160320 00010000:00010000:3.0:1746066754.294507:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 31 pid: 12255 timeout: 822 lvb_type: 1 00000100:00100000:1.0:1746066754.294543:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7110 00000100:00100000:1.0:1746066754.294558:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983160192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066754.294576:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066754.294597:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 13 pid: 11630 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.294609:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 13 pid: 11630 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.294628:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71800/0xf1867c21abfa6a3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ed expref: 13 pid: 11630 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.294645:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066754.294698:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983160192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.294900:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7111 00000100:00100000:1.0:1746066754.294908:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7110 00000100:00100000:3.0:1746066754.294909:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983160320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.294919:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.294931:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 31 pid: 12255 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.294942:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 31 pid: 12255 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.294958:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc0e800/0xf1867c21abfa69ca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13b5 expref: 31 pid: 12255 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.294985:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.294987:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.294994:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 11 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.295003:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 11 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.295032:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 11 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.295043:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984430336:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.295255:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.297605:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984430336:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.297623:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.297669:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983160320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2761us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.297678:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7111 00000100:00100000:2.0:1746066754.300588:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983159936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10323us (10977us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066754.300599:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4163 00002000:00100000:2.0:1746066754.300609:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800967a8000 x1830882983159936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.300618:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882983159936 ext(2097152->4194303) 00002000:00010000:2.0:1746066754.300623:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:0.0:1746066754.302634:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.302716:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160448 00000100:00100000:2.0:1746066754.302723:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160448 00000100:00100000:2.0:1746066754.302769:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15855 00000100:00100000:2.0:1746066754.302777:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+12:545:x1830882983160448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.302791:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.302807:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14a3 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.302831:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.302839:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.302845:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.302846:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.302849:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.302872:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.302921:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 29 pid: 11630 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.302932:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430464:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.303003:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.303010:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 13 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.303017:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430592:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.303030:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.305476:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.305529:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.305615:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430464:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.305623:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984430592:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.305642:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1318911] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.305658:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d200, rc 0) 00000100:00100000:2.0:1746066754.305696:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+13:545:x1830882983160448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2919us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.305702:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15855 00000100:00100000:3.0:1746066754.305718:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160576 00000100:00100000:3.0:1746066754.305722:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160576 00010000:00010000:3.0:1746066754.305745:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 30 pid: 11630 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.305763:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160704 00000100:00100000:3.0:1746066754.305764:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160704 00010000:00010000:3.0:1746066754.305772:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 13 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746066754.305783:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7112 00000100:00100000:3.0:1746066754.305787:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7113 00000100:00100000:1.0:1746066754.305790:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983160576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066754.305791:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882983160704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.305799:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066754.305799:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.305812:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 13 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.305812:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 30 pid: 11630 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.305820:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 30 pid: 11630 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.305829:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 13 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.305978:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895000/0xf1867c21abfa6a64 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1417 expref: 30 pid: 11630 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.305981:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d894600/0xf1867c21abfa6a5d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1410 expref: 13 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.305990:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.305991:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.305995:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.306002:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.306069:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066754.306092:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983160576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 302us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.306097:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7112 00010000:00010000:3.0:1746066754.306159:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 12 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.306173:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984430720:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.306234:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.306714:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.306805:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160832 00000100:00100000:2.0:1746066754.306811:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160832 00000100:00100000:2.0:1746066754.306858:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15856 00000100:00100000:2.0:1746066754.306866:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:550:x1830882983160832:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.307055:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.307072:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14aa expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.307096:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.307104:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.307105:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.307109:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.307235:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.307246:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 33 pid: 3528 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.307272:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984430848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.307350:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.308073:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.308246:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.308288:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983160960 00000100:00100000:3.0:1746066754.308296:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983160960 00000100:00100000:3.0:1746066754.308323:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983161088 00000100:00100000:3.0:1746066754.308325:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983161088 00000100:00100000:1.0:1746066754.308331:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15857 00000100:00100000:1.0:1746066754.308341:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983160960:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066754.308342:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15858 00000100:00100000:2.0:1746066754.308349:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983161088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.308352:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.308357:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.308363:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6b8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14b1 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.308365:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfa6b91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14b8 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.308395:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984431104:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.308396:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984430976:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.308440:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.308442:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.308468:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984430720:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.308482:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.308500:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+12:2014:x1830882983160704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2708us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.308509:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7113 00000100:00100000:3.0:1746066754.308752:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984430848:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.308767:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->2113535] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.308777:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d400, rc 0) 00000100:00100000:3.0:1746066754.308836:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:550:x1830882983160832:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1970us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.308842:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15856 00000100:00100000:0.0:1746066754.309832:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.309919:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983161344 00000100:00100000:3.0:1746066754.309923:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983161344 00002000:00010000:2.0:1746066754.309930:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066754 -> 1746066755 00002000:00010000:1.0:1746066754.309932:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066753 -> 1746066755 00002000:00010000:2.0:1746066754.309933:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066754 -> 1746066755 00002000:00010000:2.0:1746066754.309934:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066754 -> 1746066755 00002000:00010000:1.0:1746066754.309936:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066753 -> 1746066755 00002000:00010000:1.0:1746066754.309938:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066754 -> 1746066755 00000100:00100000:2.0:1746066754.309944:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984431104:192.168.204.16@tcp:106: 00002000:00100000:3.0:1746066754.309949:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1314816->1318911) req@ffff88012faf0380 x1830882983161344/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.309958:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0380 with x1830882983161344 ext(1314816->1318911) 00010000:00010000:2.0:1746066754.309960:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfa6b91 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14b8 expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746066754.309966:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf0380 00010000:00010000:2.0:1746066754.309968:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c200/0xf1867c21abfa6b91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14b8 expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066754.309979:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984430976:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.309984:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c200, rc 0) 00000100:00100000:3.0:1746066754.309987:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4164 00000100:00100000:3.0:1746066754.309993:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983161344:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:1.0:1746066754.309998:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6b8a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14b1 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066754.310003:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983161088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1655us (1759us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.310007:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15858 00010000:00010000:1.0:1746066754.310008:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428600/0xf1867c21abfa6b8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14b1 expref: 31 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.310022:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428600, rc 0) 00000100:00100000:1.0:1746066754.310047:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983160960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1708us (1974us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066754.310052:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15857 00000100:00100000:3.0:1746066754.310092:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983161344:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 99us (261us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.310098:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4164 00002000:00100000:3.0:1746066754.310115:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1314816->1318911) req@ffff88012faf0380 x1830882983161344/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.310121:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0380 with x1830882983161344 ext(1314816->1318911) 00002000:00010000:3.0:1746066754.310124:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf0380 00000100:00100000:0.0:1746066754.311447:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.311501:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983161472 00000100:00100000:2.0:1746066754.311506:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983161472 00010000:00010000:2.0:1746066754.311536:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 33 pid: 3528 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.311566:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7114 00000100:00100000:2.0:1746066754.311570:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983161472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.311578:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.311591:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 33 pid: 3528 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.311601:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 33 pid: 3528 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.311616:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418000/0xf1867c21abfa6b6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d148e expref: 33 pid: 3528 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.311628:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.311629:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.311634:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.311645:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.311667:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 32 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.311677:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984431232:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.311749:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.312424:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.312564:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.312592:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983161600 00000100:00100000:1.0:1746066754.312599:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983161600 00000100:00100000:1.0:1746066754.312753:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15859 00000100:00100000:1.0:1746066754.312760:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:548:x1830882983161600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.312771:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.312782:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14bf expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.312799:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.312806:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066754.312807:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066754.312810:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.312827:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.312841:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 34 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:1.0:1746066754.312853:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984431360:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.312860:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984431232:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.312877:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066754.312921:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.312933:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983161472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1360us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.312942:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7114 00000100:00100000:2.0:1746066754.313310:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983161856 00000100:00100000:2.0:1746066754.313315:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983161856 00000100:00100000:2.0:1746066754.313347:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5916 00000100:00100000:2.0:1746066754.313353:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:545:x1830882983161856:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066754.313586:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+17:545:x1830882983161856:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 232us (1026us total) trans 8589936571 rc 0/0 00000100:00100000:2.0:1746066754.313591:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5916 00000100:00100000:0.0:1746066754.315181:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.315203:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984431360:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066754.315226:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.315240:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428a00, rc 0) 00000100:00100000:1.0:1746066754.315294:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:548:x1830882983161600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2534us (2870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.315302:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15859 00000100:00100000:3.0:1746066754.315990:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983162112 00000100:00100000:3.0:1746066754.315996:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983162112 00002000:00100000:3.0:1746066754.316030:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2109440->2113535) req@ffff88012faf3100 x1830882983162112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.316040:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3100 with x1830882983162112 ext(2109440->2113535) 00010000:00010000:3.0:1746066754.316047:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.316060:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.316067:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf3100 00000100:00100000:3.0:1746066754.316091:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 918 00000100:00100000:3.0:1746066754.316097:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983162112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.316390:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983162112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 291us (1211us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.316397:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 918 00002000:00100000:3.0:1746066754.316403:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2109440->2113535) req@ffff88012faf3100 x1830882983162112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.316416:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3100 with x1830882983162112 ext(2109440->2113535) 00010000:00010000:3.0:1746066754.316421:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.316430:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.316436:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf3100 00000100:00100000:0.0:1746066754.321176:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.321225:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.321283:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983162624 00000100:00100000:1.0:1746066754.321291:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983162624 00000100:00100000:1.0:1746066754.321326:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5917 00000100:00100000:1.0:1746066754.321332:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:550:x1830882983162624:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066754.321402:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983162368 00000100:00100000:3.0:1746066754.321406:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983162368 00002000:00100000:3.0:1746066754.321429:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2113535) req@ffff88012faf0700 x1830882983162368/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 16872/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.321438:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0700 with x1830882983162368 ext(2097152->2113535) 00010000:00010000:3.0:1746066754.321445:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.321458:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.321463:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf0700 00000100:00100000:3.0:1746066754.321477:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 919 00000100:00100000:3.0:1746066754.321482:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983162368:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066754.321550:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:550:x1830882983162624:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 217us (324us total) trans 8589936572 rc 0/0 00000100:00100000:1.0:1746066754.321556:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5917 00000100:00100000:3.0:1746066754.322345:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983162368:12345-192.168.204.16@tcp:4:cat.0 Request processed in 861us (1174us total) trans 21474841853 rc 0/0 00000100:00100000:3.0:1746066754.322352:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 919 00002000:00100000:3.0:1746066754.322358:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2113535) req@ffff88012faf0700 x1830882983162368/t21474841853(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 16872/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.322365:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0700 with x1830882983162368 ext(2097152->2113535) 00010000:00010000:3.0:1746066754.322370:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 35 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.322379:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 35 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.322385:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012faf0700 00000100:00100000:0.0:1746066754.324748:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.324805:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983162752 00000100:00100000:3.0:1746066754.324811:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983162752 00010000:00010000:3.0:1746066754.324837:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 35 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.324870:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7115 00000100:00100000:3.0:1746066754.324877:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983162752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.324907:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.324921:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 35 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.324932:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 35 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.324949:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0d400/0xf1867c21abfa6b83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2113535) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14aa expref: 35 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.324969:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.324971:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.324976:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.324984:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.325012:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.325023:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984431488:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.325099:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.326509:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984431488:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.326531:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.326553:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137021050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983162752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1677us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.326559:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7115 00000100:00100000:0.0:1746066754.329255:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.329417:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983163008 00000100:00100000:3.0:1746066754.329424:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983163008 00002000:00100000:3.0:1746066754.329459:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf3b80 x1830882983163008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.329468:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3b80 with x1830882983163008 ext(4194304->5033983) 00002000:00010000:3.0:1746066754.329473:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf3b80 00000100:00100000:3.0:1746066754.329497:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4165 00000100:00100000:3.0:1746066754.329504:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983163008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.335386:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983163008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5874us (6130us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066754.335396:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4165 00002000:00100000:3.0:1746066754.335407:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf3b80 x1830882983163008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.335416:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3b80 with x1830882983163008 ext(4194304->5033983) 00002000:00010000:3.0:1746066754.335421:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf3b80 00000100:00100000:0.0:1746066754.338873:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.338944:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.338945:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983163136 00000100:00100000:1.0:1746066754.338952:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983163136 00000100:00100000:1.0:1746066754.338997:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983163264 00000100:00100000:1.0:1746066754.338999:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983163264 00000100:00100000:2.0:1746066754.339009:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15860 00000100:00100000:2.0:1746066754.339019:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983163136:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066754.339022:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15861 00000100:00100000:1.0:1746066754.339028:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983163264:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.339034:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.339035:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.339047:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa0600/0xf1867c21abfa6ba6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14c6 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.339047:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6b9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14cd expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.339086:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984431744:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.339086:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984431616:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.339167:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.339174:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.341039:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984431616:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066754.341062:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6b9f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14cd expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.341073:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428400/0xf1867c21abfa6b9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14cd expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.341101:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428400, rc 0) 00000100:00100000:1.0:1746066754.341143:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983163264:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2114us (2198us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066754.341148:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15861 00000100:00100000:2.0:1746066754.341545:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984431744:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.341562:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa0600/0xf1867c21abfa6ba6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14c6 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.341572:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa0600/0xf1867c21abfa6ba6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14c6 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.341583:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa0600, rc 0) 00000100:00100000:2.0:1746066754.341600:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983163136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2585us (2735us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.341606:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15860 00000100:00100000:0.0:1746066754.343292:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.343465:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983163392 00000100:00100000:2.0:1746066754.343473:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983163392 00000100:00100000:2.0:1746066754.343516:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15862 00000100:00100000:2.0:1746066754.343536:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983163392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.343637:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.343652:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa6bad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14d4 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.343694:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984431872:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.343770:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.344189:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.344240:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983163520 00000100:00100000:1.0:1746066754.344244:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983163520 00000100:00100000:1.0:1746066754.344278:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15863 00000100:00100000:1.0:1746066754.344284:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983163520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.344291:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.344303:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa6bb4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14db expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.344326:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984432000:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.344377:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.346176:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984432000:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066754.346269:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa6bb4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14db expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.346282:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428c00/0xf1867c21abfa6bb4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14db expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.346304:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428c00, rc 0) 00000100:00100000:1.0:1746066754.346356:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983163520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2071us (2166us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.346361:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984431872:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.346363:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15863 00010000:00010000:2.0:1746066754.346388:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa6bad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14d4 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.346400:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fa1200/0xf1867c21abfa6bad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14d4 expref: 30 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.346411:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fa1200, rc 0) 00000100:00100000:2.0:1746066754.346637:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983163392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3101us (3353us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.346647:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15862 00000100:00100000:0.0:1746066754.349941:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.350442:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983163776 00000100:00100000:2.0:1746066754.350455:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983163776 00000100:00100000:2.0:1746066754.350517:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5918 00000100:00100000:2.0:1746066754.350536:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:548:x1830882983163776:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066754.351000:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:548:x1830882983163776:12345-192.168.204.16@tcp:35:cat.0 Request processed in 464us (1065us total) trans 8589936573 rc 0/0 00000100:00100000:2.0:1746066754.351008:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5918 00000100:00100000:0.0:1746066754.374730:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.374919:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983164032 00000100:00100000:3.0:1746066754.374930:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983164032 00000100:00100000:3.0:1746066754.375122:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16259 00000100:00100000:3.0:1746066754.375131:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:557:x1830882983164032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.375234:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.375253:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14e2 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.375354:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375368:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375378:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375392:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375397:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375403:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375517:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375535:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375540:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066754.375548:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066754.375614:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375620:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375626:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375632:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.375636:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375642:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375652:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066754.375655:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066754.375659:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375669:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895c00/0xf1867c21abfa6bd0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375703:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375709:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375713:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375717:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375721:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.375723:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375727:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375733:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066754.375734:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.375736:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375740:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6bc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375747:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375752:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375757:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375760:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.375762:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375766:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375770:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0fd00) 00010000:00010000:3.0:1746066754.375771:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.375773:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375776:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6bc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.375805:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14e2 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.375811:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14e2 expref: 19 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.375818:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894600, rc 0) 00000100:00100000:3.0:1746066754.377002:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:557:x1830882983164032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1868us (2281us total) trans 8589936574 rc 301/301 00000100:00100000:3.0:1746066754.377010:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16259 00000100:00100000:0.0:1746066754.378699:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.379111:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983164288 00000100:00100000:2.0:1746066754.379120:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983164288 00000100:00100000:2.0:1746066754.379166:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5919 00000100:00100000:2.0:1746066754.379174:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:557:x1830882983164288:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066754.379489:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:557:x1830882983164288:12345-192.168.204.16@tcp:35:cat.0 Request processed in 315us (793us total) trans 8589936575 rc 0/0 00000100:00100000:2.0:1746066754.379496:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5919 00000100:00100000:0.0:1746066754.381806:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.381851:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.382030:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983164416 00000100:00100000:2.0:1746066754.382038:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983164416 00000100:00100000:2.0:1746066754.382078:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983164544 00000100:00100000:2.0:1746066754.382081:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983164544 00000100:00100000:2.0:1746066754.382096:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15864 00000100:00100000:2.0:1746066754.382104:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882983164416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.382122:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.382140:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa6bde lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14e9 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.382169:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15865 00000100:00100000:1.0:1746066754.382176:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882983164544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.382181:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.382188:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14f0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.382189:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984432128:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066754.382198:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.382200:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.382207:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.382220:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.382229:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429800, rc 0) 00000100:00100000:1.0:1746066754.382248:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983164544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 73us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.382254:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15865 00000100:00100000:2.0:1746066754.382257:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.384367:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984432128:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.384851:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa6bde lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14e9 expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.384864:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326c600/0xf1867c21abfa6bde lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14e9 expref: 22 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.384874:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c600, rc 0) 00000100:00100000:3.0:1746066754.385120:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882983164416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3014us (3317us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066754.385131:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15864 00000100:00100000:0.0:1746066754.397757:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.397857:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.397922:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983164800 00000100:00100000:1.0:1746066754.397932:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983164800 00002000:00100000:1.0:1746066754.397982:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1499135) req@ffff88009c7fd500 x1830882983164800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066754.397984:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983165056 00000100:00100000:3.0:1746066754.397988:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983165056 00002000:00100000:1.0:1746066754.397992:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fd500 with x1830882983164800 ext(1048576->1499135) 00002000:00010000:1.0:1746066754.397997:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fd500 00002000:00100000:3.0:1746066754.398002:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1318912->2097151) req@ffff88009c7fed80 x1830882983165056/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.398008:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fed80 with x1830882983165056 ext(1318912->2097151) 00002000:00010000:3.0:1746066754.398011:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fed80 00000100:00100000:1.0:1746066754.398702:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4166 00000100:00100000:1.0:1746066754.398712:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983164800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.399218:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4167 00000100:00100000:3.0:1746066754.399225:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983165056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066754.405415:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983164800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6693us (7656us total) trans 0 rc 450560/450560 00000100:00100000:1.0:1746066754.405427:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4166 00002000:00100000:1.0:1746066754.405441:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1499135) req@ffff88009c7fd500 x1830882983164800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 450560/450560 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.405451:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fd500 with x1830882983164800 ext(1048576->1499135) 00002000:00010000:1.0:1746066754.405458:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fd500 00000100:00100000:3.0:1746066754.406452:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983165056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7225us (8592us total) trans 0 rc 778240/778240 00000100:00100000:3.0:1746066754.406460:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4167 00002000:00100000:3.0:1746066754.406467:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1318912->2097151) req@ffff88009c7fed80 x1830882983165056/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.406474:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fed80 with x1830882983165056 ext(1318912->2097151) 00002000:00010000:3.0:1746066754.406479:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fed80 00000100:00100000:0.0:1746066754.416431:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.416579:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983165184 00000100:00100000:3.0:1746066754.416590:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983165184 00000100:00100000:3.0:1746066754.416647:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15866 00000100:00100000:3.0:1746066754.416655:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:557:x1830882983165184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.416677:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.416698:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14f7 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.416738:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.416746:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.416748:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.416752:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.416786:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.416799:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 33 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.416813:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984432256:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.416945:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.420576:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.420663:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983165312 00000100:00100000:2.0:1746066754.420671:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983165312 00002000:00100000:2.0:1746066754.420726:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1523712->2097151) req@ffff880096425180 x1830882983165312/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.420735:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096425180 with x1830882983165312 ext(1523712->2097151) 00010000:00010000:2.0:1746066754.420744:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 34 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.420758:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 34 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.420764:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096425180 00000100:00100000:2.0:1746066754.420799:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 920 00000100:00100000:2.0:1746066754.420806:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983165312:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066754.421321:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984432256:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.421348:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 22 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.421363:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d894a00, rc 0) 00000100:00100000:3.0:1746066754.421402:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:557:x1830882983165184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4748us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.421409:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15866 00000100:00100000:2.0:1746066754.431718:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882983165312:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10900us (11138us total) trans 21474841854 rc 0/0 00000100:00100000:2.0:1746066754.431732:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 920 00002000:00100000:2.0:1746066754.431745:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1523712->2097151) req@ffff880096425180 x1830882983165312/t21474841854(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.431755:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096425180 with x1830882983165312 ext(1523712->2097151) 00010000:00010000:2.0:1746066754.431766:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 36 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.431781:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 36 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.431787:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096425180 00000100:00100000:0.0:1746066754.438531:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.438580:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.438627:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983165696 00000100:00100000:0.0:1746066754.438637:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983165696 00010000:00010000:0.0:1746066754.438674:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 36 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:0.0:1746066754.438721:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7116 00000100:00100000:0.0:1746066754.438730:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983165696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066754.438749:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066754.438770:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 36 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746066754.438783:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 36 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746066754.438807:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6b67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1495 expref: 36 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:0.0:1746066754.438827:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066754.438829:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066754.438835:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066754.438843:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066754.438913:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066754.438924:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984432384:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066754.439002:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.439171:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983165568 00000100:00100000:3.0:1746066754.439176:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983165568 00000100:00100000:3.0:1746066754.439215:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16260 00000100:00100000:3.0:1746066754.439221:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:559:x1830882983165568:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066754.439241:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.439255:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6bf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d14fe expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.439322:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439334:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439343:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439355:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439360:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439365:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439459:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439469:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439475:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066754.439487:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066754.439563:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439570:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439576:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439582:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.439586:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439591:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439600:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066754.439603:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066754.439607:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439612:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894200/0xf1867c21abfa6c08 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439646:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439651:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439656:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439664:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439668:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d894600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.439670:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439674:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439681:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066754.439683:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.439685:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439689:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d894600/0xf1867c21abfa6bfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439697:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439701:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439706:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439710:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d895800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066754.439712:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439717:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439726:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ce0fd00) 00010000:00010000:3.0:1746066754.439728:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066754.439730:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439734:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895800/0xf1867c21abfa6c01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066754.439767:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6bf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14fe expref: 21 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.439775:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d895e00/0xf1867c21abfa6bf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14fe expref: 21 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.439781:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:3.0:1746066754.439823:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:559:x1830882983165568:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 601us (1313us total) trans 8589936576 rc 301/301 00000100:00100000:3.0:1746066754.439829:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16260 00000100:00100000:0.0:1746066754.442927:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984432384:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066754.442950:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066754.442993:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983165696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4264us (4411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066754.443003:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7116 00000100:00100000:2.0:1746066754.443134:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.443404:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983165952 00000100:00100000:3.0:1746066754.443412:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983165952 00002000:00100000:3.0:1746066754.443454:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093ccdf80 x1830882983165952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.443465:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdf80 with x1830882983165952 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.443469:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccdf80 00000100:00100000:3.0:1746066754.443486:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4168 00000100:00100000:3.0:1746066754.443493:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983165952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.448139:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.448204:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983166080 00000100:00100000:3.0:1746066754.448215:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983166080 00000100:00100000:3.0:1746066754.448274:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15867 00000100:00100000:3.0:1746066754.448283:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:559:x1830882983166080:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066754.448304:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.448322:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1505 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.448355:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 7 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.448364:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.448372:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 28 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.448379:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.448380:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.448384:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3514368->3633151] (req 3514368->3633151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.448416:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 28 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.448434:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 28 pid: 13363 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.448447:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984432512:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.450131:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 13 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.450145:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 13 pid: 12233 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.450302:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984432640:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066754.450351:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066754.450370:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 7 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.450379:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 7 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.450387:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984432768:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.450495:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.450545:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983166336 00000100:00100000:2.0:1746066754.450553:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983166336 00000100:00100000:2.0:1746066754.450672:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16261 00000100:00100000:2.0:1746066754.450681:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:561:x1830882983166336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.450701:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.450717:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa6c1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d150c expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.450789:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450805:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450815:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450827:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450833:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450838:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450964:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450973:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.450979:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066754.450987:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066754.451056:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451063:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451068:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451074:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.451078:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451083:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451094:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.451097:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066754.451101:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451106:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c32 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451132:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451137:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451143:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451147:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451151:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.451154:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451158:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451164:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066754.451166:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.451169:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451174:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451181:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451186:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451190:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451194:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.451197:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451201:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451206:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea05600) 00010000:00010000:2.0:1746066754.451208:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.451210:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451214:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.451249:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa6c1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d150c expref: 39 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.451256:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095750000/0xf1867c21abfa6c1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d150c expref: 39 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.451264:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750000, rc 0) 00000100:00100000:2.0:1746066754.451304:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:561:x1830882983166336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 623us (959us total) trans 8589936577 rc 301/301 00000100:00100000:2.0:1746066754.451310:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16261 00000100:00100000:3.0:1746066754.452532:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983165952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9037us (9395us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.452541:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4168 00002000:00100000:3.0:1746066754.452550:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093ccdf80 x1830882983165952/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.452559:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdf80 with x1830882983165952 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.452564:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccdf80 00000100:00100000:0.0:1746066754.457012:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.457071:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984432512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066754.457085:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983166464 00000100:00100000:1.0:1746066754.457093:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983166464 00000100:00100000:3.0:1746066754.457116:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984432640:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066754.457118:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066754.457120:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 8 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.457126:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984432768:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066754.457146:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983166592 00000100:00100000:1.0:1746066754.457148:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983166592 00000100:00100000:0.0:1746066754.457150:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066754.457157:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 29 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.457160:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3514368->3633151] (req 3514368->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.457182:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895800, rc 0) 00000100:00100000:3.0:1746066754.457410:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:559:x1830882983166080:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9126us (9280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.457418:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15867 00000100:00100000:2.0:1746066754.457418:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983166720 00000100:00100000:2.0:1746066754.457422:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983166720 00000100:00100000:1.0:1746066754.457422:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7117 00000100:00100000:1.0:1746066754.457428:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983166464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.457436:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 13 pid: 12233 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.457439:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066754.457453:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7118 00010000:00010000:1.0:1746066754.457453:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 8 pid: 9590 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.457457:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983166592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066754.457462:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 8 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457463:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066754.457479:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa693e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d137d expref: 8 pid: 9590 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457688:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 29 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457697:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 29 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457708:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009357a800/0xf1867c21abfa69bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13ca expref: 29 pid: 13363 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457722:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.457750:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983166592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 292us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.457755:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7118 00000100:00100000:2.0:1746066754.457767:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7119 00000100:00100000:2.0:1746066754.457771:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882983166720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.457776:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.457781:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 13 pid: 12233 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457788:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 13 pid: 12233 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457797:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa6a41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1409 expref: 13 pid: 12233 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.457803:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.457805:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.457810:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.457816:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.457831:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066754.457836:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 12 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.457845:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984432896:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066754.457850:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2015:x1830882983166464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 421us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.457855:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7117 00000100:00100000:2.0:1746066754.457906:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.470601:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984432896:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.470624:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.470690:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2014:x1830882983166720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12916us (13537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.470700:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7119 00000100:00100000:0.0:1746066754.476600:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.476644:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.476736:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983166976 00000100:00100000:1.0:1746066754.476743:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983166976 00002000:00100000:1.0:1746066754.476778:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88006e211180 x1830882983166976/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.476787:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211180 with x1830882983166976 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.476793:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211180 00000100:00100000:1.0:1746066754.476820:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983167232 00000100:00100000:1.0:1746066754.476822:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983167232 00002000:00100000:1.0:1746066754.476832:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88006e213100 x1830882983167232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.476839:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213100 with x1830882983167232 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.476842:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e213100 00000100:00100000:1.0:1746066754.476851:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4169 00000100:00100000:1.0:1746066754.476857:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882983166976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.476934:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4170 00000100:00100000:0.0:1746066754.476940:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983167232:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.487452:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.488406:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983167360 00000100:00100000:3.0:1746066754.488417:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983167360 00000100:00100000:3.0:1746066754.488470:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15868 00000100:00100000:3.0:1746066754.488478:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:561:x1830882983167360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066754.488498:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.488527:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1513 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.488558:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.488566:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.488573:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.488575:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.488578:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4083712->4194303] (req 4083712->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.488614:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.488626:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.488638:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984433024:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.488741:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.488748:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 36 pid: 3528 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.488756:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984433152:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.488773:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.494536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.494608:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984433024:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.494784:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983167488 00000100:00100000:2.0:1746066754.494792:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983167488 00010000:00010000:2.0:1746066754.494821:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 37 pid: 3528 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.494849:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7120 00000100:00100000:2.0:1746066754.494856:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983167488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.494866:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.494906:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 37 pid: 3528 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.494918:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 37 pid: 3528 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.494940:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066754.496483:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e428a00/0xf1867c21abfa6b98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14bf expref: 37 pid: 3528 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.496507:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984433152:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.496546:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4083712->4194303] (req 4083712->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 36 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.496566:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0cc00, rc 0) 00000100:00100000:3.0:1746066754.496646:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:561:x1830882983167360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8167us (9203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.496654:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15868 00000100:00100000:2.0:1746066754.496690:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983167488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1828us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.496700:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7120 00000100:00100000:1.0:1746066754.496923:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983167232:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19981us (20276us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066754.496932:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4170 00002000:00100000:1.0:1746066754.496942:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88006e213100 x1830882983167232/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.496952:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e213100 with x1830882983167232 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.496957:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e213100 00000100:00100000:1.0:1746066754.503021:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882983166976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 26149us (26413us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066754.503034:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4169 00002000:00100000:1.0:1746066754.503048:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88006e211180 x1830882983166976/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.503058:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211180 with x1830882983166976 ext(2097152->4194303) 00010000:00010000:1.0:1746066754.503069:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 22 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:1.0:1746066754.503085:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 22 pid: 3528 timeout: 822 lvb_type: 1 00002000:00010000:1.0:1746066754.503099:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88006e211180 00000100:00100000:0.0:1746066754.503546:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.503598:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983167744 00000100:00100000:3.0:1746066754.503607:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983167744 00000100:00100000:3.0:1746066754.503642:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5920 00000100:00100000:3.0:1746066754.503649:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+20:559:x1830882983167744:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066754.503834:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:559:x1830882983167744:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 184us (289us total) trans 8589936578 rc 0/0 00000100:00100000:3.0:1746066754.503840:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5920 00000100:00100000:0.0:1746066754.510436:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.511103:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983167872 00000100:00100000:3.0:1746066754.511111:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983167872 00000100:00100000:3.0:1746066754.511149:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15869 00000100:00100000:3.0:1746066754.511156:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:557:x1830882983167872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.511171:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.511186:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d151a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.511207:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.511212:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4083712->4194303] (req 4083712->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.511217:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.511219:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.511247:0:11630:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4083712->4194303] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.511248:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066754.511257:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.511266:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0da00, rc 0) 00000100:00100000:3.0:1746066754.511313:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:557:x1830882983167872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 156us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.511319:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15869 00000100:00100000:2.0:1746066754.511411:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983168000 00000100:00100000:2.0:1746066754.511415:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983168000 00010000:00010000:2.0:1746066754.511430:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:2.0:1746066754.511553:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7121 00000100:00100000:2.0:1746066754.511559:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983168000:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.511567:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.511582:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.511590:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.511604:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e429800/0xf1867c21abfa6be5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f0 expref: 23 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:2.0:1746066754.511627:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.511628:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.511633:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.511640:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.511658:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 34 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.511668:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 34 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.511684:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984433408:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.511748:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746066754.512116:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066754.512972:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984433408:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.512982:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.513003:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983168000:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1444us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.513010:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7121 00000100:00100000:0.0:1746066754.513399:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.513596:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983168256 00000100:00100000:1.0:1746066754.513601:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983168256 00002000:00100000:1.0:1746066754.513629:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4083712->4087807) req@ffff88009666e300 x1830882983168256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.513638:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666e300 with x1830882983168256 ext(4083712->4087807) 00010000:00010000:1.0:1746066754.513644:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 35 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.513658:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 35 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746066754.513664:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666e300 00000100:00100000:1.0:1746066754.513688:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 921 00000100:00100000:1.0:1746066754.513694:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983168256:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066754.513793:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983168256:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 100us (394us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066754.513799:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 921 00002000:00100000:1.0:1746066754.513803:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4083712->4087807) req@ffff88009666e300 x1830882983168256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.513836:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666e300 with x1830882983168256 ext(4083712->4087807) 00010000:00010000:1.0:1746066754.513841:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 35 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.513849:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 35 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746066754.513854:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666e300 00000100:00100000:0.0:1746066754.516133:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.516184:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983168512 00000100:00100000:1.0:1746066754.516191:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983168512 00000100:00100000:0.0:1746066754.516199:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746066754.516220:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4083712->4194303) req@ffff88009666f480 x1830882983168512/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.516227:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666f480 with x1830882983168512 ext(4083712->4194303) 00010000:00010000:1.0:1746066754.516233:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 35 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.516243:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 35 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746066754.516249:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666f480 00000100:00100000:1.0:1746066754.516274:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 922 00000100:00100000:1.0:1746066754.516280:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983168512:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066754.516486:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983168640 00000100:00100000:3.0:1746066754.516491:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983168640 00000100:00100000:3.0:1746066754.516529:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15870 00000100:00100000:3.0:1746066754.516535:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:561:x1830882983168640:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066754.516544:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.516557:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1521 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.516697:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.516704:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.516705:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.516708:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.516736:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 11 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.516746:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 11 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.516756:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984433536:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.516907:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.518932:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984433536:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.518953:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.518965:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d400, rc 0) 00000100:00100000:1.0:1746066754.519029:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.519050:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983168768 00000100:00100000:2.0:1746066754.519090:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983168768 00002000:00100000:2.0:1746066754.519120:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3514368->3633151) req@ffff880096424700 x1830882983168768/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.519127:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096424700 with x1830882983168768 ext(3514368->3633151) 00010000:00010000:2.0:1746066754.519133:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 12 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.519142:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 12 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.519148:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096424700 00000100:00100000:2.0:1746066754.519163:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 923 00000100:00100000:2.0:1746066754.519168:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983168768:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066754.519308:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:561:x1830882983168640:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2546us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.519315:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15870 00000100:00100000:1.0:1746066754.519741:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983168512:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3459us (3611us total) trans 21474841855 rc 0/0 00000100:00100000:1.0:1746066754.519748:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 922 00002000:00100000:1.0:1746066754.519754:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4083712->4194303) req@ffff88009666f480 x1830882983168512/t21474841855(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.519767:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666f480 with x1830882983168512 ext(4083712->4194303) 00010000:00010000:1.0:1746066754.519773:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 37 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.519782:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 37 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:1.0:1746066754.519787:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009666f480 00000100:00100000:2.0:1746066754.521420:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983168768:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2246us (2386us total) trans 17179874402 rc 0/0 00000100:00100000:2.0:1746066754.521431:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 923 00002000:00100000:2.0:1746066754.521439:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3514368->3633151) req@ffff880096424700 x1830882983168768/t17179874402(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.521446:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096424700 with x1830882983168768 ext(3514368->3633151) 00010000:00010000:2.0:1746066754.521453:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 14 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.521462:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 14 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.521468:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096424700 00000100:00100000:0.0:1746066754.524789:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.524850:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983168896 00000100:00100000:2.0:1746066754.524858:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983168896 00000100:00100000:0.0:1746066754.524865:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066754.524913:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 37 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.525190:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983169024 00000100:00100000:2.0:1746066754.525194:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983169024 00010000:00010000:2.0:1746066754.525206:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 14 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.525224:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7122 00000100:00100000:2.0:1746066754.525230:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882983168896:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.525240:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.525256:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 37 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.525270:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 37 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.525288:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa6c40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4083712->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1513 expref: 37 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.525311:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.525313:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.525318:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.525326:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.525342:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7123 00010000:00010000:2.0:1746066754.525352:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.525354:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983169024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.525362:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066754.525363:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984433664:192.168.204.16@tcp:105: 00002000:00010000:3.0:1746066754.525370:0:8395:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066754 -> 1746066755 00002000:00010000:3.0:1746066754.525373:0:8395:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066754 -> 1746066755 00002000:00010000:3.0:1746066754.525375:0:8395:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066754 -> 1746066755 00010000:00010000:3.0:1746066754.525379:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 14 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.525389:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 14 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.525400:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895800/0xf1867c21abfa6c16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3514368->3633151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1505 expref: 14 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.525420:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.525422:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.525426:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.525433:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.525451:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.525459:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984433792:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.525710:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.525856:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.527607:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984433792:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.527623:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.527668:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882983169024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2318us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.527677:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7123 00000100:00100000:2.0:1746066754.528168:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984433664:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.528178:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.528207:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983168896:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2973us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.528214:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7122 00000100:00100000:0.0:1746066754.529668:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.529860:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.529909:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983169408 00000100:00100000:1.0:1746066754.529916:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983169408 00000100:00100000:2.0:1746066754.529946:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983169536 00002000:00100000:1.0:1746066754.529950:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3461120->3465215) req@ffff88009666c700 x1830882983169408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066754.529951:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983169536 00002000:00100000:1.0:1746066754.529959:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c700 with x1830882983169408 ext(3461120->3465215) 00002000:00010000:1.0:1746066754.529963:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666c700 00002000:00100000:2.0:1746066754.529967:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009666ed80 x1830882983169536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.529975:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ed80 with x1830882983169536 ext(3145728->4194303) 00002000:00010000:2.0:1746066754.529978:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666ed80 00000100:00100000:1.0:1746066754.529995:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4171 00000100:00100000:1.0:1746066754.530002:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983169408:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066754.530073:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4172 00000100:00100000:2.0:1746066754.530080:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983169536:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066754.530118:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983169408:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 115us (453us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066754.530124:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4171 00002000:00100000:1.0:1746066754.530129:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3461120->3465215) req@ffff88009666c700 x1830882983169408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.530135:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c700 with x1830882983169408 ext(3461120->3465215) 00002000:00010000:1.0:1746066754.530139:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666c700 00000100:00100000:1.0:1746066754.532984:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.533431:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983169792 00000100:00100000:3.0:1746066754.533438:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983169792 00000100:00100000:3.0:1746066754.533468:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5921 00000100:00100000:3.0:1746066754.533474:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:561:x1830882983169792:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066754.533682:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:561:x1830882983169792:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 207us (705us total) trans 8589936579 rc 0/0 00000100:00100000:3.0:1746066754.533689:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5921 00000100:00100000:2.0:1746066754.536281:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983169536:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6195us (6415us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066754.536291:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4172 00002000:00100000:2.0:1746066754.536299:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009666ed80 x1830882983169536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.536307:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666ed80 with x1830882983169536 ext(3145728->4194303) 00002000:00010000:2.0:1746066754.536312:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666ed80 00000100:00100000:0.0:1746066754.540550:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.540612:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983169920 00000100:00100000:3.0:1746066754.540619:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983169920 00000100:00100000:3.0:1746066754.540651:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15871 00000100:00100000:3.0:1746066754.540657:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:557:x1830882983169920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.540671:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.540685:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1528 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.540708:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.540715:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.540717:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.540720:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 14 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.540742:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.540751:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 28 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.540766:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984433920:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.540835:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.543808:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984433920:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.543837:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 14 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.543852:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c800, rc 0) 00000100:00100000:3.0:1746066754.543928:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:557:x1830882983169920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3269us (3385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.543939:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15871 00000100:00100000:0.0:1746066754.545045:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.545089:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983170048 00000100:00100000:2.0:1746066754.545095:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983170048 00002000:00100000:2.0:1746066754.545126:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3465215) req@ffff88009666d880 x1830882983170048/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.545134:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d880 with x1830882983170048 ext(3145728->3465215) 00010000:00010000:2.0:1746066754.545141:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 29 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.545153:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 29 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.545163:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009666d880 00000100:00100000:2.0:1746066754.545185:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 924 00000100:00100000:2.0:1746066754.545191:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983170048:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066754.549343:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983170048:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4144us (4292us total) trans 17179874403 rc 0/0 00000100:00100000:2.0:1746066754.549354:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 924 00002000:00100000:2.0:1746066754.549363:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3465215) req@ffff88009666d880 x1830882983170048/t17179874403(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.549372:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666d880 with x1830882983170048 ext(3145728->3465215) 00010000:00010000:2.0:1746066754.549380:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 31 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.549393:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 31 pid: 11630 timeout: 822 lvb_type: 0 00002000:00010000:2.0:1746066754.549399:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009666d880 00000100:00100000:0.0:1746066754.553120:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.553576:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983170176 00000100:00100000:2.0:1746066754.553584:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983170176 00010000:00010000:2.0:1746066754.553615:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 31 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.553653:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7124 00000100:00100000:2.0:1746066754.553660:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983170176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.553674:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.553688:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 31 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.553699:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 31 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.553717:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d400/0xf1867c21abfa6c4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1521 expref: 31 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.553740:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.553742:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.553747:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.553754:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.553779:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.553789:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984434048:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.553864:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.556025:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984434048:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.556051:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.556089:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983170176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2428us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.556271:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7124 00000100:00100000:0.0:1746066754.557878:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.558255:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983170432 00000100:00100000:2.0:1746066754.558263:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983170432 00002000:00100000:2.0:1746066754.558299:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88009666c380 x1830882983170432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.558308:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c380 with x1830882983170432 ext(3145728->4194303) 00002000:00010000:2.0:1746066754.558313:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666c380 00000100:00100000:2.0:1746066754.558339:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4173 00000100:00100000:2.0:1746066754.558346:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983170432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.567606:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983170432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9252us (9723us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.567618:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4173 00002000:00100000:3.0:1746066754.567628:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88009666c380 x1830882983170432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.567637:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666c380 with x1830882983170432 ext(3145728->4194303) 00002000:00010000:3.0:1746066754.567643:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009666c380 00000100:00100000:0.0:1746066754.572179:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.572563:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983170688 00000100:00100000:3.0:1746066754.572571:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983170688 00002000:00100000:3.0:1746066754.572607:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009666dc00 x1830882983170688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.572616:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666dc00 with x1830882983170688 ext(4194304->5033983) 00002000:00010000:3.0:1746066754.572620:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666dc00 00000100:00100000:3.0:1746066754.572778:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4174 00000100:00100000:3.0:1746066754.572785:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983170688:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.577618:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.579415:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983170944 00000100:00100000:2.0:1746066754.579426:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983170944 00000100:00100000:2.0:1746066754.579468:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16262 00000100:00100000:2.0:1746066754.579474:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:566:x1830882983170944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.579492:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.579508:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d152f expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.579577:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579588:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579596:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579605:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579610:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579614:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579687:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579694:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579699:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066754.579706:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066754.579756:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579762:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579767:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579772:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.579775:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579781:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579789:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.579792:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066754.579795:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579800:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6c71 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579816:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579820:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579824:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579827:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579830:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.579832:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579836:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579840:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066754.579841:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.579843:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579847:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6c63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579852:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579857:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579860:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579863:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.579865:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579869:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579874:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea05600) 00010000:00010000:2.0:1746066754.579876:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.579877:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579899:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751a00/0xf1867c21abfa6c6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.579927:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d152f expref: 41 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.579933:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6c5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d152f expref: 41 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.579940:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751400, rc 0) 00000100:00100000:2.0:1746066754.579992:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+40:566:x1830882983170944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 517us (2383us total) trans 8589936580 rc 301/301 00000100:00100000:2.0:1746066754.579998:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16262 00000100:00100000:3.0:1746066754.581133:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983170688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8346us (8959us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066754.581141:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4174 00002000:00100000:3.0:1746066754.581149:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009666dc00 x1830882983170688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.582173:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009666dc00 with x1830882983170688 ext(4194304->5033983) 00002000:00010000:3.0:1746066754.582178:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009666dc00 00000100:00100000:0.0:1746066754.582819:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.583302:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.583328:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.583948:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.584162:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.584176:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171072 00000100:00100000:1.0:1746066754.584184:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171072 00000100:00100000:2.0:1746066754.584235:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171328 00000100:00100000:2.0:1746066754.584238:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171328 00000100:00100000:1.0:1746066754.584602:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171584 00000100:00100000:1.0:1746066754.584606:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171584 00000100:00100000:1.0:1746066754.584620:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171200 00000100:00100000:1.0:1746066754.584622:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171200 00000100:00100000:1.0:1746066754.584628:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171456 00000100:00100000:1.0:1746066754.584629:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171456 00000100:00100000:1.0:1746066754.584639:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15872 00000100:00100000:1.0:1746066754.584644:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983171072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.584659:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.584672:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa6c7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1536 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.584716:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984434176:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.584772:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.584789:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15873 00000100:00100000:1.0:1746066754.584795:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882983171328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.584802:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.584810:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1544 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.584821:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.584822:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.584829:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.584841:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.584850:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a000, rc 0) 00000100:00100000:1.0:1746066754.584871:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983171328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 76us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.584876:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15873 00000100:00100000:1.0:1746066754.584909:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15874 00000100:00100000:1.0:1746066754.584915:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983171584:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.584921:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.584927:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1552 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.584937:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.584939:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.584943:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.584951:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.584958:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848aa00, rc 0) 00000100:00100000:1.0:1746066754.584972:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983171584:12345-192.168.204.16@tcp:101:cat.0 Request processed in 58us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.584976:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15874 00000100:00100000:1.0:1746066754.584986:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15875 00000100:00100000:1.0:1746066754.584990:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983171200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.584998:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.585003:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa6c94 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d153d expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.585021:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984434304:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.585040:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.585054:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15876 00000100:00100000:1.0:1746066754.585058:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882983171456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.585064:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.585070:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d154b expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.585078:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.585080:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.585084:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 38 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.585092:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 38 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.585098:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45600, rc 0) 00000100:00100000:1.0:1746066754.585110:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983171456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 52us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.585115:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15876 00000100:00100000:2.0:1746066754.588211:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984434304:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.588211:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984434176:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.588240:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa6c94 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d153d expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.588240:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa6c7f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1536 expref: 34 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.588251:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848ba00/0xf1867c21abfa6c94 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d153d expref: 34 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.588251:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa6c7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1536 expref: 34 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.588261:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848ba00, rc 0) 00010000:00010000:1.0:1746066754.588273:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848b200, rc 0) 00000100:00100000:2.0:1746066754.588310:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983171200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3318us (4361us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066754.588310:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983171072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3664us (5492us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066754.588316:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15872 00000100:00100000:2.0:1746066754.588374:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15875 00000100:00100000:0.0:1746066754.596211:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.596552:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171712 00000100:00100000:2.0:1746066754.596560:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171712 00000100:00100000:2.0:1746066754.596614:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15877 00000100:00100000:2.0:1746066754.596622:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+31:566:x1830882983171712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.596637:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.596651:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1559 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.596677:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.596683:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.596685:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.596688:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.596716:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.596726:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 13 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.596736:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984434432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.596813:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.598282:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984434432:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.598301:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.598323:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751a00, rc 0) 00000100:00100000:2.0:1746066754.598593:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:566:x1830882983171712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1971us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.598599:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15877 00000100:00100000:0.0:1746066754.599473:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.599585:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171840 00000100:00100000:3.0:1746066754.599590:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171840 00002000:00100000:3.0:1746066754.599620:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1499136->2097151) req@ffff88009677c700 x1830882983171840/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.599628:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882983171840 ext(1499136->2097151) 00010000:00010000:3.0:1746066754.599634:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 14 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.599644:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 14 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.599650:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677c700 00000100:00100000:3.0:1746066754.599674:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 925 00000100:00100000:3.0:1746066754.599680:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983171840:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066754.607860:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983171840:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8171us (8379us total) trans 17179874404 rc 0/0 00000100:00100000:3.0:1746066754.607874:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 925 00002000:00100000:3.0:1746066754.607900:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1499136->2097151) req@ffff88009677c700 x1830882983171840/t17179874404(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.607908:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882983171840 ext(1499136->2097151) 00010000:00010000:3.0:1746066754.607917:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 16 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.607931:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 16 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.607937:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677c700 00000100:00100000:0.0:1746066754.610585:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.610664:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983171968 00000100:00100000:2.0:1746066754.610671:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983171968 00010000:00010000:2.0:1746066754.610697:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 16 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.610721:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7125 00000100:00100000:2.0:1746066754.610725:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2014:x1830882983171968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.610735:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.610747:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 16 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.610754:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 16 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.610768:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa6b75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d149c expref: 16 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:2.0:1746066754.610788:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.610789:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.610794:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.610799:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.610821:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.610828:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984434560:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.610903:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.612545:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984434560:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.612563:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.612764:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2014:x1830882983171968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2035us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.612774:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7125 00000100:00100000:0.0:1746066754.614127:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.614229:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983172224 00000100:00100000:3.0:1746066754.614236:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983172224 00002000:00100000:3.0:1746066754.614272:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009677ea00 x1830882983172224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.614279:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ea00 with x1830882983172224 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.614283:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ea00 00000100:00100000:3.0:1746066754.614303:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4175 00000100:00100000:3.0:1746066754.614308:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983172224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.624131:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983172224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9810us (9999us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.624143:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4175 00002000:00100000:3.0:1746066754.624157:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009677ea00 x1830882983172224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.624173:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ea00 with x1830882983172224 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.624180:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677ea00 00000100:00100000:0.0:1746066754.633548:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.635046:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983172352 00000100:00100000:2.0:1746066754.635056:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983172352 00000100:00100000:2.0:1746066754.635145:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15878 00000100:00100000:2.0:1746066754.635154:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:566:x1830882983172352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.635172:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.635191:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1560 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.635221:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 14 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.635229:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.635230:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.635234:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.635263:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 14 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.635274:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 14 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:2.0:1746066754.635287:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984434688:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.637321:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.637374:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984434688:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.637395:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.637411:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751800, rc 0) 00000100:00100000:3.0:1746066754.637570:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:566:x1830882983172352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2416us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.637578:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15878 00000100:00100000:0.0:1746066754.638448:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.638498:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983172480 00000100:00100000:3.0:1746066754.638504:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983172480 00002000:00100000:3.0:1746066754.638557:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1318911) req@ffff88009677e300 x1830882983172480/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.638567:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e300 with x1830882983172480 ext(1048576->1318911) 00010000:00010000:3.0:1746066754.638574:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 15 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.638585:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 15 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.638595:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677e300 00000100:00100000:3.0:1746066754.638621:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 926 00000100:00100000:3.0:1746066754.638630:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983172480:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066754.640429:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.640489:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983172736 00000100:00100000:2.0:1746066754.640495:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983172736 00000100:00100000:2.0:1746066754.640561:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16263 00000100:00100000:2.0:1746066754.640568:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:570:x1830882983172736:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.640590:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.640607:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1567 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.640677:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640689:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640699:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640710:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640715:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640720:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640806:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640814:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.640819:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066754.640827:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066754.640876:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641081:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641087:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641092:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097019a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.641096:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641102:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641113:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.641116:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066754.641120:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641125:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097019a00/0xf1867c21abfa6cc5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641237:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641243:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641247:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641252:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641255:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.641258:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641263:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641269:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066754.641270:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.641272:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641276:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751c00/0xf1867c21abfa6cb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641283:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641287:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641290:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641293:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095751600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.641295:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641298:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641302:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea05200) 00010000:00010000:2.0:1746066754.641304:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.641306:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641313:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751600/0xf1867c21abfa6cbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.641346:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6cb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1567 expref: 23 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.641353:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751400/0xf1867c21abfa6cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1567 expref: 23 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.641360:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751400, rc 0) 00000100:00100000:2.0:1746066754.641410:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:570:x1830882983172736:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 842us (986us total) trans 8589936581 rc 301/301 00000100:00100000:2.0:1746066754.641417:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16263 00000100:00100000:3.0:1746066754.641962:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983172480:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3333us (3514us total) trans 17179874405 rc 0/0 00000100:00100000:3.0:1746066754.641970:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 926 00002000:00100000:3.0:1746066754.641978:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1318911) req@ffff88009677e300 x1830882983172480/t17179874405(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.641986:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e300 with x1830882983172480 ext(1048576->1318911) 00010000:00010000:3.0:1746066754.641993:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 17 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.642004:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 17 pid: 12255 timeout: 822 lvb_type: 0 00002000:00010000:3.0:1746066754.642010:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677e300 00000100:00100000:0.0:1746066754.644079:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.644210:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983172864 00000100:00100000:3.0:1746066754.644219:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983172864 00010000:00010000:3.0:1746066754.644249:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 17 pid: 12255 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.644273:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7126 00000100:00100000:3.0:1746066754.644280:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983172864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.644294:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.644312:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 17 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.644322:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 17 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.644467:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d200/0xf1867c21abfa6b7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14a3 expref: 17 pid: 12255 timeout: 822 lvb_type: 0 00010000:00010000:3.0:1746066754.644525:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.644527:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.644535:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.644544:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.644577:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.644589:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984434816:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.644697:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.646634:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984434816:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.646652:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.647027:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983172864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2743us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.647037:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7126 00000100:00100000:0.0:1746066754.649986:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.650034:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.650166:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983173120 00000100:00100000:3.0:1746066754.650175:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983173120 00002000:00100000:3.0:1746066754.650220:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012ce06300 x1830882983173120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.650236:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06300 with x1830882983173120 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.650242:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce06300 00000100:00100000:3.0:1746066754.650270:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983173376 00000100:00100000:3.0:1746066754.650273:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983173376 00002000:00100000:3.0:1746066754.650287:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880095ceea00 x1830882983173376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.650294:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceea00 with x1830882983173376 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.650296:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceea00 00000100:00100000:3.0:1746066754.650319:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4176 00000100:00100000:3.0:1746066754.650326:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983173120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066754.651123:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4177 00000100:00100000:1.0:1746066754.651131:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983173376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066754.654665:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984434944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746066754.654728:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066754.655509:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984434944 00000100:00100000:2.0:1746066754.655527:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984434944 00000100:00100000:2.0:1746066754.655591:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1746066754.655599:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984434944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746066754.655623:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1060797760 pending 1740800 free 3912097792 avail 3680575488 00000100:00100000:2.0:1746066754.655666:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984434944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.655672:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00080000:1.0:1746066754.655725:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066754.655761:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984434944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746066754.659328:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983173120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8992us (9339us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.659339:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4176 00002000:00100000:3.0:1746066754.659351:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012ce06300 x1830882983173120/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.659361:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce06300 with x1830882983173120 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.659367:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ce06300 00000100:00100000:1.0:1746066754.663834:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983173376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12689us (13784us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066754.663847:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4177 00002000:00100000:1.0:1746066754.663859:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880095ceea00 x1830882983173376/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.663869:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceea00 with x1830882983173376 ext(1048576->2097151) 00002000:00010000:1.0:1746066754.663876:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceea00 00000100:00100000:0.0:1746066754.676319:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.676393:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983173632 00000100:00100000:1.0:1746066754.676404:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983173632 00002000:00100000:1.0:1746066754.676456:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095ced500 x1830882983173632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.676467:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced500 with x1830882983173632 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.676473:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ced500 00000100:00100000:0.0:1746066754.676694:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.676796:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983173888 00000100:00100000:1.0:1746066754.676799:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983173888 00002000:00100000:1.0:1746066754.676819:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095cec000 x1830882983173888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.676826:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec000 with x1830882983173888 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.676829:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cec000 00000100:00100000:1.0:1746066754.676842:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4178 00000100:00100000:1.0:1746066754.676849:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983173632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.676915:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4179 00000100:00100000:0.0:1746066754.676922:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882983173888:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066754.691229:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882983173888:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14295us (14522us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066754.691241:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4179 00002000:00100000:2.0:1746066754.691253:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880095cec000 x1830882983173888/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.691270:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec000 with x1830882983173888 ext(2097152->4194303) 00002000:00010000:2.0:1746066754.691278:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cec000 00000100:00100000:1.0:1746066754.695196:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983173632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18336us (18879us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066754.695208:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4178 00002000:00100000:1.0:1746066754.695219:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880095ced500 x1830882983173632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.695228:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced500 with x1830882983173632 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.695233:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ced500 00000100:00100000:0.0:1746066754.704651:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.704737:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983174144 00000100:00100000:1.0:1746066754.704746:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983174144 00002000:00100000:1.0:1746066754.704802:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095ceed80 x1830882983174144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.704812:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceed80 with x1830882983174144 ext(4194304->5033983) 00002000:00010000:1.0:1746066754.704818:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceed80 00000100:00100000:1.0:1746066754.704855:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4180 00000100:00100000:1.0:1746066754.704862:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983174144:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066754.712019:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983174144:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7143us (7364us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066754.712032:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4180 00002000:00100000:2.0:1746066754.712045:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095ceed80 x1830882983174144/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.712054:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceed80 with x1830882983174144 ext(4194304->5033983) 00002000:00010000:2.0:1746066754.712060:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ceed80 00000100:00100000:0.0:1746066754.730013:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.730162:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983174400 00000100:00100000:3.0:1746066754.730174:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983174400 00000100:00100000:3.0:1746066754.730234:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5922 00000100:00100000:3.0:1746066754.730242:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:566:x1830882983174400:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066754.730467:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:566:x1830882983174400:12345-192.168.204.16@tcp:35:cat.0 Request processed in 225us (466us total) trans 8589936582 rc 0/0 00000100:00100000:3.0:1746066754.730478:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5922 00000100:00100000:0.0:1746066754.738049:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.738269:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983174656 00000100:00100000:3.0:1746066754.738282:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983174656 00000100:00100000:3.0:1746066754.738375:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5923 00000100:00100000:3.0:1746066754.738385:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:522:x1830882983174656:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00080000:1.0:1746066754.738443:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066754.739301:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:522:x1830882983174656:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 913us (1262us total) trans 8589936583 rc 0/0 00000100:00100000:3.0:1746066754.739309:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5923 00000100:00100000:1.0:1746066754.742880:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.742985:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983174912 00000100:00100000:3.0:1746066754.742995:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983174912 00000100:00100000:3.0:1746066754.743044:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5924 00000100:00100000:3.0:1746066754.743053:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:522:x1830882983174912:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:3.0:1746066754.743478:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:522:x1830882983174912:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 422us (604us total) trans 8589936584 rc 0/0 00000100:00100000:3.0:1746066754.743486:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5924 00000100:00100000:0.0:1746066754.760640:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.761619:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983175168 00000100:00100000:2.0:1746066754.761630:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983175168 00000100:00100000:2.0:1746066754.761812:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16264 00000100:00100000:2.0:1746066754.761821:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:575:x1830882983175168:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.761846:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.761862:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0de00/0xf1867c21abfa6cd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d156e expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.761964:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.761980:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.761992:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762008:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762016:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762022:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762137:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6ce8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762147:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762154:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066754.762164:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066754.762253:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762260:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762266:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762272:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762278:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0c800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.762282:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762288:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762304:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066754.762307:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.762311:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762316:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c800/0xf1867c21abfa6cda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762344:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762350:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762355:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762359:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0c200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.762361:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762366:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762373:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea05000) 00010000:00010000:2.0:1746066754.762375:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.762378:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762382:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c200/0xf1867c21abfa6ce1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.762426:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0de00/0xf1867c21abfa6cd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d156e expref: 44 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.762440:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d156e expref: 43 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.762446:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.762448:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066754.762451:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d600, rc 0) 00000100:00100000:2.0:1746066754.762534:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:575:x1830882983175168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 711us (1902us total) trans 8589936585 rc 0/0 00000100:00100000:2.0:1746066754.762540:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16264 00000100:00100000:0.0:1746066754.766003:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.766463:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983175296 00000100:00100000:3.0:1746066754.766474:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983175296 00000100:00100000:3.0:1746066754.766565:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 777 00000100:00100000:3.0:1746066754.766576:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882983175296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.766593:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.766623:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6ce8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d156e expref: 43 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.766662:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066754.766668:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.766742:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983175296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.766750:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 777 00000100:00100000:0.0:1746066754.785277:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.786622:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983175424 00000100:00100000:3.0:1746066754.786634:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983175424 00000100:00100000:3.0:1746066754.787232:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15879 00000100:00100000:3.0:1746066754.787242:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+16:570:x1830882983175424:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066754.787261:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.787279:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1575 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.787311:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.787320:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.787325:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.787327:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.787330:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3760128->4194303] (req 3760128->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 17 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.787362:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 32 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.787373:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 32 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.787390:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.787573:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 17 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.787583:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 17 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.787592:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435200:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.787613:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.791316:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435072:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.791328:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435200:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.791355:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3760128->4194303] (req 3760128->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 17 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.791372:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895e00, rc 0) 00000100:00100000:3.0:1746066754.791581:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+17:570:x1830882983175424:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4338us (6310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.791590:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15879 00000100:00100000:0.0:1746066754.794157:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.795022:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983175552 00000100:00100000:3.0:1746066754.795032:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983175552 00000100:00100000:0.0:1746066754.795069:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066754.795072:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 33 pid: 3528 timeout: 822 lvb_type: 1 00000100:00100000:3.0:1746066754.795099:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983175680 00000100:00100000:3.0:1746066754.795102:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983175680 00010000:00010000:3.0:1746066754.795112:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 17 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.795141:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7127 00000100:00100000:3.0:1746066754.795148:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983175552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.795162:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.795182:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 33 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.795194:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 33 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.795220:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa6c8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1552 expref: 33 pid: 3528 timeout: 822 lvb_type: 1 00010000:00010000:3.0:1746066754.795237:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066754.795243:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7128 00000100:00100000:1.0:1746066754.795253:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983175680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066754.795262:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066754.795272:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 17 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.795282:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 17 pid: 11630 timeout: 822 lvb_type: 0 00000100:00100000:3.0:1746066754.795283:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983175552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.795289:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7127 00010000:00010000:1.0:1746066754.795295:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa6c55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1528 expref: 17 pid: 11630 timeout: 822 lvb_type: 0 00010000:00010000:1.0:1746066754.795312:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.795314:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.795320:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.795329:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.795361:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.795377:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984435328:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066754.795595:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.797245:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984435328:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066754.797263:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066754.797303:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983175680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2052us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.797310:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7128 00000100:00100000:0.0:1746066754.798594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.798685:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983175936 00000100:00100000:3.0:1746066754.798692:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983175936 00002000:00100000:3.0:1746066754.798733:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3760128->3764223) req@ffff8800a03d7800 x1830882983175936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.798742:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882983175936 ext(3760128->3764223) 00002000:00010000:3.0:1746066754.798747:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7800 00000100:00100000:3.0:1746066754.798764:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4181 00000100:00100000:3.0:1746066754.798771:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983175936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066754.798925:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983175936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 154us (333us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.798931:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4181 00002000:00100000:3.0:1746066754.798937:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3760128->3764223) req@ffff8800a03d7800 x1830882983175936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.798944:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d7800 with x1830882983175936 ext(3760128->3764223) 00002000:00010000:3.0:1746066754.798947:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d7800 00000100:00100000:0.0:1746066754.805112:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.805244:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983176192 00000100:00100000:2.0:1746066754.805255:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983176192 00000100:00100000:2.0:1746066754.805355:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16265 00000100:00100000:2.0:1746066754.805364:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:578:x1830882983176192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.805392:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.805410:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfa6cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d157c expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.805489:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805502:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805526:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805540:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805549:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805554:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805647:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6d12 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805655:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6d12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805661:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6d12 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066754.805669:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066754.805741:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805747:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805752:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805757:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805762:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0c400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.805765:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.805771:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806115:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066754.806118:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.806286:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806292:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c400/0xf1867c21abfa6d04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806751:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806757:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806760:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806764:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d0ce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.806766:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806769:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806776:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea05200) 00010000:00010000:2.0:1746066754.806778:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.806779:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806783:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.806819:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0c000/0xf1867c21abfa6cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d157c expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.806829:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6d12 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d157c expref: 24 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.806834:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.806836:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066754.806838:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0d600, rc 0) 00000100:00100000:2.0:1746066754.807091:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:578:x1830882983176192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1727us (1987us total) trans 8589936586 rc 0/0 00000100:00100000:2.0:1746066754.807097:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16265 00000100:00100000:0.0:1746066754.809298:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.809379:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983176448 00000100:00100000:3.0:1746066754.809388:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983176448 00000100:00100000:3.0:1746066754.809425:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5925 00000100:00100000:3.0:1746066754.809431:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+24:578:x1830882983176448:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066754.809623:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:578:x1830882983176448:12345-192.168.204.16@tcp:35:cat.0 Request processed in 191us (330us total) trans 8589936587 rc 0/0 00000100:00100000:3.0:1746066754.809629:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5925 00000100:00100000:0.0:1746066754.810560:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.810627:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983176576 00000100:00100000:1.0:1746066754.810631:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983176576 00000100:00100000:1.0:1746066754.810670:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 778 00000100:00100000:1.0:1746066754.810676:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983176576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066754.810687:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066754.810710:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d0d600/0xf1867c21abfa6d12 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d157c expref: 25 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.810737:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066754.810741:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066754.810762:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983176576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066754.810768:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 778 00000100:00100000:0.0:1746066754.812114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.812179:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983176704 00000100:00100000:2.0:1746066754.812184:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983176704 00000100:00100000:2.0:1746066754.812314:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15880 00000100:00100000:2.0:1746066754.812321:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:570:x1830882983176704:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.812336:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.812350:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1583 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066754.812355:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.812371:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983176832 00000100:00100000:0.0:1746066754.812374:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983176832 00010000:00010000:2.0:1746066754.812375:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.812383:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.812389:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.812391:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.812394:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->4648959] (req 4194304->4648959) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066754.812405:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15881 00000100:00100000:0.0:1746066754.812410:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983176832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066754.812417:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.812421:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066754.812426:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d158a expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.812431:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 37 pid: 1893 timeout: 823 lvb_type: 1 00010000:00010000:0.0:1746066754.812438:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066754.812439:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066754.812442:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984435456:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066754.812445:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066754.812456:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066754.812464:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05a00, rc 0) 00010000:00010000:2.0:1746066754.812509:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.812528:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066754.812536:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984435584:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066754.812600:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983176832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 188us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066754.812605:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15881 00000100:00100000:2.0:1746066754.812752:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.812991:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.813143:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983176960 00000100:00100000:2.0:1746066754.813146:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983176960 00000100:00100000:2.0:1746066754.813171:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15882 00000100:00100000:2.0:1746066754.813177:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983176960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.813183:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.813189:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1591 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.813200:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.813202:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.813205:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.813215:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.813221:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0cc00, rc 0) 00000100:00100000:2.0:1746066754.813240:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983176960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.813245:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15882 00000100:00100000:2.0:1746066754.814075:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984435456:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.814086:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984435584:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.814102:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->4648959] (req 4194304->4648959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.814110:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0ce00, rc 0) 00000100:00100000:2.0:1746066754.814127:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+23:570:x1830882983176704:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1807us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.814132:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15880 00000100:00100000:0.0:1746066754.819476:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.819586:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983177216 00000100:00100000:2.0:1746066754.819596:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983177216 00010000:00010000:2.0:1746066754.819634:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 38 pid: 1893 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066754.819677:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7129 00000100:00100000:2.0:1746066754.819685:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983177216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.819701:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.819722:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 38 pid: 1893 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066754.819732:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 38 pid: 1893 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066754.819754:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45600/0xf1867c21abfa6c9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d154b expref: 38 pid: 1893 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066754.819787:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.819829:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983177216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.819837:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7129 00000100:00100000:0.0:1746066754.820736:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.822705:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983177088 00000100:00100000:1.0:1746066754.822715:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983177088 00010000:00010000:1.0:1746066754.822751:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066754.822792:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7130 00000100:00100000:1.0:1746066754.822800:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983177088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066754.822815:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066754.822833:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066754.822845:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066754.822870:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa6c47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d151a expref: 23 pid: 11630 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066754.822921:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.822924:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066754.822930:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.822938:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.822971:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.822984:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984435712:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066754.823071:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.824379:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.824532:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983177344 00000100:00100000:2.0:1746066754.824538:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983177344 00000100:00100000:2.0:1746066754.824572:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15883 00000100:00100000:2.0:1746066754.824578:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:575:x1830882983177344:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.824593:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.824609:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1598 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.824632:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.824640:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.824650:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.824651:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.824654:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1224704->1871871] (req 1224704->1871871) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.824675:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 17 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.824685:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 17 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066754.824695:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435840:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.825758:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.825768:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066754.825775:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435968:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.826358:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.826863:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984435712:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066754.826902:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.826926:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983177088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4126us (6190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.826935:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7130 00000100:00100000:2.0:1746066754.829723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.829747:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.829800:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435840:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.829920:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983177600 00000100:00100000:3.0:1746066754.829927:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983177600 00002000:00100000:3.0:1746066754.829973:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880093cce300 x1830882983177600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.829984:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cce300 with x1830882983177600 ext(1048576->2097151) 00010000:00010000:3.0:1746066754.829993:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066754.830006:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00002000:00010000:3.0:1746066754.830018:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cce300 00000100:00100000:2.0:1746066754.830036:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984435968:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.830042:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983177856 00000100:00100000:3.0:1746066754.830045:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983177856 00002000:00100000:3.0:1746066754.830059:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880093ccea00 x1830882983177856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066754.830062:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1224704->1871871] (req 1224704->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066754.830067:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccea00 with x1830882983177856 ext(1048576->2097151) 00002000:00010000:3.0:1746066754.830070:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccea00 00010000:00010000:2.0:1746066754.830078:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c200, rc 0) 00000100:00100000:3.0:1746066754.830084:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 927 00000100:00100000:3.0:1746066754.830092:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882983177600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066754.830127:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:575:x1830882983177344:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5548us (5750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.830135:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15883 00000100:00100000:0.0:1746066754.830521:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4182 00000100:00100000:0.0:1746066754.830530:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+19:2015:x1830882983177856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066754.831989:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.832986:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.833008:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983178240 00000100:00100000:2.0:1746066754.833014:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983178240 00010000:00010000:2.0:1746066754.833046:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066754.833072:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7131 00000100:00100000:2.0:1746066754.833079:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983178240:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.833092:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.833109:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066754.833120:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066754.833149:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095751a00/0xf1867c21abfa6ca2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1559 expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066754.833167:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066754.833195:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983178240:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 116us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.833202:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7131 00000100:00100000:3.0:1746066754.835472:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983178112 00000100:00100000:3.0:1746066754.835484:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983178112 00002000:00100000:3.0:1746066754.835538:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4644864->4648959) req@ffff880093ccce00 x1830882983178112/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.835548:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccce00 with x1830882983178112 ext(4644864->4648959) 00002000:00010000:3.0:1746066754.835554:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccce00 00000100:00100000:3.0:1746066754.835572:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4183 00000100:00100000:3.0:1746066754.835578:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983178112:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.835709:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983178112:12345-192.168.204.16@tcp:3:cat.0 Request processed in 131us (3724us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066754.835715:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4183 00002000:00100000:3.0:1746066754.835719:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4644864->4648959) req@ffff880093ccce00 x1830882983178112/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.835725:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccce00 with x1830882983178112 ext(4644864->4648959) 00002000:00010000:3.0:1746066754.835728:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccce00 00000100:00100000:2.0:1746066754.841186:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983177856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10643us (11423us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066754.841197:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4182 00002000:00100000:2.0:1746066754.841208:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880093ccea00 x1830882983177856/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.841218:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccea00 with x1830882983177856 ext(1048576->2097151) 00002000:00010000:2.0:1746066754.841225:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccea00 00000100:00100000:3.0:1746066754.842298:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983177600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12205us (12581us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.842307:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 927 00002000:00100000:3.0:1746066754.842313:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880093cce300 x1830882983177600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.842321:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cce300 with x1830882983177600 ext(1048576->2097151) 00010000:00010000:3.0:1746066754.842330:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066754.842345:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00002000:00010000:3.0:1746066754.842352:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093cce300 00000100:00100000:0.0:1746066754.845311:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.845401:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983178496 00000100:00100000:2.0:1746066754.845412:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983178496 00000100:00100000:2.0:1746066754.845468:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5926 00000100:00100000:2.0:1746066754.845477:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:570:x1830882983178496:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066754.845716:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:570:x1830882983178496:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 239us (414us total) trans 8589936588 rc 0/0 00000100:00100000:2.0:1746066754.845724:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5926 00000100:00100000:0.0:1746066754.847969:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.848604:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983178624 00000100:00100000:2.0:1746066754.848613:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983178624 00010000:00010000:2.0:1746066754.848655:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066754.848695:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7132 00000100:00100000:2.0:1746066754.848703:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983178624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.848717:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.848737:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066754.848748:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066754.848771:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d05a00/0xf1867c21abfa6d27 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d158a expref: 18 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066754.848785:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.848787:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066754.848793:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.848801:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.848834:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.848845:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984436096:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066754.852410:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.852478:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983178880 00000100:00100000:0.0:1746066754.852488:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983178880 00002000:00100000:0.0:1746066754.852542:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1224704->1228799) req@ffff880093ccc000 x1830882983178880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066754.852552:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccc000 with x1830882983178880 ext(1224704->1228799) 00002000:00010000:0.0:1746066754.852558:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccc000 00000100:00100000:0.0:1746066754.852578:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4184 00000100:00100000:0.0:1746066754.852585:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983178880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066754.852741:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983178880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 155us (342us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066754.852748:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4184 00002000:00100000:0.0:1746066754.852754:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1224704->1228799) req@ffff880093ccc000 x1830882983178880/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066754.852761:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccc000 with x1830882983178880 ext(1224704->1228799) 00002000:00010000:0.0:1746066754.852764:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccc000 00000100:00100000:3.0:1746066754.852989:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.853018:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984436096:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.853036:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.853061:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983178624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4360us (5100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.853070:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7132 00000100:00100000:2.0:1746066754.855280:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.855315:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983179136 00000100:00100000:2.0:1746066754.855321:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983179136 00000100:00100000:2.0:1746066754.855378:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16266 00000100:00100000:2.0:1746066754.855386:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+42:582:x1830882983179136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.855409:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.855428:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6d3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d159f expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.855540:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.855554:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066754.855564:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:2.0:1746066754.855574:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066754.855674:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6d3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 45 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.855689:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 44 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.855696:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.855700:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746066754.855702:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31a00, rc 0) 00000100:00100000:2.0:1746066754.855742:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:582:x1830882983179136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 357us (468us total) trans 8589936589 rc 0/0 00000100:00100000:2.0:1746066754.855751:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16266 00000100:00100000:1.0:1746066754.857392:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.857437:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.857721:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983179392 00000100:00100000:3.0:1746066754.857730:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983179392 00002000:00100000:3.0:1746066754.857770:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096425c00 x1830882983179392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.857780:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096425c00 with x1830882983179392 ext(2097152->4194303) 00002000:00010000:3.0:1746066754.857785:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096425c00 00000100:00100000:0.0:1746066754.858359:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983179648 00000100:00100000:0.0:1746066754.858364:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983179648 00002000:00100000:0.0:1746066754.858387:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3760127) req@ffff880096427b80 x1830882983179648/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066754.858395:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096427b80 with x1830882983179648 ext(2097152->3760127) 00002000:00010000:0.0:1746066754.858399:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096427b80 00000100:00100000:0.0:1746066754.858443:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4185 00000100:00100000:0.0:1746066754.858450:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983179392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.858453:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4186 00000100:00100000:3.0:1746066754.858460:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983179648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066754.860071:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.860127:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983179904 00000100:00100000:0.0:1746066754.860133:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983179904 00002000:00100000:0.0:1746066754.860160:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1867776->1871871) req@ffff880096424380 x1830882983179904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066754.860168:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096424380 with x1830882983179904 ext(1867776->1871871) 00002000:00010000:0.0:1746066754.860173:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096424380 00000100:00100000:0.0:1746066754.860189:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4187 00000100:00100000:0.0:1746066754.860194:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983179904:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066754.860330:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983179904:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 135us (270us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066754.860336:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4187 00002000:00100000:0.0:1746066754.860341:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1867776->1871871) req@ffff880096424380 x1830882983179904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/4536 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066754.860348:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096424380 with x1830882983179904 ext(1867776->1871871) 00002000:00010000:0.0:1746066754.860351:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096424380 00000100:00100000:2.0:1746066754.874073:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983179392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15611us (16676us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066754.874084:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4185 00002000:00100000:2.0:1746066754.874094:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096425c00 x1830882983179392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.874103:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096425c00 with x1830882983179392 ext(2097152->4194303) 00002000:00010000:2.0:1746066754.874109:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096425c00 00000100:00100000:2.0:1746066754.877236:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.877268:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.877279:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983180032 00000100:00100000:0.0:1746066754.877286:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983180032 00000100:00100000:2.0:1746066754.877292:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.877307:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983180160 00000100:00100000:1.0:1746066754.877311:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983180160 00000100:00100000:0.0:1746066754.877315:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15884 00000100:00100000:0.0:1746066754.877320:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882983180032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066754.877331:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066754.877344:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa6d51 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15a6 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066754.877390:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ac9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984436224:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.877853:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15885 00000100:00100000:1.0:1746066754.877860:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983180160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.877868:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.877877:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfa6d58 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15ad expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.877934:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984436352:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.878062:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983180416 00000100:00100000:1.0:1746066754.878065:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983180416 00000100:00100000:1.0:1746066754.878085:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5927 00000100:00100000:1.0:1746066754.878089:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:575:x1830882983180416:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066754.878219:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:575:x1830882983180416:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 128us (925us total) trans 8589936590 rc 0/0 00000100:00100000:1.0:1746066754.878229:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5927 00000100:00100000:0.0:1746066754.878250:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.878259:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.878682:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983179648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20221us (21243us total) trans 0 rc 1662976/1662976 00000100:00100000:3.0:1746066754.878690:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4186 00002000:00100000:3.0:1746066754.878698:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3760127) req@ffff880096427b80 x1830882983179648/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1662976/1662976 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.878706:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096427b80 with x1830882983179648 ext(2097152->3760127) 00002000:00010000:3.0:1746066754.878710:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096427b80 00000100:00100000:2.0:1746066754.879562:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ac9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984436224:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.879584:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa6d51 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15a6 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.879594:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa6d51 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15a6 expref: 38 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.879617:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05800, rc 0) 00000100:00100000:1.0:1746066754.879625:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984436352:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.879639:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882983180032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2318us (2409us total) trans 0 rc 301/301 00010000:00010000:1.0:1746066754.879642:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfa6d58 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ad expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066754.879644:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15884 00010000:00010000:1.0:1746066754.879652:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44800/0xf1867c21abfa6d58 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ad expref: 33 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.879664:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44800, rc 0) 00000100:00100000:1.0:1746066754.879682:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983180160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1823us (2414us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066754.879688:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15885 00000100:00100000:0.0:1746066754.884098:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.884180:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983180672 00000100:00100000:2.0:1746066754.884186:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983180672 00002000:00100000:2.0:1746066754.884218:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880093ac9f80 x1830882983180672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 504/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.884225:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9f80 with x1830882983180672 ext(1048576->2097151) 00002000:00010000:2.0:1746066754.884229:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac9f80 00000100:00100000:2.0:1746066754.884241:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4188 00000100:00100000:2.0:1746066754.884245:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983180672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.887859:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.887907:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983180800 00000100:00100000:1.0:1746066754.887915:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983180800 00000100:00100000:1.0:1746066754.887952:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15886 00000100:00100000:1.0:1746066754.887956:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983180800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.887968:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.887980:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfa6d5f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15b4 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.888016:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984436480:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.888081:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.888106:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983180672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3858us (4015us total) trans 0 rc 401408/401408 00000100:00100000:2.0:1746066754.888112:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4188 00002000:00100000:2.0:1746066754.888117:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880093ac9f80 x1830882983180672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 504/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.888123:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ac9f80 with x1830882983180672 ext(1048576->2097151) 00002000:00010000:2.0:1746066754.888125:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ac9f80 00000100:00100000:1.0:1746066754.889306:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984436480:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066754.889330:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfa6d5f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15b4 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.889341:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44400/0xf1867c21abfa6d5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15b4 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066754.889350:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44400, rc 0) 00000100:00100000:1.0:1746066754.889375:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983180800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1418us (1524us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066754.889384:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15886 00000100:00100000:0.0:1746066754.892724:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.892799:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181056 00000100:00100000:2.0:1746066754.892807:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181056 00002000:00100000:2.0:1746066754.892842:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4648960->5033983) req@ffff880093acad80 x1830882983181056/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.892852:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acad80 with x1830882983181056 ext(4648960->5033983) 00002000:00010000:2.0:1746066754.892856:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acad80 00000100:00100000:2.0:1746066754.892905:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4189 00000100:00100000:2.0:1746066754.892910:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983181056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066754.895118:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.895194:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181184 00000100:00100000:1.0:1746066754.895201:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181184 00000100:00100000:1.0:1746066754.895247:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15887 00000100:00100000:1.0:1746066754.895253:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983181184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066754.895269:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.895282:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa45200/0xf1867c21abfa6d66 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15bb expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066754.895323:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984436608:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066754.895395:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.895556:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983181056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 2643us (2836us total) trans 0 rc 385024/385024 00000100:00100000:3.0:1746066754.895564:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4189 00002000:00100000:3.0:1746066754.895571:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4648960->5033983) req@ffff880093acad80 x1830882983181056/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 385024/385024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.895579:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093acad80 with x1830882983181056 ext(4648960->5033983) 00002000:00010000:3.0:1746066754.895583:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093acad80 00000100:00100000:0.0:1746066754.896735:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.896787:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181312 00000100:00100000:2.0:1746066754.896792:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181312 00000100:00100000:2.0:1746066754.896827:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15888 00000100:00100000:2.0:1746066754.896834:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983181312:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.896843:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.896855:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d06c00/0xf1867c21abfa6d6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15c2 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.896909:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984436736:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.896963:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.897849:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984436608:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.897872:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45200/0xf1867c21abfa6d66 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15bb expref: 38 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.897913:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45200/0xf1867c21abfa6d66 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15bb expref: 38 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.897929:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45200, rc 0) 00000100:00100000:2.0:1746066754.898023:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983181184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2769us (2908us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.898030:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15887 00000100:00100000:0.0:1746066754.898868:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.899019:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181440 00000100:00100000:2.0:1746066754.899024:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181440 00000100:00100000:2.0:1746066754.899054:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15889 00000100:00100000:2.0:1746066754.899060:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882983181440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.899072:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.899083:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfa6d74 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15c9 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.899118:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984436864:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.899174:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746066754.900102:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984436736:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.900120:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d06c00/0xf1867c21abfa6d6d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15c2 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.900131:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d06c00/0xf1867c21abfa6d6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15c2 expref: 33 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.900343:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06c00, rc 0) 00000100:00100000:2.0:1746066754.900369:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983181312:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3535us (3636us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.900375:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15888 00000100:00100000:2.0:1746066754.901866:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984436864:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066754.901919:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfa6d74 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15c9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.902085:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07c00/0xf1867c21abfa6d74 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15c9 expref: 18 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066754.902095:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07c00, rc 0) 00000100:00100000:2.0:1746066754.902126:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:2013:x1830882983181440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3065us (3259us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066754.902132:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15889 00000100:00100000:0.0:1746066754.902455:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.902561:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181568 00000100:00100000:2.0:1746066754.902566:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181568 00000100:00100000:2.0:1746066754.902627:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15890 00000100:00100000:2.0:1746066754.902634:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:582:x1830882983181568:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.902646:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.902656:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15d0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.902675:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.902682:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.902683:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066754.902686:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.902706:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 21 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.902717:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 21 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066754.902727:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984436992:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066754.903072:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066754.903421:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.903557:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181696 00000100:00100000:2.0:1746066754.903561:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181696 00000100:00100000:2.0:1746066754.903589:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15891 00000100:00100000:2.0:1746066754.903594:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983181696:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066754.903604:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.903613:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07600/0xf1867c21abfa6d82 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15d7 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066754.903638:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984437120:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.903663:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.906854:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984437120:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066754.907249:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984436992:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066754.907271:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 38 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066754.907282:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066754.907286:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06200, rc 0) 00000100:00100000:2.0:1746066754.907321:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:582:x1830882983181568:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4686us (4865us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.907328:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15890 00010000:00010000:3.0:1746066754.907359:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07600/0xf1867c21abfa6d82 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d7 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.907370:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07600/0xf1867c21abfa6d82 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d7 expref: 18 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066754.907396:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07600, rc 0) 00000100:00100000:3.0:1746066754.907415:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983181696:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3821us (3995us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066754.907420:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15891 00000100:00100000:3.0:1746066754.907810:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181824 00000100:00100000:3.0:1746066754.907816:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181824 00002000:00100000:3.0:1746066754.907844:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4648959) req@ffff88008e332680 x1830882983181824/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.907852:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332680 with x1830882983181824 ext(4194304->4648959) 00010000:00010000:3.0:1746066754.907858:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.907869:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066754.907874:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e332680 00000100:00100000:3.0:1746066754.907904:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 928 00000100:00100000:3.0:1746066754.907910:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983181824:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066754.914186:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983181824:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6263us (6893us total) trans 21474841856 rc 0/0 00000100:00100000:3.0:1746066754.914197:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 928 00002000:00100000:3.0:1746066754.914206:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4648959) req@ffff88008e332680 x1830882983181824/t21474841856(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.914215:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332680 with x1830882983181824 ext(4194304->4648959) 00010000:00010000:3.0:1746066754.914224:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 24 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.914240:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 24 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066754.914245:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e332680 00000100:00100000:0.0:1746066754.918787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.918910:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983181952 00000100:00100000:3.0:1746066754.919047:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983181952 00010000:00010000:3.0:1746066754.919080:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 24 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066754.919117:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7133 00000100:00100000:3.0:1746066754.919125:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983181952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.919137:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.919154:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 24 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.919165:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 24 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.919184:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0ce00/0xf1867c21abfa6d20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1583 expref: 24 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.919216:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.919218:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.919224:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.919237:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.919264:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 37 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.919275:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984437248:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.919340:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.920577:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984437248:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.920591:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.920616:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983181952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1491us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.920624:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7133 00000100:00100000:0.0:1746066754.924142:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.924217:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983182208 00000100:00100000:3.0:1746066754.924228:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983182208 00002000:00100000:3.0:1746066754.924266:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800966e1f80 x1830882983182208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.924275:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1f80 with x1830882983182208 ext(2097152->3145727) 00002000:00010000:3.0:1746066754.924280:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e1f80 00000100:00100000:3.0:1746066754.924311:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4190 00000100:00100000:3.0:1746066754.924318:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983182208:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.929809:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983182208:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5479us (5667us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.929827:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4190 00002000:00100000:3.0:1746066754.929840:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800966e1f80 x1830882983182208/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.929850:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1f80 with x1830882983182208 ext(2097152->3145727) 00002000:00010000:3.0:1746066754.929856:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e1f80 00000100:00100000:0.0:1746066754.934001:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.934316:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983182336 00000100:00100000:3.0:1746066754.934326:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983182336 00000100:00100000:3.0:1746066754.934387:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15892 00000100:00100000:3.0:1746066754.934395:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:582:x1830882983182336:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066754.934415:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066754.934434:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15de expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.934465:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.934472:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.934474:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066754.934476:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.934504:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 16 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.934541:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 16 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066754.934557:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984437376:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066754.934642:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.936546:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984437376:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066754.936574:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.936591:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943ebc00, rc 0) 00000100:00100000:3.0:1746066754.936627:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:582:x1830882983182336:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2232us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.936634:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15892 00000100:00100000:0.0:1746066754.937006:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.937239:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983182464 00000100:00100000:3.0:1746066754.937245:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983182464 00002000:00100000:3.0:1746066754.937279:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3760128->4194303) req@ffff8800966e3480 x1830882983182464/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.937288:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882983182464 ext(3760128->4194303) 00010000:00010000:3.0:1746066754.937294:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 17 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.937305:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 17 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066754.937312:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e3480 00000100:00100000:3.0:1746066754.937342:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 929 00000100:00100000:3.0:1746066754.937349:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983182464:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066754.942324:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983182464:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4963us (5307us total) trans 17179874406 rc 0/0 00000100:00100000:3.0:1746066754.942337:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 929 00002000:00100000:3.0:1746066754.942350:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3760128->4194303) req@ffff8800966e3480 x1830882983182464/t17179874406(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:160/0 lens 488/448 e 0 to 0 dl 1746066765 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.942360:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3480 with x1830882983182464 ext(3760128->4194303) 00010000:00010000:3.0:1746066754.942371:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 19 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.942387:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 19 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066754.942394:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800966e3480 00000100:00100000:0.0:1746066754.946265:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066754.946333:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983182592 00000100:00100000:3.0:1746066754.946343:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983182592 00010000:00010000:3.0:1746066754.946384:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 19 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066754.946427:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7134 00000100:00100000:3.0:1746066754.946436:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983182592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066754.946451:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.946472:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 19 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.946485:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 19 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.946523:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009d895e00/0xf1867c21abfa6cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3760128->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1575 expref: 19 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.947111:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.947114:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066754.947123:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.947133:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066754.947213:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066754.947226:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984437504:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066754.947338:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066754.948687:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984437504:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066754.948701:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.948741:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983182592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2305us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066754.948751:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7134 00000100:00100000:0.0:1746066754.955314:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066754.955362:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.955717:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983182848 00000100:00100000:1.0:1746066754.955725:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983182848 00002000:00100000:1.0:1746066754.955765:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800966e1180 x1830882983182848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.955774:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1180 with x1830882983182848 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.955779:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1180 00000100:00100000:3.0:1746066754.955795:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983183104 00000100:00100000:1.0:1746066754.955816:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4191 00000100:00100000:1.0:1746066754.955826:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983182848:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066754.956015:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983183104 00002000:00100000:3.0:1746066754.956055:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800966e2d80 x1830882983183104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066754.956070:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882983183104 ext(3145728->4194303) 00002000:00010000:3.0:1746066754.956075:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2d80 00000100:00100000:3.0:1746066754.956954:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4192 00000100:00100000:3.0:1746066754.956963:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983183104:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066754.965981:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.966333:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983183360 00000100:00100000:1.0:1746066754.966340:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983183360 00000100:00100000:1.0:1746066754.966393:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16267 00000100:00100000:1.0:1746066754.966400:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:587:x1830882983183360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066754.966418:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066754.966435:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009848ac00/0xf1867c21abfa6d90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15e5 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.966529:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.966542:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.966550:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.966557:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066754.966582:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 26 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.966592:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 26 pid: 17253 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066754.966601:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984437632:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066754.966668:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 44 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066754.966675:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 44 pid: 17253 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066754.966681:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984437760:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066754.966695:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066754.970682:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983182848:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14851us (15368us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066754.970691:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4191 00002000:00100000:1.0:1746066754.970700:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800966e1180 x1830882983182848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066754.970709:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1180 with x1830882983182848 ext(2097152->4194303) 00002000:00010000:1.0:1746066754.970714:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800966e1180 00000100:00100000:0.0:1746066754.972695:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.972716:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984437632:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066754.972724:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066754.972726:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984437760:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066754.972741:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983183616 00000100:00100000:0.0:1746066754.972746:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983183616 00010000:00010000:1.0:1746066754.972747:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066754.972770:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 45 pid: 17253 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066754.973051:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983183488 00000100:00100000:3.0:1746066754.973060:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983183488 00010000:00010000:3.0:1746066754.973091:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 27 pid: 17253 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066754.973127:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7135 00000100:00100000:3.0:1746066754.973136:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983183616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066754.973141:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7136 00000100:00100000:2.0:1746066754.973150:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882983183488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066754.973161:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066754.973167:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 27 pid: 17253 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066754.973176:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 27 pid: 17253 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066754.973192:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fafe00/0xf1867c21abfa6a09 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13d8 expref: 27 pid: 17253 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066754.973211:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.973215:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.973222:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.973226:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066754.973236:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066754.973243:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 45 pid: 17253 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.973253:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 45 pid: 17253 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066754.973259:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983183488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.973265:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7136 00010000:00010000:3.0:1746066754.973271:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009357b600/0xf1867c21abfa69b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d13a7 expref: 45 pid: 17253 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066754.973287:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066754.973290:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066754.973298:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066754.973305:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066754.973323:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066754.973359:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983183616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 224us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066754.973359:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983183104:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16397us (17997us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066754.973366:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7135 00000100:00100000:2.0:1746066754.973366:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4192 00002000:00100000:2.0:1746066754.973373:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800966e2d80 x1830882983183104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.973381:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2d80 with x1830882983183104 ext(3145728->4194303) 00002000:00010000:2.0:1746066754.973384:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2d80 00010000:00010000:0.0:1746066754.973447:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066754.973454:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066754.973469:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066754.973575:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848ac00/0xf1867c21abfa6d90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066754.973601:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 26 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066754.973607:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066754.973609:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066754.973611:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a200, rc 0) 00000100:00100000:0.0:1746066754.973642:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:587:x1830882983183360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7243us (7667us total) trans 8589936591 rc 0/0 00000100:00100000:0.0:1746066754.973648:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16267 00000100:00100000:0.0:1746066754.979653:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.979732:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983183872 00000100:00100000:2.0:1746066754.979738:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983183872 00002000:00100000:2.0:1746066754.979770:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800966e2300 x1830882983183872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/0 e 0 to 0 dl 1746066765 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.979776:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882983183872 ext(4194304->5033983) 00002000:00010000:2.0:1746066754.979780:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:2.0:1746066754.979797:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4193 00000100:00100000:2.0:1746066754.979803:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983183872:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066754.992242:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983183872:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12431us (12587us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066754.992250:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4193 00002000:00100000:2.0:1746066754.992258:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800966e2300 x1830882983183872/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:160/0 lens 488/440 e 0 to 0 dl 1746066765 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066754.992263:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e2300 with x1830882983183872 ext(4194304->5033983) 00002000:00010000:2.0:1746066754.992268:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e2300 00000100:00100000:0.0:1746066754.998950:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066754.999312:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983184128 00000100:00100000:2.0:1746066754.999320:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983184128 00000100:00100000:2.0:1746066754.999367:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16268 00000100:00100000:2.0:1746066754.999374:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:589:x1830882983184128:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066754.999393:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066754.999408:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed800/0xf1867c21abfa6da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15ec expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.999466:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999478:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999487:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999498:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999503:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999520:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999597:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999604:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999609:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066754.999617:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066754.999667:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999672:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999676:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999681:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999685:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19ec800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.999688:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999693:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999700:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066754.999703:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.999707:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999711:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999731:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999735:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999739:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999743:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19ed600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066754.999745:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999748:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999753:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea05200) 00010000:00010000:2.0:1746066754.999755:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066754.999757:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999761:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6db3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066754.999871:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed800/0xf1867c21abfa6da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 47 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.999903:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 46 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066754.999908:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066754.999910:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066754.999912:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30600, rc 0) 00000100:00100000:2.0:1746066755.000078:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:589:x1830882983184128:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 703us (1134us total) trans 8589936592 rc 0/0 00000100:00100000:2.0:1746066755.000083:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16268 00000100:00100000:0.0:1746066755.003137:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.003297:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983184256 00000100:00100000:3.0:1746066755.003308:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983184256 00000100:00080000:1.0:1746066755.003376:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066755.003378:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15893 00000100:00100000:3.0:1746066755.003386:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:589:x1830882983184256:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.003426:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.003444:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15f3 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.003479:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.003487:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.003489:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.003492:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2506752->2613247] (req 2506752->2613247) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 39 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.003539:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 39 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.003551:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 39 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.003569:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984437888:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.003808:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.004216:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.004266:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983184384 00000100:00100000:2.0:1746066755.004276:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983184384 00000100:00100000:2.0:1746066755.004335:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16269 00000100:00100000:2.0:1746066755.004342:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+26:587:x1830882983184384:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.004359:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.004376:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d15fa expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.004419:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.004429:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 27 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.004442:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.004444:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066755.004447:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ec800, rc 0) 00000100:00100000:2.0:1746066755.004504:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:587:x1830882983184384:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 163us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.004524:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16269 00000100:00100000:3.0:1746066755.005952:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984437888:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.005976:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2506752->2613247] (req 2506752->2613247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 39 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.005991:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eba00, rc 0) 00000100:00100000:3.0:1746066755.006032:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:589:x1830882983184256:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2646us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.006040:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15893 00000100:00100000:0.0:1746066755.006110:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.006168:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983184512 00000100:00100000:3.0:1746066755.006173:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983184512 00000100:00080000:1.0:1746066755.006210:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066755.006224:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15894 00000100:00100000:3.0:1746066755.006234:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+18:587:x1830882983184512:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.006246:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.006259:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1601 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.006278:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.006285:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.006287:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.006289:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2322432->2809855] (req 2322432->2809855) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.006316:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 32 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.006327:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 32 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.006338:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984438016:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.006401:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.007410:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984438016:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.007424:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2322432->2809855] (req 2322432->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 19 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.007436:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eac00, rc 0) 00000100:00100000:3.0:1746066755.007470:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+19:587:x1830882983184512:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1236us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.007476:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15894 00000100:00100000:0.0:1746066755.010296:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.010571:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983184640 00000100:00100000:3.0:1746066755.010581:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983184640 00010000:00010000:3.0:1746066755.010637:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.010668:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7137 00000100:00100000:3.0:1746066755.010675:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983184640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.010690:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.010710:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.010720:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.010742:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943ebc00/0xf1867c21abfa6d89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15de expref: 33 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.010773:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.010775:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.010780:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.010789:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.010818:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 18 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.010829:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984438144:192.168.204.16@tcp:105: 00000100:00080000:1.0:1746066755.010912:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066755.010919:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7f38780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.010974:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.011025:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983184768 00000100:00100000:1.0:1746066755.011029:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983184768 00010000:00010000:1.0:1746066755.011046:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 39 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066755.011064:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7138 00000100:00100000:1.0:1746066755.011068:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983184768:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.011076:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.011090:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 39 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.011104:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 39 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.011117:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d06200/0xf1867c21abfa6d7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15d0 expref: 39 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.011142:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.011144:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.011148:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.011155:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.011172:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 38 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066755.011184:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984438272:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066755.011221:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.012259:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.012424:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984438144:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066755.012440:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.012467:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983184640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1792us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.012474:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7137 00000100:00100000:1.0:1746066755.012700:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984438272:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066755.012712:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.012717:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983185024 00000100:00100000:2.0:1746066755.012722:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983185024 00000100:00100000:1.0:1746066755.012744:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983184768:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1675us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.012750:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7138 00002000:00100000:2.0:1746066755.012753:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2506752->2510847) req@ffff88012faf7b80 x1830882983185024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.012762:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7b80 with x1830882983185024 ext(2506752->2510847) 00002000:00010000:2.0:1746066755.012767:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf7b80 00000100:00100000:2.0:1746066755.012781:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4194 00000100:00100000:2.0:1746066755.012786:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983185024:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066755.012922:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983185024:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 135us (664us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066755.012931:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4194 00002000:00100000:2.0:1746066755.012936:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2506752->2510847) req@ffff88012faf7b80 x1830882983185024/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.012942:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf7b80 with x1830882983185024 ext(2506752->2510847) 00002000:00010000:2.0:1746066755.012945:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf7b80 00000100:00100000:0.0:1746066755.015204:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.015302:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983185280 00000100:00100000:1.0:1746066755.015311:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983185280 00002000:00100000:1.0:1746066755.015356:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2609152->2613247) req@ffff88012faf5c00 x1830882983185280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.015366:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5c00 with x1830882983185280 ext(2609152->2613247) 00002000:00010000:1.0:1746066755.015372:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5c00 00000100:00100000:0.0:1746066755.015989:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.016952:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983185536 00000100:00100000:1.0:1746066755.016961:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983185536 00002000:00100000:1.0:1746066755.017002:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2805760->2809855) req@ffff880096e68000 x1830882983185536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.017011:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e68000 with x1830882983185536 ext(2805760->2809855) 00002000:00010000:1.0:1746066755.017017:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e68000 00000100:00100000:1.0:1746066755.017038:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4195 00000100:00100000:1.0:1746066755.017047:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983185280:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066755.017225:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983185280:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 178us (2030us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066755.017232:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4195 00002000:00100000:1.0:1746066755.017238:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2609152->2613247) req@ffff88012faf5c00 x1830882983185280/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.017245:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5c00 with x1830882983185280 ext(2609152->2613247) 00002000:00010000:1.0:1746066755.017249:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5c00 00000100:00100000:1.0:1746066755.017263:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4196 00000100:00100000:1.0:1746066755.017267:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983185536:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066755.017322:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983185536:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 55us (1334us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066755.017331:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4196 00002000:00100000:1.0:1746066755.017335:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2805760->2809855) req@ffff880096e68000 x1830882983185536/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.017341:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e68000 with x1830882983185536 ext(2805760->2809855) 00002000:00010000:1.0:1746066755.017344:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e68000 00000100:00100000:0.0:1746066755.020123:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.020706:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983185792 00000100:00100000:3.0:1746066755.020716:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983185792 00000100:00100000:3.0:1746066755.020773:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5928 00000100:00100000:3.0:1746066755.020854:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:589:x1830882983185792:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066755.021333:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:589:x1830882983185792:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 481us (1216us total) trans 8589936593 rc 0/0 00000100:00100000:3.0:1746066755.021341:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5928 00000100:00100000:0.0:1746066755.030935:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.031009:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983186048 00000100:00100000:2.0:1746066755.031020:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983186048 00000100:00100000:2.0:1746066755.031070:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16270 00000100:00100000:2.0:1746066755.031079:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:595:x1830882983186048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.031100:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.031120:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1608 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.031200:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031217:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031228:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031241:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031246:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031251:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031350:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031359:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031365:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.031373:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066755.031448:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031454:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031459:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031465:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031471:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19ec000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.031475:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031481:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031491:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.031493:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.031497:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.031502:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec000/0xf1867c21abfa6de4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032129:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032135:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032141:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032145:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d30c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.032147:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032152:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032159:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea05200) 00010000:00010000:2.0:1746066755.032161:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.032164:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032169:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa6deb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.032204:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.032215:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.032221:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.032223:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066755.032225:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57200, rc 0) 00000100:00100000:2.0:1746066755.032268:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:595:x1830882983186048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1191us (1386us total) trans 8589936594 rc 0/0 00000100:00100000:2.0:1746066755.032274:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16270 00000100:00100000:1.0:1746066755.035873:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.036912:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983186304 00000100:00100000:3.0:1746066755.036924:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983186304 00000100:00100000:3.0:1746066755.036979:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5929 00000100:00100000:3.0:1746066755.036987:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+29:595:x1830882983186304:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066755.037219:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:595:x1830882983186304:12345-192.168.204.16@tcp:35:cat.0 Request processed in 232us (1355us total) trans 8589936595 rc 0/0 00000100:00100000:3.0:1746066755.037226:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5929 00000100:00100000:0.0:1746066755.040876:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.040980:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983186432 00000100:00100000:3.0:1746066755.040988:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983186432 00000100:00100000:3.0:1746066755.041043:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15895 00000100:00100000:3.0:1746066755.041051:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983186432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066755.041069:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.041089:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943eae00/0xf1867c21abfa6e00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d160f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.041147:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984438400:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066755.041255:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.041781:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.041942:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983186560 00000100:00100000:2.0:1746066755.041947:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983186560 00000100:00100000:2.0:1746066755.041988:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15896 00000100:00100000:2.0:1746066755.041995:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983186560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.042003:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.042014:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf56800/0xf1867c21abfa6e07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1616 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.042041:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984438528:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.042086:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00080000:0.0:1746066755.042312:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1746066755.043719:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066755 -> 1746066756 00002000:00010000:3.0:1746066755.043724:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066755 -> 1746066756 00002000:00010000:3.0:1746066755.043728:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066755 -> 1746066756 00000100:00100000:3.0:1746066755.043748:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984438400:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.043776:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800943eae00/0xf1867c21abfa6e00 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d160f expref: 20 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.043789:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943eae00/0xf1867c21abfa6e00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d160f expref: 20 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.043814:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943eae00, rc 0) 00000100:00100000:3.0:1746066755.043852:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983186432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2802us (2985us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066755.043860:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15895 00002000:00010000:2.0:1746066755.044961:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066755 -> 1746066756 00002000:00010000:2.0:1746066755.044968:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066755 -> 1746066756 00002000:00010000:2.0:1746066755.044970:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066755 -> 1746066756 00000100:00100000:2.0:1746066755.044986:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984438528:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066755.045014:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf56800/0xf1867c21abfa6e07 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1616 expref: 24 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.045026:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf56800/0xf1867c21abfa6e07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1616 expref: 24 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.045050:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf56800, rc 0) 00000100:00100000:2.0:1746066755.045102:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983186560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3107us (3320us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.045109:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15896 00000100:00100000:0.0:1746066755.048594:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.048729:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983186688 00000100:00100000:2.0:1746066755.048740:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983186688 00000100:00100000:2.0:1746066755.048840:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15897 00000100:00100000:2.0:1746066755.048849:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:595:x1830882983186688:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.048869:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.048925:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d161d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.048962:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.048970:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.048971:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.048975:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.049007:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.049020:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 31 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.049033:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984438656:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.049130:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.050635:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984438656:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.050662:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 20 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.050676:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf57800, rc 0) 00000100:00100000:2.0:1746066755.050717:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+20:595:x1830882983186688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1869us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.050726:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15897 00000100:00100000:0.0:1746066755.051462:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.051542:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983186816 00000100:00100000:2.0:1746066755.051552:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983186816 00002000:00100000:2.0:1746066755.051671:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1224704->1871871) req@ffff880096e68e00 x1830882983186816/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.051680:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e68e00 with x1830882983186816 ext(1224704->1871871) 00010000:00010000:2.0:1746066755.051688:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 32 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.051705:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 32 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.051710:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096e68e00 00000100:00100000:2.0:1746066755.051739:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 930 00000100:00100000:2.0:1746066755.051746:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2016:x1830882983186816:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066755.059967:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983186816:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8211us (8498us total) trans 17179874407 rc 0/0 00000100:00100000:2.0:1746066755.059979:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 930 00002000:00100000:2.0:1746066755.059990:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1224704->1871871) req@ffff880096e68e00 x1830882983186816/t17179874407(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.059999:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e68e00 with x1830882983186816 ext(1224704->1871871) 00010000:00010000:2.0:1746066755.060008:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 34 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.060023:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 34 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.060030:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096e68e00 00000100:00100000:0.0:1746066755.062253:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.062382:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983186944 00000100:00100000:1.0:1746066755.062393:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983186944 00010000:00010000:1.0:1746066755.062430:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 34 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066755.062649:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7139 00000100:00100000:1.0:1746066755.062657:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983186944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.062669:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.062684:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 34 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.062693:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 34 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.062712:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0c200/0xf1867c21abfa6d35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1224704->1871871) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1598 expref: 34 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.063065:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.063068:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.063075:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.063082:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.063111:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 19 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066755.063121:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984438784:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066755.063494:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.066718:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.066773:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983187200 00000100:00100000:3.0:1746066755.066782:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983187200 00002000:00100000:3.0:1746066755.066820:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a5d7ca80 x1830882983187200/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.066828:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ca80 with x1830882983187200 ext(1048576->2097151) 00002000:00010000:3.0:1746066755.066832:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ca80 00000100:00100000:3.0:1746066755.066855:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4197 00000100:00100000:3.0:1746066755.066861:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983187200:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066755.066919:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984438784:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066755.066940:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.067101:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983186944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4443us (4859us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.067111:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7139 00000100:00100000:3.0:1746066755.072201:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983187200:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5327us (5481us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066755.072214:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4197 00002000:00100000:3.0:1746066755.072226:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a5d7ca80 x1830882983187200/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.072241:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ca80 with x1830882983187200 ext(1048576->2097151) 00002000:00010000:3.0:1746066755.072247:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7ca80 00000100:00100000:0.0:1746066755.077559:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.077667:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983187328 00000100:00100000:2.0:1746066755.077675:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983187328 00000100:00100000:2.0:1746066755.077728:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15898 00000100:00100000:2.0:1746066755.077735:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:595:x1830882983187328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.077753:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.077769:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1624 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.077795:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 37 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.077807:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.077809:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.077812:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.077837:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 37 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.077847:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 37 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.077858:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984438912:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.078179:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.079866:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984438912:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.079913:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.079923:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576be00, rc 0) 00000100:00100000:2.0:1746066755.079961:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:595:x1830882983187328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2227us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.079966:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15898 00000100:00100000:2.0:1746066755.080758:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.080841:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983187456 00000100:00100000:3.0:1746066755.080849:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983187456 00002000:00100000:3.0:1746066755.080917:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2506752->2613247) req@ffff880093cce680 x1830882983187456/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.080927:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cce680 with x1830882983187456 ext(2506752->2613247) 00010000:00010000:3.0:1746066755.080935:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 38 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.080948:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 38 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066755.080954:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cce680 00000100:00100000:3.0:1746066755.080971:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 931 00000100:00100000:3.0:1746066755.080978:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983187456:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066755.083586:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983187456:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2599us (2825us total) trans 21474841857 rc 0/0 00000100:00100000:3.0:1746066755.083597:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 931 00002000:00100000:3.0:1746066755.083606:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2506752->2613247) req@ffff880093cce680 x1830882983187456/t21474841857(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.083615:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093cce680 with x1830882983187456 ext(2506752->2613247) 00010000:00010000:3.0:1746066755.083625:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 40 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.083638:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 40 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066755.083645:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093cce680 00000100:00100000:0.0:1746066755.087023:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.087104:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983187584 00000100:00100000:1.0:1746066755.087114:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983187584 00010000:00010000:1.0:1746066755.087150:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 40 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066755.087189:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7140 00000100:00100000:1.0:1746066755.087196:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983187584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.087211:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.087231:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 40 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.087249:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 40 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.087268:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800943eba00/0xf1867c21abfa6dc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2506752->2613247) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15f3 expref: 40 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.087289:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.087291:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.087297:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.087303:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.087331:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066755.087340:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984439040:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066755.087410:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363900 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.088638:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984439040:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066755.088655:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.088680:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882983187584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1483us (1667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.088688:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7140 00000100:00100000:0.0:1746066755.093714:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.093770:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.093862:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983187968 00000100:00100000:1.0:1746066755.093865:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983188096 00000100:00100000:3.0:1746066755.093872:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983187968 00000100:00100000:1.0:1746066755.093872:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983188096 00002000:00100000:3.0:1746066755.093944:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800a5d7ed80 x1830882983187968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.093954:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830882983187968 ext(2097152->4194303) 00002000:00010000:3.0:1746066755.093960:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7ed80 00000100:00100000:3.0:1746066755.093979:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4198 00000100:00100000:3.0:1746066755.093988:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983187968:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:1.0:1746066755.094058:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d7f480 x1830882983188096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 504/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.094070:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830882983188096 ext(2097152->4194303) 00002000:00010000:1.0:1746066755.094075:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:1.0:1746066755.094121:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4199 00000100:00100000:1.0:1746066755.094129:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983188096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066755.106834:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983187968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12838us (13123us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066755.106846:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4198 00002000:00100000:3.0:1746066755.106856:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800a5d7ed80 x1830882983187968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.106863:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7ed80 with x1830882983187968 ext(2097152->4194303) 00002000:00010000:3.0:1746066755.106869:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d7ed80 00000100:00100000:1.0:1746066755.111386:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983188096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17250us (17607us total) trans 0 rc 1609728/1609728 00000100:00100000:1.0:1746066755.111570:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4199 00002000:00100000:1.0:1746066755.111583:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d7f480 x1830882983188096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 504/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1609728/1609728 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.111592:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d7f480 with x1830882983188096 ext(2097152->4194303) 00002000:00010000:1.0:1746066755.111598:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d7f480 00000100:00100000:0.0:1746066755.117681:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.117818:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983188352 00000100:00100000:1.0:1746066755.117829:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983188352 00002000:00100000:1.0:1746066755.117873:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096fd5880 x1830882983188352/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.117928:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5880 with x1830882983188352 ext(4194304->5033983) 00002000:00010000:1.0:1746066755.117933:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd5880 00000100:00100000:1.0:1746066755.117974:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4200 00000100:00100000:1.0:1746066755.117981:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882983188352:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066755.123033:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882983188352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5042us (5354us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066755.123047:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4200 00002000:00100000:1.0:1746066755.123057:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096fd5880 x1830882983188352/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.123066:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd5880 with x1830882983188352 ext(4194304->5033983) 00002000:00010000:1.0:1746066755.123072:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd5880 00000100:00100000:0.0:1746066755.134643:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.134762:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983188608 00000100:00100000:2.0:1746066755.134772:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983188608 00000100:00100000:2.0:1746066755.134819:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16271 00000100:00100000:2.0:1746066755.134826:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:597:x1830882983188608:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.134851:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.134870:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d162b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.134984:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.134996:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135007:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135019:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135024:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135029:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135126:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e31 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135135:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135140:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e31 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.135148:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066755.135218:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135223:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135229:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135234:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135239:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576b600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.135242:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135248:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135258:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.135261:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.135265:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135269:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b600/0xf1867c21abfa6e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135302:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135310:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135315:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135318:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576a000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.135320:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135323:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135328:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34ee00) 00010000:00010000:2.0:1746066755.135330:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.135332:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135336:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.135371:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d162b expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.135381:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e31 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d162b expref: 32 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.135386:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.135388:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066755.135390:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:2.0:1746066755.135455:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:597:x1830882983188608:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 628us (824us total) trans 8589936596 rc 0/0 00000100:00100000:2.0:1746066755.135462:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16271 00000100:00100000:0.0:1746066755.137226:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.137526:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983188864 00000100:00100000:3.0:1746066755.137535:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983188864 00000100:00100000:3.0:1746066755.137578:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5930 00000100:00100000:3.0:1746066755.137621:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:597:x1830882983188864:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066755.137711:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.137819:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:597:x1830882983188864:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 233us (597us total) trans 8589936597 rc 0/0 00000100:00100000:3.0:1746066755.137825:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5930 00000100:00100000:0.0:1746066755.138249:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983188992 00000100:00100000:0.0:1746066755.138253:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983188992 00000100:00100000:0.0:1746066755.138292:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 779 00000100:00100000:0.0:1746066755.138297:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2013:x1830882983188992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066755.138306:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066755.138329:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d162b expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.138355:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066755.138359:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066755.138381:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983188992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.138386:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 779 00000100:00100000:0.0:1746066755.226190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.226369:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983189248 00000100:00100000:2.0:1746066755.226379:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983189248 00000100:00100000:2.0:1746066755.226429:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16272 00000100:00100000:2.0:1746066755.226438:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:602:x1830882983189248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.226463:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.226481:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa6e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1632 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.226571:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226584:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226594:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226607:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226613:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226618:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226719:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226730:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226736:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.226746:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066755.226821:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226827:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226832:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226838:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226843:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576a600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.226847:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226854:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226864:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.226867:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.226870:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226875:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a600/0xf1867c21abfa6e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226917:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226926:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226931:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226934:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a576b200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.226936:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226941:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226947:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34ee00) 00010000:00010000:2.0:1746066755.226952:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.226954:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226959:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576b200/0xf1867c21abfa6e4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.226996:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576bc00/0xf1867c21abfa6e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1632 expref: 50 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.227007:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1632 expref: 49 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.227012:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.227014:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066755.227017:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a000, rc 0) 00000100:00100000:2.0:1746066755.227074:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:602:x1830882983189248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 636us (895us total) trans 8589936598 rc 0/0 00000100:00100000:2.0:1746066755.227081:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16272 00000100:00100000:0.0:1746066755.229354:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.229549:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.229617:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983189504 00000100:00100000:3.0:1746066755.229625:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983189504 00000100:00100000:3.0:1746066755.229674:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5931 00000100:00100000:3.0:1746066755.229680:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:602:x1830882983189504:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066755.230359:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983189632 00000100:00100000:2.0:1746066755.230364:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983189632 00000100:00100000:2.0:1746066755.230394:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 780 00000100:00100000:2.0:1746066755.230399:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882983189632:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.230411:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.230434:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a576a000/0xf1867c21abfa6e54 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1632 expref: 50 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.230451:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.230455:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.230518:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882983189632:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.230523:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 780 00000100:00100000:3.0:1746066755.230604:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:602:x1830882983189504:12345-192.168.204.16@tcp:35:cat.0 Request processed in 923us (1256us total) trans 8589936599 rc 0/0 00000100:00100000:3.0:1746066755.230610:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5931 00000100:00100000:0.0:1746066755.232838:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.235115:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983189760 00000100:00100000:2.0:1746066755.235125:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983189760 00000100:00100000:2.0:1746066755.235285:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15899 00000100:00100000:2.0:1746066755.235292:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983189760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.235306:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.235321:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1639 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.235340:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.235342:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.235349:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.235366:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.235373:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:2.0:1746066755.235420:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983189760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 128us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.235425:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15899 00000100:00100000:0.0:1746066755.235707:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.235797:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.235859:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983189888 00000100:00100000:3.0:1746066755.235864:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983189888 00000100:00100000:3.0:1746066755.235916:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983190016 00000100:00100000:3.0:1746066755.235919:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983190016 00000100:00100000:3.0:1746066755.235941:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15900 00000100:00100000:3.0:1746066755.235946:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882983189888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066755.235954:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.235963:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1640 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.235974:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.235975:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.235980:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066755.236062:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15901 00000100:00100000:2.0:1746066755.236069:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983190016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.236076:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.236083:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa6e70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1647 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.236117:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984439168:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.236209:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 40 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.236224:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d895800, rc 0) 00000100:00100000:3.0:1746066755.236249:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983189888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 304us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.236254:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15900 00000100:00100000:2.0:1746066755.236266:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746066755.237777:0:9590:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066755 -> 1746066756 00002000:00010000:2.0:1746066755.237782:0:9590:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066755 -> 1746066756 00002000:00010000:2.0:1746066755.237784:0:9590:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066755 -> 1746066756 00000100:00100000:2.0:1746066755.237799:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984439168:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066755.238081:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa6e70 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1647 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.238093:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576b400/0xf1867c21abfa6e70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1647 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.238107:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576b400, rc 0) 00000100:00100000:2.0:1746066755.238151:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983190016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2080us (2352us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.238156:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15901 00000100:00100000:0.0:1746066755.239930:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.240069:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983190272 00000100:00100000:2.0:1746066755.240077:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983190272 00000100:00100000:2.0:1746066755.240122:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16273 00000100:00100000:2.0:1746066755.240129:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:604:x1830882983190272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.240146:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.240159:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6e77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d164e expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.240227:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240237:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240245:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240255:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240260:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240264:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240341:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6e8c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240349:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6e8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240355:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6e8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.240362:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066755.240419:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240425:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240430:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240435:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240439:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe2a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.240443:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240448:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240457:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.240459:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.240463:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240470:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa6e7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240480:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240485:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240489:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240492:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.240494:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240498:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240514:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34e500) 00010000:00010000:2.0:1746066755.240517:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.240519:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240523:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6e85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.240552:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa6e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d164e expref: 52 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.240561:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6e8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d164e expref: 51 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.240572:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.240573:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066755.240575:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ed600, rc 0) 00000100:00100000:2.0:1746066755.240612:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:604:x1830882983190272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 483us (689us total) trans 8589936600 rc 0/0 00000100:00100000:2.0:1746066755.240618:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16273 00000100:00100000:0.0:1746066755.243097:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.243187:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983190528 00000100:00100000:1.0:1746066755.243196:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983190528 00002000:00100000:1.0:1746066755.243235:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800967a9f80 x1830882983190528/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.243244:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882983190528 ext(1048576->2097151) 00002000:00010000:1.0:1746066755.243248:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9f80 00000100:00100000:1.0:1746066755.243283:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4201 00000100:00100000:1.0:1746066755.243289:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983190528:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066755.246096:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.246571:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983190656 00000100:00100000:2.0:1746066755.246580:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983190656 00000100:00100000:1.0:1746066755.247076:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 781 00000100:00100000:1.0:1746066755.247085:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:2013:x1830882983190656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.247099:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.247122:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ed600/0xf1867c21abfa6e8c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d164e expref: 51 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.247144:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066755.247149:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.247182:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983190656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 98us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.247191:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 781 00000100:00100000:0.0:1746066755.248953:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.249181:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983190912 00000100:00100000:2.0:1746066755.249187:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983190912 00000100:00100000:2.0:1746066755.249217:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16274 00000100:00100000:2.0:1746066755.249224:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+32:607:x1830882983190912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.249388:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.249403:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa6e9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1655 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.249464:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249475:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249483:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249494:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249499:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249517:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249597:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa6eaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249606:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa6eaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249612:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa6eaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.249621:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066755.249678:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249684:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249700:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249705:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249709:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009db77400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.249712:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249717:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249725:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.249728:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.249731:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249735:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77400/0xf1867c21abfa6ea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249744:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249749:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249753:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249756:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009db77600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.249758:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249762:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249768:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34e600) 00010000:00010000:2.0:1746066755.249770:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.249772:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249776:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77600/0xf1867c21abfa6ea8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.249806:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db76200/0xf1867c21abfa6e9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1655 expref: 35 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.249816:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa6eaf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1655 expref: 34 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.249822:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.249824:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066755.249826:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77000, rc 0) 00000100:00100000:2.0:1746066755.249870:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:607:x1830882983190912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 646us (923us total) trans 8589936601 rc 0/0 00000100:00100000:2.0:1746066755.249876:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16274 00000100:00100000:1.0:1746066755.250837:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983190528:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7546us (7746us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066755.250844:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4201 00002000:00100000:1.0:1746066755.250851:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800967a9f80 x1830882983190528/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.250860:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882983190528 ext(1048576->2097151) 00002000:00010000:1.0:1746066755.250864:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9f80 00000100:00100000:0.0:1746066755.254603:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.254653:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.254778:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983191040 00000100:00100000:2.0:1746066755.254785:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983191040 00000100:00100000:2.0:1746066755.254833:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 782 00000100:00100000:2.0:1746066755.254838:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882983191040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.254847:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.254867:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009db77000/0xf1867c21abfa6eaf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1655 expref: 34 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.254906:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.254910:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.254944:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983191296 00000100:00100000:2.0:1746066755.254945:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983191040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.254951:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 782 00000100:00100000:3.0:1746066755.254953:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983191296 00000100:00100000:3.0:1746066755.254977:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5932 00000100:00100000:3.0:1746066755.254987:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:607:x1830882983191296:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066755.255128:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:607:x1830882983191296:12345-192.168.204.16@tcp:35:cat.0 Request processed in 145us (475us total) trans 8589936602 rc 0/0 00000100:00100000:3.0:1746066755.255434:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5932 00000100:00100000:0.0:1746066755.257589:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.257690:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983191424 00000100:00100000:2.0:1746066755.257700:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983191424 00000100:00100000:2.0:1746066755.257744:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15902 00000100:00100000:2.0:1746066755.257752:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:597:x1830882983191424:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.257770:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.257787:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d165c expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.257833:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.257842:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.257849:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.257850:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.257854:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [327680->1048575] (req 327680->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.257915:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 39 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.257929:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 39 pid: 20361 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066755.257941:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984439296:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.258046:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.258054:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 25 pid: 11630 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.258062:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984439424:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.258085:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.260239:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984439296:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066755.261058:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.261083:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984439424:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.261118:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [327680->1048575] (req 327680->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.261135:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db76e00, rc 0) 00000100:00100000:2.0:1746066755.261193:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:597:x1830882983191424:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3436us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.261203:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15902 00000100:00100000:1.0:1746066755.261524:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983191552 00000100:00100000:1.0:1746066755.261531:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983191552 00010000:00010000:1.0:1746066755.261560:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 40 pid: 20361 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746066755.261599:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7141 00000100:00100000:1.0:1746066755.261607:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882983191552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.261618:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.261634:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 40 pid: 20361 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746066755.261644:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 40 pid: 20361 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746066755.261661:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa6b28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d145d expref: 40 pid: 20361 timeout: 823 lvb_type: 1 00010000:00010000:1.0:1746066755.261683:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.261711:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983191552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.261717:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7141 00000100:00100000:0.0:1746066755.263033:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.263121:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983191680 00000100:00100000:2.0:1746066755.263127:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983191680 00010000:00010000:2.0:1746066755.263145:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 25 pid: 11630 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.263203:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7142 00000100:00100000:2.0:1746066755.263209:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983191680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.263216:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.263228:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 25 pid: 11630 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.263236:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 25 pid: 11630 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.263249:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fa1a00/0xf1867c21abfa6acd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1448 expref: 25 pid: 11630 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.263267:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.263268:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.263274:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.263281:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.263306:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.263316:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984439552:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066755.263370:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.263709:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.263747:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.263804:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983191936 00000100:00100000:1.0:1746066755.263808:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983191936 00002000:00100000:1.0:1746066755.263833:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880093ccc700 x1830882983191936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.263841:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccc700 with x1830882983191936 ext(2097152->3145727) 00002000:00010000:1.0:1746066755.263845:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccc700 00000100:00100000:1.0:1746066755.263867:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4202 00000100:00100000:1.0:1746066755.263873:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882983191936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066755.263972:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983192064 00000100:00100000:0.0:1746066755.263980:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983192064 00000100:00100000:0.0:1746066755.264026:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15903 00000100:00100000:0.0:1746066755.264033:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983192064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066755.264048:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.264063:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094541600/0xf1867c21abfa6ec4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1663 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.264101:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984439680:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.264156:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.266780:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.266816:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984439552:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.266840:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.266917:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983191680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3706us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.266926:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7142 00002000:00010000:1.0:1746066755.267143:0:12255:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746066755 -> 1746066756 00002000:00010000:1.0:1746066755.267147:0:12255:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066754 -> 1746066756 00002000:00010000:1.0:1746066755.267149:0:12255:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746066755 -> 1746066756 00000100:00100000:1.0:1746066755.267160:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a88000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984439680:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066755.267182:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094541600/0xf1867c21abfa6ec4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1663 expref: 25 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.267193:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094541600/0xf1867c21abfa6ec4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1663 expref: 25 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.267202:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094541600, rc 0) 00000100:00100000:1.0:1746066755.267227:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983192064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3195us (3519us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066755.267234:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15903 00000100:00100000:3.0:1746066755.268823:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983192320 00000100:00100000:3.0:1746066755.268832:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983192320 00002000:00100000:3.0:1746066755.268878:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (327680->331775) req@ffff880097a89c00 x1830882983192320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.268924:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89c00 with x1830882983192320 ext(327680->331775) 00002000:00010000:3.0:1746066755.268929:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a89c00 00000100:00100000:3.0:1746066755.268955:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4203 00000100:00100000:3.0:1746066755.268963:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983192320:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066755.269123:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983192320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 160us (2350us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066755.269129:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4203 00002000:00100000:3.0:1746066755.269135:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (327680->331775) req@ffff880097a89c00 x1830882983192320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.269142:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a89c00 with x1830882983192320 ext(327680->331775) 00002000:00010000:3.0:1746066755.269145:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a89c00 00000100:00100000:1.0:1746066755.274179:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882983191936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10283us (10408us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066755.274193:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4202 00002000:00100000:1.0:1746066755.274206:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880093ccc700 x1830882983191936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.274216:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccc700 with x1830882983191936 ext(2097152->3145727) 00002000:00010000:1.0:1746066755.274222:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ccc700 00000100:00100000:1.0:1746066755.278422:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.278534:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983192448 00000100:00100000:2.0:1746066755.278544:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983192448 00000100:00100000:2.0:1746066755.278598:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15904 00000100:00100000:2.0:1746066755.278605:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+39:604:x1830882983192448:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.278621:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.278637:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d166a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.278660:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.278666:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.278668:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.278670:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [200704->630783] (req 200704->630783) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 40 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.278694:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.278703:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 23 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.278713:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984439808:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.279517:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.279906:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.279949:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.280030:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983192576 00000100:00100000:2.0:1746066755.280037:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983192576 00000100:00100000:2.0:1746066755.280071:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983192704 00000100:00100000:2.0:1746066755.280073:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983192704 00000100:00100000:2.0:1746066755.280088:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15905 00000100:00100000:2.0:1746066755.280094:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:602:x1830882983192576:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.280109:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.280125:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1671 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.280157:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.280164:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746066755.280165:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15906 00010000:00010000:2.0:1746066755.280166:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.280170:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 35 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.280174:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:597:x1830882983192704:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.280182:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.280190:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1678 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.280196:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 20 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.280206:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.280206:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 21 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.280213:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066755.280217:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984439936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.280218:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.280219:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.280222:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.280239:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.280247:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 35 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746066755.280255:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984440064:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.280292:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00010000:00010000:3.0:1746066755.280305:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 21 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.280312:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 21 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.280499:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984439808:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.280533:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [200704->630783] (req 200704->630783) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 40 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.280543:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984440192:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.280545:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3800, rc 0) 00000100:00100000:3.0:1746066755.280568:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.280579:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+40:604:x1830882983192448:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1974us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.280585:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15904 00000100:00100000:0.0:1746066755.282466:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.282566:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983192832 00000100:00100000:1.0:1746066755.282577:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983192832 00000100:00100000:3.0:1746066755.282673:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984440064:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.282674:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984439936:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.282682:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984440192:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.282697:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 35 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.282700:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.282711:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0400, rc 0) 00010000:00010000:2.0:1746066755.282711:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77400, rc 0) 00002000:00100000:1.0:1746066755.282729:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (327680->1048575) req@ffff880095800e00 x1830882983192832/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.282738:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800e00 with x1830882983192832 ext(327680->1048575) 00010000:00010000:1.0:1746066755.282747:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 24 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.282750:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:597:x1830882983192704:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2577us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.282750:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:602:x1830882983192576:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2655us (2846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.282757:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15905 00010000:00010000:1.0:1746066755.282759:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 24 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.282761:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15906 00002000:00010000:1.0:1746066755.282766:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800e00 00000100:00100000:1.0:1746066755.282802:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 932 00000100:00100000:1.0:1746066755.282811:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983192832:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066755.283943:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.284086:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983192960 00000100:00100000:2.0:1746066755.284092:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983192960 00002000:00100000:2.0:1746066755.284119:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2322432->2809855) req@ffff880095802300 x1830882983192960/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.284128:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802300 with x1830882983192960 ext(2322432->2809855) 00010000:00010000:2.0:1746066755.284135:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 21 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.284146:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 21 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.284153:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095802300 00000100:00100000:2.0:1746066755.284179:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 933 00000100:00100000:2.0:1746066755.284184:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882983192960:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066755.286740:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.286785:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.286831:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983193088 00000100:00100000:1.0:1746066755.286839:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983193088 00000100:00100000:2.0:1746066755.286853:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983193216 00000100:00100000:2.0:1746066755.286857:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983193216 00010000:00010000:2.0:1746066755.286871:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 23 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.286871:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 35 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:1.0:1746066755.286926:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7143 00000100:00100000:1.0:1746066755.286932:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983193088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.286945:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.286965:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 35 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066755.286974:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7144 00010000:00010000:1.0:1746066755.286976:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 35 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066755.286980:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983193216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.286988:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.287003:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a600/0xf1867c21abfa6e62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1639 expref: 35 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.287071:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 23 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.287075:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066755.287079:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 23 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.287090:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf57800/0xf1867c21abfa6e0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d161d expref: 23 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.287102:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.287104:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066755.287110:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983193088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 178us (378us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066755.287111:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 22 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066755.287116:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7143 00010000:00010000:2.0:1746066755.287119:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 22 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.287150:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 22 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.287164:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984440320:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066755.287209:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.291343:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983192832:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8523us (8871us total) trans 21474841858 rc 0/0 00000100:00100000:1.0:1746066755.291355:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 932 00002000:00100000:1.0:1746066755.291367:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (327680->1048575) req@ffff880095800e00 x1830882983192832/t21474841858(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.291376:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095800e00 with x1830882983192832 ext(327680->1048575) 00010000:00010000:1.0:1746066755.291386:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 26 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.291398:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 26 pid: 9590 timeout: 823 lvb_type: 0 00002000:00010000:1.0:1746066755.291404:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095800e00 00000100:00100000:2.0:1746066755.291576:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984440320:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.291594:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.291614:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b54a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983193216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4633us (4828us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.291622:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7144 00000100:00100000:2.0:1746066755.291740:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.291806:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983193472 00000100:00100000:1.0:1746066755.291813:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983193472 00002000:00100000:1.0:1746066755.291845:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1191936->1196031) req@ffff880093ccd500 x1830882983193472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.291852:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd500 with x1830882983193472 ext(1191936->1196031) 00002000:00010000:1.0:1746066755.291855:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccd500 00000100:00100000:1.0:1746066755.291870:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4204 00000100:00100000:1.0:1746066755.291877:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983193472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066755.291998:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983193472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 121us (258us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066755.292003:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4204 00002000:00100000:1.0:1746066755.292007:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1191936->1196031) req@ffff880093ccd500 x1830882983193472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.292013:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd500 with x1830882983193472 ext(1191936->1196031) 00002000:00010000:1.0:1746066755.292015:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccd500 00000100:00100000:0.0:1746066755.294063:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.294173:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983193600 00000100:00100000:2.0:1746066755.294180:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983193600 00010000:00010000:2.0:1746066755.294210:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 26 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.294244:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7145 00000100:00100000:2.0:1746066755.294251:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983193600:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.294263:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.294323:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 26 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.294336:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 26 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.294359:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009db76e00/0xf1867c21abfa6ebd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 327680->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d165c expref: 26 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.294386:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.294388:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.294395:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.294408:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.294442:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.294455:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984440448:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066755.294534:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983192960:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10339us (10582us total) trans 17179874408 rc 0/0 00000100:00100000:0.0:1746066755.294545:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 933 00002000:00100000:0.0:1746066755.294556:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2322432->2809855) req@ffff880095802300 x1830882983192960/t17179874408(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066755.294565:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095802300 with x1830882983192960 ext(2322432->2809855) 00010000:00010000:0.0:1746066755.294573:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.294588:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746066755.294595:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095802300 00000100:00100000:2.0:1746066755.294782:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.296047:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984440448:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.296065:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.296114:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983193600:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1862us (2055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.296122:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7145 00000100:00100000:0.0:1746066755.296922:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.297083:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983193856 00000100:00100000:2.0:1746066755.297089:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983193856 00002000:00100000:2.0:1746066755.297128:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (200704->204799) req@ffff880095803100 x1830882983193856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.297137:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803100 with x1830882983193856 ext(200704->204799) 00002000:00010000:2.0:1746066755.297175:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095803100 00000100:00100000:2.0:1746066755.297193:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4205 00000100:00100000:2.0:1746066755.297200:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983193856:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066755.297319:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983193856:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 120us (398us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066755.297328:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4205 00002000:00100000:2.0:1746066755.297333:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (200704->204799) req@ffff880095803100 x1830882983193856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.297339:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095803100 with x1830882983193856 ext(200704->204799) 00002000:00010000:2.0:1746066755.297342:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095803100 00000100:00100000:0.0:1746066755.298413:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.298567:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983193984 00000100:00100000:2.0:1746066755.298572:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983193984 00010000:00010000:2.0:1746066755.298593:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.298627:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7146 00000100:00100000:2.0:1746066755.298633:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983193984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.298644:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.298661:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.298672:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.298692:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943eac00/0xf1867c21abfa6dd6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2322432->2809855) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1601 expref: 22 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.298787:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.298790:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.298800:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.298813:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.298844:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.298856:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984440576:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066755.298946:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.300326:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984440576:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.300339:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.300365:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882983193984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1731us (1952us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.300373:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7146 00000100:00100000:0.0:1746066755.301622:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.301939:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983194240 00000100:00100000:2.0:1746066755.301946:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983194240 00002000:00100000:2.0:1746066755.301985:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (626688->630783) req@ffff880095801180 x1830882983194240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.301995:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801180 with x1830882983194240 ext(626688->630783) 00002000:00010000:2.0:1746066755.301999:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801180 00000100:00100000:2.0:1746066755.302029:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4206 00000100:00100000:2.0:1746066755.302036:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882983194240:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066755.302154:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882983194240:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 118us (534us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066755.302163:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4206 00002000:00100000:2.0:1746066755.302168:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (626688->630783) req@ffff880095801180 x1830882983194240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.302175:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095801180 with x1830882983194240 ext(626688->630783) 00002000:00010000:2.0:1746066755.302178:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095801180 00000100:00100000:0.0:1746066755.306695:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.306970:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.307008:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.307034:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983194880 00000100:00100000:3.0:1746066755.307044:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983194880 00000100:00100000:3.0:1746066755.307092:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5933 00000100:00100000:3.0:1746066755.307099:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+50:604:x1830882983194880:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066755.307118:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983194624 00000100:00100000:2.0:1746066755.307122:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983194624 00002000:00100000:2.0:1746066755.307147:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d9b0700 x1830882983194624/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.307155:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882983194624 ext(2097152->4194303) 00002000:00010000:2.0:1746066755.307160:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:2.0:1746066755.307172:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983195008 00000100:00100000:2.0:1746066755.307174:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983195008 00002000:00100000:2.0:1746066755.307184:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009d9b1500 x1830882983195008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.307190:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1500 with x1830882983195008 ext(3145728->4194303) 00002000:00010000:2.0:1746066755.307192:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1500 00000100:00100000:3.0:1746066755.307303:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:604:x1830882983194880:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 203us (332us total) trans 8589936603 rc 0/0 00000100:00100000:3.0:1746066755.307309:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5933 00000100:00100000:2.0:1746066755.307444:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4207 00000100:00100000:2.0:1746066755.307450:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983194624:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066755.307564:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4208 00000100:00100000:1.0:1746066755.307579:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983195008:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066755.314427:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983195008:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6843us (7404us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066755.314441:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4208 00002000:00100000:1.0:1746066755.314453:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009d9b1500 x1830882983195008/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.314463:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1500 with x1830882983195008 ext(3145728->4194303) 00002000:00010000:1.0:1746066755.314469:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1500 00000100:00100000:0.0:1746066755.325729:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983194624:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 18266us (19029us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746066755.326099:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4207 00002000:00100000:0.0:1746066755.326113:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009d9b0700 x1830882983194624/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066755.326123:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882983194624 ext(2097152->4194303) 00002000:00010000:0.0:1746066755.326129:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:0.0:1746066755.332379:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.332488:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983195136 00000100:00100000:2.0:1746066755.332498:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983195136 00000100:00100000:2.0:1746066755.332561:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15907 00000100:00100000:2.0:1746066755.332568:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983195136:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.332588:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.332606:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfa6ee0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d167f expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.332657:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984440704:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.332750:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.335208:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984440704:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066755.335246:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfa6ee0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d167f expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.335259:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fadc00/0xf1867c21abfa6ee0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d167f expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.335285:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:2.0:1746066755.335405:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983195136:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2835us (3033us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.335414:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15907 00000100:00100000:0.0:1746066755.339108:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.339179:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983195392 00000100:00100000:2.0:1746066755.339189:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983195392 00002000:00100000:2.0:1746066755.339236:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012b164a80 x1830882983195392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.339247:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164a80 with x1830882983195392 ext(4194304->5033983) 00002000:00010000:2.0:1746066755.339252:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b164a80 00000100:00100000:2.0:1746066755.339283:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4209 00000100:00100000:2.0:1746066755.339292:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882983195392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066755.344454:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2014:x1830882983195392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5151us (5344us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066755.344467:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4209 00002000:00100000:2.0:1746066755.344480:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012b164a80 x1830882983195392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.344489:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164a80 with x1830882983195392 ext(4194304->5033983) 00002000:00010000:2.0:1746066755.344496:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b164a80 00000100:00100000:0.0:1746066755.349182:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.349418:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983195520 00000100:00100000:2.0:1746066755.349428:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983195520 00000100:00100000:2.0:1746066755.349488:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15908 00000100:00100000:2.0:1746066755.349496:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983195520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.349525:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.349543:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa6ee7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1686 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.349600:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984440832:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.351174:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.352290:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984440832:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066755.352328:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa6ee7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1686 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.352343:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa6ee7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1686 expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.352368:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac800, rc 0) 00000100:00100000:2.0:1746066755.352422:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983195520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2924us (3248us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.352431:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15908 00000100:00100000:0.0:1746066755.354561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.354713:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983195648 00000100:00100000:2.0:1746066755.354723:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983195648 00000100:00100000:2.0:1746066755.354776:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15909 00000100:00100000:2.0:1746066755.354784:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983195648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.354807:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.354823:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfa6eee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d168d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.354875:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984440960:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.355000:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.358677:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984440960:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066755.358713:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfa6eee lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d168d expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.358728:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad800/0xf1867c21abfa6eee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d168d expref: 35 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.358754:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad800, rc 0) 00000100:00100000:2.0:1746066755.359072:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983195648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4286us (4514us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.359080:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15909 00000100:00100000:0.0:1746066755.413174:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.413292:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983195904 00000100:00100000:2.0:1746066755.413302:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983195904 00000100:00100000:2.0:1746066755.413369:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16275 00000100:00100000:2.0:1746066755.413379:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:613:x1830882983195904:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.413405:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.413426:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6ef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1694 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.413526:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413540:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413552:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413567:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413572:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413577:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413685:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6f0a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413695:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413701:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6f0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.413711:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066755.413806:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413813:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413820:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413828:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413835:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fade00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.413840:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413847:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413859:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.413862:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.413866:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.413871:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414117:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414124:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414128:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414133:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.414136:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414141:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414149:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34e400) 00010000:00010000:2.0:1746066755.414151:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.414153:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414158:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.414204:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6ef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1694 expref: 37 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.414216:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6f0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1694 expref: 36 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.414223:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.414225:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066755.414228:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad200, rc 0) 00000100:00100000:2.0:1746066755.414454:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+36:613:x1830882983195904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1075us (1293us total) trans 8589936604 rc 0/0 00000100:00100000:2.0:1746066755.414461:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16275 00000100:00100000:0.0:1746066755.416747:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.417110:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.417573:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983196288 00000100:00100000:3.0:1746066755.417582:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983196288 00000100:00100000:2.0:1746066755.417719:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983196160 00000100:00100000:2.0:1746066755.417724:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983196160 00000100:00100000:2.0:1746066755.417759:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5934 00000100:00100000:2.0:1746066755.417766:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+37:613:x1830882983196160:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066755.418102:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 783 00000100:00100000:3.0:1746066755.418109:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+38:2015:x1830882983196288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.418119:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.418143:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6f0a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1694 expref: 38 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.418324:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+37:613:x1830882983196160:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 557us (1583us total) trans 8589936605 rc 0/0 00000100:00100000:2.0:1746066755.418331:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5934 00010000:00010000:3.0:1746066755.418552:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.418557:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.418590:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983196288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 481us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.418595:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 783 00000100:00100000:0.0:1746066755.428081:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.428191:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983196544 00000100:00100000:2.0:1746066755.428202:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983196544 00000100:00100000:2.0:1746066755.428698:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16276 00000100:00100000:2.0:1746066755.428706:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134cd4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:615:x1830882983196544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.428732:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.428753:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d169b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.428828:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.428841:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.428850:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.428860:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.428865:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.428870:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.428999:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6f2d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429011:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6f2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429017:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6f2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.429025:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066755.429095:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429100:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429105:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429110:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429116:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fada00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.429119:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429125:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429135:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.429138:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.429142:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429146:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429171:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429176:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429180:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429184:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.429186:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429190:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429195:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34eb00) 00010000:00010000:2.0:1746066755.429197:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.429199:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429203:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.429237:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d169b expref: 54 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.429248:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6f2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d169b expref: 53 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.429254:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.429257:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066755.429259:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fade00, rc 0) 00000100:00100000:2.0:1746066755.429310:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134cd4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+53:615:x1830882983196544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 605us (1241us total) trans 8589936606 rc 0/0 00000100:00100000:2.0:1746066755.429316:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16276 00000100:00100000:0.0:1746066755.431868:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.432072:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983196672 00000100:00100000:3.0:1746066755.432081:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983196672 00000100:00100000:3.0:1746066755.432133:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 784 00000100:00100000:3.0:1746066755.432140:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+53:2013:x1830882983196672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.432154:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.432176:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fade00/0xf1867c21abfa6f2d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d169b expref: 53 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.432204:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.432208:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.432246:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+52:2013:x1830882983196672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.432252:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 784 00000100:00100000:0.0:1746066755.464071:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.464334:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983196800 00000100:00100000:2.0:1746066755.464345:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983196800 00000100:00100000:2.0:1746066755.464402:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16277 00000100:00100000:2.0:1746066755.464410:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:616:x1830882983196800:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066755.464437:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.464455:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16a2 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.464540:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464553:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464562:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464573:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464577:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464582:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464643:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464654:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 35 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.464660:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.464688:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 35 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.464699:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 35 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.464712:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984441088:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.466247:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.467657:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.467730:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983196928 00000100:00100000:1.0:1746066755.467738:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983196928 00010000:00010000:1.0:1746066755.467776:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 36 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066755.467814:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7147 00000100:00100000:1.0:1746066755.467820:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983196928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.467832:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.467837:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 36 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.467847:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 36 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:1.0:1746066755.467868:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066755.467872:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.467902:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.467909:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.467926:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.467965:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983196928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 144us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.467970:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7147 00010000:00010000:2.0:1746066755.468056:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009848a200/0xf1867c21abfa6d97 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15e5 expref: 35 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.468075:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984441088:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.468091:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468126:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468132:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066755.468184:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:2.0:1746066755.468189:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066755.468207:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468219:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468232:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468238:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468243:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468249:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468254:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fada00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.468258:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468266:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468276:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066755.468278:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.468282:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468287:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fada00/0xf1867c21abfa6f42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468298:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468306:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468310:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468314:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.468316:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468320:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468326:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34eb00) 00010000:00010000:2.0:1746066755.468328:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066755.468330:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468334:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac000/0xf1867c21abfa6f49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.468374:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa6f3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.468387:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.468393:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.468395:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066755.468397:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac800, rc 0) 00000100:00100000:2.0:1746066755.468433:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:616:x1830882983196800:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4022us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.468439:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16277 00000100:00100000:0.0:1746066755.472445:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.472520:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.472569:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.472597:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.472636:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.472676:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.472730:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983197056 00000100:00100000:0.0:1746066755.472741:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983197056 00000100:00100000:0.0:1746066755.472789:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983197184 00000100:00100000:0.0:1746066755.472793:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983197184 00000100:00100000:0.0:1746066755.472814:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983197312 00000100:00100000:0.0:1746066755.472817:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983197312 00000100:00100000:0.0:1746066755.472832:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983197440 00000100:00100000:0.0:1746066755.472834:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983197440 00000100:00100000:0.0:1746066755.472847:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983197568 00000100:00100000:0.0:1746066755.472849:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983197568 00000100:00100000:0.0:1746066755.472873:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983197696 00000100:00100000:0.0:1746066755.472876:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983197696 00000100:00100000:0.0:1746066755.472941:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15910 00000100:00100000:0.0:1746066755.472952:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882983197056:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.472976:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.473000:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa6f57 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16a9 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.473063:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984441216:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.473156:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.473176:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15911 00000100:00100000:0.0:1746066755.473181:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2013:x1830882983197184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.473189:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.473198:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa6f5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16b0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.473221:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984441344:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.473240:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1bc1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.473253:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15912 00000100:00100000:0.0:1746066755.473257:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983197312:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.473262:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.473269:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16b7 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.473280:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473282:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473290:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473303:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473312:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36200, rc 0) 00000100:00100000:0.0:1746066755.473332:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983197312:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 74us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.473337:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15912 00000100:00100000:0.0:1746066755.473358:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15913 00000100:00100000:0.0:1746066755.473362:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882983197440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.473367:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.473373:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16be expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.473381:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473382:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473386:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473395:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473406:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37a00, rc 0) 00000100:00100000:0.0:1746066755.473420:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882983197440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 57us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.473425:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15913 00000100:00100000:0.0:1746066755.473435:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15914 00000100:00100000:0.0:1746066755.473439:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882983197568:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.473445:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.473451:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16c5 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.473459:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473461:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473464:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473471:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 17 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473476:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37e00, rc 0) 00000100:00100000:0.0:1746066755.473487:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2013:x1830882983197568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 48us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.473492:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15914 00000100:00100000:0.0:1746066755.473511:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15915 00000100:00100000:0.0:1746066755.473516:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983197696:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.473523:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.473529:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16cc expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.473538:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473539:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.473542:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473550:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.473556:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37600, rc 0) 00000100:00100000:0.0:1746066755.473569:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983197696:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 54us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.473574:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15915 00000100:00100000:0.0:1746066755.474966:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984441344:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066755.474993:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa6f5e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b0 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.475003:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa6f5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b0 expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.475016:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36400, rc 0) 00000100:00100000:0.0:1746066755.475041:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2013:x1830882983197184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1859us (2522us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066755.475051:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15911 00000100:00100000:1.0:1746066755.475382:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984441216:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066755.475399:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa6f57 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a9 expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.475408:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa6f57 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a9 expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.475420:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36a00, rc 0) 00000100:00100000:1.0:1746066755.475440:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882983197056:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2491us (3009us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066755.475446:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15910 00000100:00100000:2.0:1746066755.481579:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.481647:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983197952 00000100:00100000:0.0:1746066755.481657:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983197952 00000100:00100000:0.0:1746066755.481806:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16278 00000100:00100000:0.0:1746066755.481816:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:616:x1830882983197952:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.481835:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.481852:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa6f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16d3 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.481963:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066755.481976:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.481985:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.482061:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.482075:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 11 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066755.482085:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984441472:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066755.482174:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.483092:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984441472:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066755.483109:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066755.484446:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.484521:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983198080 00000100:00100000:3.0:1746066755.484532:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983198080 00010000:00010000:3.0:1746066755.484569:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.484609:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7148 00000100:00100000:3.0:1746066755.484616:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983198080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.484632:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.484638:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.484649:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.484670:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa6f50 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16a2 expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.484708:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.484713:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066755.485059:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066755.485067:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066755.485100:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066755.485119:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066755.485126:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066755.485142:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000100:00100000:3.0:1746066755.485144:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983198080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 528us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.485151:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7148 00010000:00010000:0.0:1746066755.485238:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37400/0xf1867c21abfa6f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.485371:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.485379:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066755.485382:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066755.485385:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36600, rc 0) 00000100:00100000:1.0:1746066755.485475:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:616:x1830882983197952:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3659us (3906us total) trans 8589936607 rc 0/0 00000100:00100000:1.0:1746066755.485483:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16278 00000100:00100000:0.0:1746066755.488762:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.488839:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983198208 00000100:00100000:1.0:1746066755.488847:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983198208 00000100:00100000:1.0:1746066755.489142:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16279 00000100:00100000:1.0:1746066755.489150:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:616:x1830882983198208:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066755.489168:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066755.489183:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa6f96 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16da expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.489255:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.489268:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.489274:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.489297:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.489308:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066755.489318:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984441600:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066755.489389:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.494613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.494689:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.494703:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983198592 00000100:00100000:3.0:1746066755.494715:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983198592 00000100:00100000:0.0:1746066755.494732:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983198336 00000100:00100000:0.0:1746066755.494739:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983198336 00010000:00010000:0.0:1746066755.494769:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 13 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.494774:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16280 00000100:00100000:3.0:1746066755.494783:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+35:619:x1830882983198592:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066755.494792:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7149 00000100:00100000:0.0:1746066755.494798:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983198336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066755.494808:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.494811:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.494812:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 13 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.494822:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 13 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.494834:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa6fa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16e1 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.494839:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066755.494843:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066755.494850:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066755.494861:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066755.494877:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066755.494959:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066755.494967:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983198336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 169us (277us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066755.494974:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066755.494974:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7149 00010000:00010000:3.0:1746066755.494985:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495000:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495006:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495012:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066755.495044:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36600/0xf1867c21abfa6f88 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16d3 expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746066755.495059:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984441600:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066755.495072:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066755.495079:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066755.495084:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066755.495125:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:0.0:1746066755.495128:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1746066755.495134:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00000004:00010000:0.0:1746066755.495140:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066755.495145:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495152:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066755.495166:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066755.495167:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa6f96 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.495177:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.495183:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066755.495186:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746066755.495188:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729c00, rc 0) 00010000:00010000:3.0:1746066755.495251:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495259:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495264:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495270:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495275:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ce1800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066755.495279:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.495286:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00000100:00100000:1.0:1746066755.495789:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:616:x1830882983198208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6637us (7032us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.495795:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16279 00000100:00100000:1.0:1746066755.497091:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.497143:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.497284:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983198848 00000100:00100000:0.0:1746066755.497289:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983198848 00000100:00100000:0.0:1746066755.497312:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983198720 00000100:00100000:0.0:1746066755.497314:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983198720 00000100:00100000:0.0:1746066755.497341:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15916 00000100:00100000:0.0:1746066755.497347:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2013:x1830882983198848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.497359:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.497372:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa6fc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16ef expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.497385:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15917 00000100:00100000:2.0:1746066755.497393:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882983198720:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066755.497400:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.497408:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfa6fce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16e8 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.497409:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984441728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.497432:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984441856:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.497453:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.497454:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.499337:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984441728:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.499354:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984441856:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066755.499361:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa6fc7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16ef expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.499369:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfa6fce lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e8 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.499371:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36400/0xf1867c21abfa6fc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16ef expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.499377:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fade00/0xf1867c21abfa6fce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e8 expref: 16 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.499388:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36400, rc 0) 00010000:00010000:2.0:1746066755.499389:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fade00, rc 0) 00000100:00100000:2.0:1746066755.499415:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882983198720:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2023us (2271us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066755.499418:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2013:x1830882983198848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2071us (2329us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.499421:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15917 00000100:00100000:1.0:1746066755.499428:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15916 00010000:00010000:3.0:1746066755.499740:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066755.499747:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066755.499756:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499764:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1800/0xf1867c21abfa6fab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499793:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499801:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499810:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499815:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097ce0000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066755.499820:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499826:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499836:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5e80500) 00010000:00010000:3.0:1746066755.499838:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066755.499840:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499845:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa6fb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.499949:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa6fa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 38 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.499964:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 37 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.499971:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.499972:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066755.499975:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce1a00, rc 0) 00000100:00100000:3.0:1746066755.500057:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+37:619:x1830882983198592:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5271us (5448us total) trans 8589936608 rc 0/0 00000100:00100000:3.0:1746066755.500065:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16280 00000100:00100000:0.0:1746066755.502954:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.503080:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983199104 00000100:00100000:2.0:1746066755.503090:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983199104 00000100:00100000:2.0:1746066755.503152:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5935 00000100:00100000:2.0:1746066755.503160:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+37:619:x1830882983199104:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:2.0:1746066755.503344:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+38:619:x1830882983199104:12345-192.168.204.16@tcp:35:cat.0 Request processed in 184us (400us total) trans 8589936609 rc 0/0 00000100:00100000:2.0:1746066755.503351:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5935 00000100:00100000:0.0:1746066755.503801:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.503948:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983199360 00000100:00100000:2.0:1746066755.503952:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983199360 00000100:00100000:2.0:1746066755.503976:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16281 00000100:00100000:2.0:1746066755.503981:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:616:x1830882983199360:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066755.503990:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.504004:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa6fd5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16f6 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.504059:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504071:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504080:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504090:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504096:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504100:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504105:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066755.504108:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504114:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504122:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.504124:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066755.504129:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504133:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad200/0xf1867c21abfa6fdc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.504152:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa6fd5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16f6 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.504159:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa6fd5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16f6 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.504165:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:2.0:1746066755.504200:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:616:x1830882983199360:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 218us (399us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.504205:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16281 00000100:00100000:1.0:1746066755.507099:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.507139:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983199488 00000100:00100000:0.0:1746066755.507144:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983199488 00000100:00100000:0.0:1746066755.507167:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15918 00000100:00100000:0.0:1746066755.507172:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:613:x1830882983199488:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066755.507181:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.507240:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d16fd expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.507259:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.507263:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066755.507265:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066755.507267:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.507285:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 39 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.507292:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 39 pid: 12255 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746066755.507299:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984441984:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066755.507343:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.507471:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.507513:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.507519:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983199616 00000100:00100000:2.0:1746066755.507523:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983199616 00000100:00100000:0.0:1746066755.507530:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983199744 00000100:00100000:0.0:1746066755.507533:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983199744 00000100:00100000:2.0:1746066755.507570:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15919 00000100:00100000:0.0:1746066755.507863:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15920 00000100:00100000:2.0:1746066755.507866:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983199616:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066755.507870:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882983199744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.507873:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.507877:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.507880:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fad600/0xf1867c21abfa6fea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1704 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.507901:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d170b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.507913:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.507914:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.507920:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 22 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.507929:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 22 pid: 9592 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066755.507939:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984442112:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066755.507940:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37c00, rc 0) 00000100:00100000:0.0:1746066755.507960:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983199744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 91us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.507965:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15920 00000100:00100000:2.0:1746066755.508276:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.508388:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.508424:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983200000 00000100:00100000:3.0:1746066755.508434:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983200000 00000100:00100000:3.0:1746066755.508488:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5936 00000100:00100000:3.0:1746066755.508495:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:616:x1830882983200000:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066755.508702:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:616:x1830882983200000:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 207us (314us total) trans 8589936610 rc 0/0 00000100:00100000:3.0:1746066755.508709:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5936 00000100:00100000:0.0:1746066755.513260:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.513317:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984441984:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.513337:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 28 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.513349:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36000, rc 0) 00000100:00100000:2.0:1746066755.513378:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:613:x1830882983199488:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6206us (6285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.513384:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15918 00000100:00100000:2.0:1746066755.513409:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983200128 00000100:00100000:2.0:1746066755.513413:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983200128 00002000:00100000:2.0:1746066755.513436:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (200704->630783) req@ffff880095ce1c00 x1830882983200128/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.513441:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1c00 with x1830882983200128 ext(200704->630783) 00010000:00010000:2.0:1746066755.513446:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 40 pid: 12255 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.513453:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 40 pid: 12255 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.513458:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1c00 00000100:00100000:2.0:1746066755.513478:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 934 00000100:00100000:2.0:1746066755.513482:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:2015:x1830882983200128:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066755.513599:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984442112:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.513619:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fad600/0xf1867c21abfa6fea lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1704 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.513627:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fad600/0xf1867c21abfa6fea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1704 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.513636:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad600, rc 0) 00000100:00100000:3.0:1746066755.513653:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882983199616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5790us (6183us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066755.513659:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15919 00010000:00010000:2.0:1746066755.513964:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066755.515368:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.515415:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983200256 00000100:00100000:3.0:1746066755.515420:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983200256 00000100:00100000:3.0:1746066755.515456:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15921 00000100:00100000:3.0:1746066755.515462:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:619:x1830882983200256:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066755.515472:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.515483:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1712 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.515516:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066755.515521:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.515527:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066755.515531:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.515558:0:9590:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.515568:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.515576:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce1400, rc 0) 00000100:00100000:3.0:1746066755.515619:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:619:x1830882983200256:12345-192.168.204.16@tcp:101:cat.0 Request processed in 157us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.515625:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15921 00000100:00100000:2.0:1746066755.516475:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983200128:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2989us (3219us total) trans 21474841859 rc 0/0 00000100:00100000:2.0:1746066755.516484:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 934 00002000:00100000:2.0:1746066755.516491:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (200704->630783) req@ffff880095ce1c00 x1830882983200128/t21474841859(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.516513:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1c00 with x1830882983200128 ext(200704->630783) 00010000:00010000:2.0:1746066755.516519:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 42 pid: 12255 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.516531:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 42 pid: 12255 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.516538:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1c00 00000100:00100000:0.0:1746066755.524084:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.524596:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983200384 00000100:00100000:2.0:1746066755.524608:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983200384 00010000:00010000:2.0:1746066755.524652:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 42 pid: 12255 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.524727:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7150 00000100:00100000:2.0:1746066755.524735:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983200384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.524750:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.524772:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 42 pid: 12255 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.524789:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 42 pid: 12255 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.524814:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3800/0xf1867c21abfa6ecb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 200704->630783) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d166a expref: 42 pid: 12255 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.525456:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.525459:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.525469:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.525476:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.525524:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 26 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.525533:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 26 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.525543:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984442368:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066755.525630:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.529172:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.529277:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983200640 00000100:00100000:3.0:1746066755.529287:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983200640 00002000:00100000:3.0:1746066755.529342:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (770048->774143) req@ffff880095ce1f80 x1830882983200640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.529352:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1f80 with x1830882983200640 ext(770048->774143) 00010000:00010000:3.0:1746066755.529364:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.529374:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984442368:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066755.529390:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.529395:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746066755.529396:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1f80 00000100:00100000:3.0:1746066755.529427:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 935 00000100:00100000:3.0:1746066755.529436:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882983200640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066755.529452:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983200384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4717us (5382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.529463:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7150 00000100:00100000:3.0:1746066755.529577:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882983200640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 141us (417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066755.529583:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 935 00002000:00100000:3.0:1746066755.529588:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (770048->774143) req@ffff880095ce1f80 x1830882983200640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.529595:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1f80 with x1830882983200640 ext(770048->774143) 00010000:00010000:3.0:1746066755.529599:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.529608:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066755.529614:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1f80 00000100:00100000:0.0:1746066755.533954:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.534012:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983200896 00000100:00100000:3.0:1746066755.534023:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983200896 00002000:00100000:3.0:1746066755.534073:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (770048->1048575) req@ffff880095ce2300 x1830882983200896/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.534083:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2300 with x1830882983200896 ext(770048->1048575) 00010000:00010000:3.0:1746066755.534092:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.534107:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 27 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066755.534114:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce2300 00000100:00100000:3.0:1746066755.534151:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 936 00000100:00100000:3.0:1746066755.534158:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983200896:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066755.536814:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.536897:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983201152 00000100:00100000:2.0:1746066755.536906:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983201152 00002000:00100000:2.0:1746066755.536947:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1523712->1527807) req@ffff880096427800 x1830882983201152/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.536956:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096427800 with x1830882983201152 ext(1523712->1527807) 00002000:00010000:2.0:1746066755.536961:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096427800 00000100:00100000:2.0:1746066755.536981:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4210 00000100:00100000:2.0:1746066755.536987:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983201152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066755.537118:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983201152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 130us (311us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066755.537124:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4210 00002000:00100000:2.0:1746066755.537130:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1523712->1527807) req@ffff880096427800 x1830882983201152/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.537138:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096427800 with x1830882983201152 ext(1523712->1527807) 00002000:00010000:2.0:1746066755.537140:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096427800 00000100:00100000:3.0:1746066755.538185:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983200896:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4024us (4239us total) trans 21474841860 rc 0/0 00000100:00100000:3.0:1746066755.538194:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 936 00002000:00100000:3.0:1746066755.538201:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (770048->1048575) req@ffff880095ce2300 x1830882983200896/t21474841860(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.538209:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2300 with x1830882983200896 ext(770048->1048575) 00010000:00010000:3.0:1746066755.538221:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 29 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.538235:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 29 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066755.538242:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce2300 00000100:00100000:0.0:1746066755.540253:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.540435:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983201408 00000100:00100000:3.0:1746066755.540443:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983201408 00000100:00100000:3.0:1746066755.540507:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5937 00000100:00100000:3.0:1746066755.540514:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+38:613:x1830882983201408:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066755.540677:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+39:613:x1830882983201408:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 164us (432us total) trans 8589936611 rc 0/0 00000100:00100000:3.0:1746066755.540683:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5937 00000100:00100000:0.0:1746066755.541108:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.541247:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983201536 00000100:00100000:2.0:1746066755.541251:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983201536 00010000:00010000:2.0:1746066755.541270:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 29 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.541299:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7151 00000100:00100000:2.0:1746066755.541304:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882983201536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.541314:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.541328:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 29 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.541338:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 29 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.541356:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36000/0xf1867c21abfa6fe3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16fd expref: 29 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.541372:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.541374:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.541380:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.541387:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.541412:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 28 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.541422:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984442496:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066755.541472:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.545785:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984442496:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.545804:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.545846:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983201536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4541us (4738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.545855:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7151 00000100:00100000:0.0:1746066755.547389:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.547437:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983201792 00000100:00100000:3.0:1746066755.547445:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983201792 00002000:00100000:3.0:1746066755.547490:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012c491f80 x1830882983201792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.547510:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491f80 with x1830882983201792 ext(0->1048575) 00002000:00010000:3.0:1746066755.547515:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491f80 00000100:00100000:3.0:1746066755.547542:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4211 00000100:00100000:3.0:1746066755.547549:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983201792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066755.550459:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.550556:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983202048 00000100:00100000:2.0:1746066755.550565:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983202048 00002000:00100000:2.0:1746066755.550608:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1527808->2097151) req@ffff88012c490700 x1830882983202048/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.550619:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882983202048 ext(1527808->2097151) 00002000:00010000:2.0:1746066755.550625:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:2.0:1746066755.550643:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4212 00000100:00100000:2.0:1746066755.550651:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983202048:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066755.558470:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983201792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10908us (11075us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066755.558487:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4211 00002000:00100000:3.0:1746066755.558508:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012c491f80 x1830882983201792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.558516:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491f80 with x1830882983201792 ext(0->1048575) 00002000:00010000:3.0:1746066755.558522:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491f80 00000100:00100000:2.0:1746066755.563340:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983202048:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12677us (12879us total) trans 0 rc 569344/569344 00000100:00100000:2.0:1746066755.563354:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4212 00002000:00100000:2.0:1746066755.563367:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1527808->2097151) req@ffff88012c490700 x1830882983202048/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 569344/569344 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.563377:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490700 with x1830882983202048 ext(1527808->2097151) 00002000:00010000:2.0:1746066755.563384:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c490700 00000100:00100000:0.0:1746066755.574847:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.574995:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983202304 00000100:00100000:2.0:1746066755.575005:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983202304 00002000:00100000:2.0:1746066755.575052:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012c490000 x1830882983202304/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.575061:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490000 with x1830882983202304 ext(2097152->4194303) 00002000:00010000:2.0:1746066755.575068:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c490000 00000100:00100000:2.0:1746066755.575099:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4213 00000100:00100000:2.0:1746066755.575106:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983202304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066755.583591:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.583697:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.583940:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983202688 00000100:00100000:2.0:1746066755.583949:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983202688 00000100:00100000:2.0:1746066755.584409:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15922 00000100:00100000:2.0:1746066755.584419:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:615:x1830882983202688:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:3.0:1746066755.584431:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983202560 00000100:00100000:3.0:1746066755.584436:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983202560 00010000:00010000:2.0:1746066755.584437:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.584454:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1720 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.584477:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16282 00000100:00100000:3.0:1746066755.584484:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+52:624:x1830882983202560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.584486:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 23 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.584493:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.584495:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066755.584508:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.584508:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1138688->2097151] (req 1138688->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.584520:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa7006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1719 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.584537:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 23 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.584547:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 23 pid: 12237 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.584558:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984442624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.584596:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584607:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584617:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:2.0:1746066755.584625:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746066755.584629:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584634:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584640:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584734:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584744:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584750:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066755.584759:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066755.584835:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584842:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584851:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584856:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584861:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fac800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066755.584865:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584872:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584907:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066755.584910:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066755.584914:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584919:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fac800/0xf1867c21abfa700d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584934:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584938:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584943:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584947:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098fad600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066755.584949:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584957:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584963:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5e80900) 00010000:00010000:3.0:1746066755.584965:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066755.584966:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.584971:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fad600/0xf1867c21abfa7014 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.585005:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0000/0xf1867c21abfa7006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 55 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.585015:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 54 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.585020:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.585022:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066755.585025:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:3.0:1746066755.585054:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a932635-1bad-46b9-b237-470f1d1c8595+54:624:x1830882983202560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 569us (1356us total) trans 8589936612 rc 0/0 00000100:00100000:3.0:1746066755.585060:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16282 00000100:00100000:2.0:1746066755.587417:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984442624:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.587447:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1138688->2097151] (req 1138688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.587468:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009db77000, rc 0) 00000100:00100000:2.0:1746066755.587537:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:615:x1830882983202688:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3116us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.587545:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15922 00000100:00100000:2.0:1746066755.587922:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983202304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12815us (13084us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066755.587931:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4213 00002000:00100000:2.0:1746066755.587938:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012c490000 x1830882983202304/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.587946:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490000 with x1830882983202304 ext(2097152->4194303) 00002000:00010000:2.0:1746066755.587951:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c490000 00000100:00100000:0.0:1746066755.588260:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.588285:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.588298:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983202816 00000100:00100000:2.0:1746066755.588304:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983202816 00002000:00100000:2.0:1746066755.588333:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1527807) req@ffff88012c490380 x1830882983202816/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.588339:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882983202816 ext(1048576->1527807) 00010000:00010000:2.0:1746066755.588345:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 22 pid: 12237 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.588357:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 22 pid: 12237 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.588363:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c490380 00000100:00100000:2.0:1746066755.588378:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 937 00000100:00100000:2.0:1746066755.588386:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983202816:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066755.588628:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983203072 00000100:00100000:3.0:1746066755.588632:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983203072 00000100:00100000:3.0:1746066755.589199:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5938 00000100:00100000:3.0:1746066755.589207:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+54:624:x1830882983203072:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066755.589385:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+55:624:x1830882983203072:12345-192.168.204.16@tcp:35:cat.0 Request processed in 179us (1097us total) trans 8589936613 rc 0/0 00000100:00100000:3.0:1746066755.589392:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5938 00000100:00100000:0.0:1746066755.593577:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.593769:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983203200 00000100:00100000:2.0:1746066755.593778:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983203200 00000100:00100000:2.0:1746066755.593828:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15923 00000100:00100000:2.0:1746066755.593837:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983203200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.593854:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.593871:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa7029 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1727 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.593941:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984442752:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.594577:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.595768:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.595809:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.595909:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983203328 00000100:00100000:0.0:1746066755.595915:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983203328 00000100:00100000:0.0:1746066755.595955:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983203456 00000100:00100000:0.0:1746066755.595958:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983203456 00000100:00100000:0.0:1746066755.595987:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15924 00000100:00100000:0.0:1746066755.595994:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983203328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066755.596008:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066755.596009:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15925 00000100:00100000:2.0:1746066755.596016:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983203456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.596025:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.596037:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfa7030 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1735 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.596070:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984442880:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.596139:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00010000:00010000:0.0:1746066755.596279:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d172e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.596295:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.596297:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.596306:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 42 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.596321:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 42 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.596330:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8800, rc 0) 00000100:00100000:0.0:1746066755.596357:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882983203328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 364us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.596363:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15924 00000100:00100000:3.0:1746066755.597338:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984442880:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.597354:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984442752:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.597360:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfa7030 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1735 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.597370:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa7029 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1727 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.597372:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356aa00/0xf1867c21abfa7030 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1735 expref: 36 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.597380:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356ba00/0xf1867c21abfa7029 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1727 expref: 27 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.597384:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356aa00, rc 0) 00000100:00100000:3.0:1746066755.597433:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983203456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1418us (1623us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066755.597439:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15925 00010000:00010000:2.0:1746066755.597507:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ba00, rc 0) 00000100:00100000:2.0:1746066755.597707:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983203200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3869us (4140us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.597713:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15923 00000100:00100000:2.0:1746066755.598731:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983202816:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10336us (10462us total) trans 17179874409 rc 0/0 00000100:00100000:2.0:1746066755.598747:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 937 00002000:00100000:2.0:1746066755.598758:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1527807) req@ffff88012c490380 x1830882983202816/t17179874409(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.598767:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882983202816 ext(1048576->1527807) 00010000:00010000:2.0:1746066755.598775:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 24 pid: 12237 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.598790:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 24 pid: 12237 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.598796:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c490380 00000100:00100000:0.0:1746066755.602714:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.602756:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.602782:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983203584 00000100:00100000:2.0:1746066755.602790:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983203584 00000100:00100000:0.0:1746066755.602795:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066755.602820:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 24 pid: 12237 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.602821:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983203712 00000100:00100000:3.0:1746066755.602830:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983203712 00000100:00100000:2.0:1746066755.602964:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7152 00000100:00100000:2.0:1746066755.602973:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983203584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.602988:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.603005:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 25 pid: 12237 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.603016:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 25 pid: 12237 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.603025:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15926 00000100:00100000:3.0:1746066755.603034:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983203712:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.603035:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0400/0xf1867c21abfa6ed9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1678 expref: 25 pid: 12237 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.603052:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.603055:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.603057:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.603064:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.603068:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fad600/0xf1867c21abfa703e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d173c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.603072:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.603103:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.603115:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984443008:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066755.603118:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443136:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.603259:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.603277:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983203968 00000100:00100000:2.0:1746066755.603281:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983203968 00000100:00100000:3.0:1746066755.603285:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746066755.603304:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098480380 x1830882983203968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.603318:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480380 with x1830882983203968 ext(0->1048575) 00002000:00010000:2.0:1746066755.604159:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098480380 00000100:00100000:2.0:1746066755.604172:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4214 00000100:00100000:2.0:1746066755.604177:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983203968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066755.607421:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.607483:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983204224 00000100:00100000:1.0:1746066755.607488:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983204224 00000100:00100000:0.0:1746066755.607506:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984443008:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066755.607523:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746066755.607533:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1138688->1142783) req@ffff880093ccd880 x1830882983204224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.607546:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd880 with x1830882983204224 ext(1138688->1142783) 00000100:00100000:0.0:1746066755.607553:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983203584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4582us (4851us total) trans 0 rc 0/0 00002000:00010000:1.0:1746066755.607554:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccd880 00000100:00100000:0.0:1746066755.607562:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7152 00000100:00100000:1.0:1746066755.607569:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4215 00000100:00100000:1.0:1746066755.607575:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983204224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066755.607630:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443136:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.607654:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fad600/0xf1867c21abfa703e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d173c expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.607665:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fad600/0xf1867c21abfa703e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d173c expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.607687:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fad600, rc 0) 00000100:00100000:1.0:1746066755.607720:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983204224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 145us (307us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066755.607726:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4215 00002000:00100000:1.0:1746066755.607732:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1138688->1142783) req@ffff880093ccd880 x1830882983204224/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066755.607739:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd880 with x1830882983204224 ext(1138688->1142783) 00002000:00010000:1.0:1746066755.607742:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccd880 00000100:00100000:3.0:1746066755.607764:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983203712:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4722us (4999us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066755.607774:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15926 00000100:00100000:2.0:1746066755.610595:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.610667:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983204352 00000100:00100000:3.0:1746066755.610677:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983204352 00000100:00100000:3.0:1746066755.610729:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15927 00000100:00100000:3.0:1746066755.610737:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983204352:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066755.610756:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.610774:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097ce0c00/0xf1867c21abfa7045 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1743 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.610797:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983203968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6618us (7999us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066755.610807:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4214 00002000:00100000:0.0:1746066755.610817:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098480380 x1830882983203968/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066755.610827:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098480380 with x1830882983203968 ext(0->1048575) 00000100:00100000:3.0:1746066755.610831:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443264:192.168.204.16@tcp:106: 00002000:00010000:0.0:1746066755.610832:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098480380 00000100:00100000:3.0:1746066755.610927:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.613578:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443264:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.613613:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097ce0c00/0xf1867c21abfa7045 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1743 expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.613625:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097ce0c00/0xf1867c21abfa7045 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1743 expref: 24 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.613651:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0c00, rc 0) 00000100:00100000:0.0:1746066755.613665:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.613695:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983204352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2959us (3110us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066755.613696:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983204608 00000100:00100000:3.0:1746066755.613702:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15927 00000100:00100000:0.0:1746066755.613702:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983204608 00002000:00100000:0.0:1746066755.613737:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1138687) req@ffff8801310f0700 x1830882983204608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066755.613746:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0700 with x1830882983204608 ext(1048576->1138687) 00002000:00010000:0.0:1746066755.613750:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0700 00000100:00100000:0.0:1746066755.613778:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4216 00000100:00100000:0.0:1746066755.613784:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983204608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066755.615634:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983204608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 1842us (1963us total) trans 0 rc 90112/90112 00000100:00100000:2.0:1746066755.615643:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4216 00002000:00100000:2.0:1746066755.615652:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1138687) req@ffff8801310f0700 x1830882983204608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 90112/90112 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.615660:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0700 with x1830882983204608 ext(1048576->1138687) 00002000:00010000:2.0:1746066755.615665:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0700 00000100:00100000:0.0:1746066755.624586:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.624697:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983204736 00000100:00100000:3.0:1746066755.624708:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983204736 00000100:00100000:3.0:1746066755.624772:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15928 00000100:00100000:3.0:1746066755.624780:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:615:x1830882983204736:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.624801:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.624819:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d174a expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.624862:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.624871:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.624878:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.624919:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.624921:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.624924:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.624964:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 22 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.624976:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 22 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746066755.624989:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443392:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.625084:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.625093:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 8 pid: 3528 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746066755.625100:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443520:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.625470:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.625478:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 36 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.625487:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443648:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.625514:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.626234:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443392:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.627144:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443520:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.627152:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984443648:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.627180:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 36 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.627196:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fac800, rc 0) 00000100:00100000:3.0:1746066755.627237:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:615:x1830882983204736:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2456us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.627245:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15928 00000100:00100000:0.0:1746066755.627536:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.627582:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.627634:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983204992 00000100:00100000:2.0:1746066755.627640:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983204992 00010000:00010000:2.0:1746066755.627663:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 23 pid: 9590 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066755.627687:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983204864 00000100:00100000:2.0:1746066755.627688:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983204864 00010000:00010000:2.0:1746066755.627694:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 9 pid: 3528 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066755.627703:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7153 00000100:00100000:2.0:1746066755.627708:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:2016:x1830882983204992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.627718:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.627731:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 23 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.627739:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 23 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.627755:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0cc00/0xf1867c21abfa6d2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1591 expref: 23 pid: 9590 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.627764:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.627780:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983204992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.627784:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7153 00000100:00100000:2.0:1746066755.627790:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7154 00000100:00100000:2.0:1746066755.627793:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983204864:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.627797:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.627800:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 9 pid: 3528 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.627806:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 9 pid: 3528 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.627812:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa36200/0xf1867c21abfa6f65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16b7 expref: 9 pid: 3528 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.627821:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.627828:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983204864:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.627832:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7154 00000100:00100000:1.0:1746066755.628316:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.628388:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983205120 00000100:00100000:0.0:1746066755.628392:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983205120 00010000:00010000:0.0:1746066755.628407:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 36 pid: 3528 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746066755.628429:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7155 00000100:00100000:0.0:1746066755.628433:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882983205120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066755.628439:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066755.628447:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 36 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.628459:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 36 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.628470:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095751800/0xf1867c21abfa6ca9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1560 expref: 36 pid: 3528 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.628481:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.628483:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.628489:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.628514:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.628539:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.628549:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984443776:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066755.628599:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.629693:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984443776:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.629710:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066755.629724:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.629903:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983205120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1443us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.629912:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7155 00000100:00100000:1.0:1746066755.629987:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983205376 00000100:00100000:1.0:1746066755.629992:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983205376 00000100:00100000:1.0:1746066755.630039:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5939 00000100:00100000:1.0:1746066755.630045:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+55:615:x1830882983205376:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066755.630252:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+56:615:x1830882983205376:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 207us (527us total) trans 8589936614 rc 0/0 00000100:00100000:1.0:1746066755.630259:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5939 00000100:00100000:0.0:1746066755.657063:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.657134:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983205632 00000100:00100000:3.0:1746066755.657145:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983205632 00000100:00100000:3.0:1746066755.657208:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16283 00000100:00100000:3.0:1746066755.657216:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+39:629:x1830882983205632:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.657243:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.657262:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa7053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1751 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.657369:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.657384:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.657391:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 40 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.657397:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 55 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.657405:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 6/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.657435:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 55 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.657446:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 55 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.657459:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984443904:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.658102:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 40 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.658111:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 40 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.658119:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984444032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.658146:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.658154:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 11 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.658161:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984444160:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.658179:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.660194:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984443904:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.660204:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984444032:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.660211:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984444160:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.660234:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066755.660677:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.660718:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.660789:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983205760 00000100:00100000:2.0:1746066755.660792:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983205888 00000100:00100000:3.0:1746066755.660794:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983205760 00000100:00100000:2.0:1746066755.660794:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983205888 00010000:00010000:3.0:1746066755.660820:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.660820:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 56 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.661016:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7156 00000100:00100000:3.0:1746066755.661023:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+56:2015:x1830882983205888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.661035:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.661041:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 56 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.661050:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 56 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.661069:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fadc00/0xf1867c21abfa701b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1719 expref: 56 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.661085:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.661090:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066755.661281:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.661300:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983206016 00000100:00100000:0.0:1746066755.661303:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983206016 00010000:00010000:0.0:1746066755.661316:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746066755.661329:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7157 00000100:00100000:0.0:1746066755.661334:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+41:2016:x1830882983205760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066755.661341:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066755.661344:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.661465:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7158 00000100:00100000:2.0:1746066755.661472:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983206016:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.661479:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.661483:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.661517:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.661526:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.661565:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+55:2015:x1830882983205888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 542us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.661570:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7156 00010000:00010000:0.0:1746066755.661618:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.661631:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce1a00/0xf1867c21abfa6fb9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16e1 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.661651:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066755.661654:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066755.661660:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:0.0:1746066755.661664:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066755.661682:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+40:2016:x1830882983205760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 348us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.661688:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7157 00010000:00010000:2.0:1746066755.661970:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.661983:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa6f9d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16da expref: 12 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.661998:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.662000:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.662007:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.662013:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.662195:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.662218:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983206016:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 746us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.662224:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7158 00010000:00010000:3.0:1746066755.662262:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.662269:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066755.662288:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066755.662412:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa7053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 41 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.662424:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 40 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.662430:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.662432:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066755.662434:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0400, rc 0) 00000100:00100000:3.0:1746066755.663020:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2051f12-252a-4bb3-b8f3-833317fca821+40:629:x1830882983205632:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5803us (5966us total) trans 8589936615 rc 0/0 00000100:00100000:3.0:1746066755.663026:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16283 00000100:00100000:0.0:1746066755.676818:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.676923:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983206144 00000100:00100000:3.0:1746066755.676933:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983206144 00000100:00100000:3.0:1746066755.676991:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15929 00000100:00100000:3.0:1746066755.677000:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:629:x1830882983206144:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.677019:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.677038:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1758 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.677071:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.677078:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066755.677080:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066755.677083:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.677111:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 34 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.677122:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 34 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.677134:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984444288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.677224:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.678392:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984444288:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.678415:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.678428:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a0000, rc 0) 00000100:00100000:3.0:1746066755.678466:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:629:x1830882983206144:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1467us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.678472:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15929 00000100:00100000:0.0:1746066755.679351:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.679923:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983206272 00000100:00100000:2.0:1746066755.679930:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983206272 00002000:00100000:2.0:1746066755.679966:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1138688->2097151) req@ffff8801310f1c00 x1830882983206272/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.679976:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1c00 with x1830882983206272 ext(1138688->2097151) 00010000:00010000:2.0:1746066755.679984:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 35 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.679996:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 35 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.680003:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801310f1c00 00000100:00100000:2.0:1746066755.680025:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 938 00000100:00100000:2.0:1746066755.680031:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2016:x1830882983206272:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066755.689053:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2016:x1830882983206272:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9010us (9693us total) trans 17179874410 rc 0/0 00000100:00100000:2.0:1746066755.689067:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 938 00002000:00100000:2.0:1746066755.689080:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1138688->2097151) req@ffff8801310f1c00 x1830882983206272/t17179874410(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.689090:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f1c00 with x1830882983206272 ext(1138688->2097151) 00010000:00010000:2.0:1746066755.689100:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 37 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.689116:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 37 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.689124:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801310f1c00 00000100:00100000:0.0:1746066755.693137:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.693235:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983206400 00000100:00100000:2.0:1746066755.693245:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983206400 00010000:00010000:2.0:1746066755.693284:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 37 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.693324:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7159 00000100:00100000:2.0:1746066755.693332:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983206400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.693349:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.693371:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 37 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.693383:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 37 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.693406:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77000/0xf1867c21abfa6fff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1138688->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1720 expref: 37 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.693426:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.693428:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.693434:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.693442:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.693474:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.693485:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984444416:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066755.693667:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.694733:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984444416:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.694754:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.694814:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882983206400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1481us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.694824:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7159 00000100:00100000:0.0:1746066755.695952:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.696048:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983206656 00000100:00100000:2.0:1746066755.696054:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983206656 00002000:00100000:2.0:1746066755.696093:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1990656->1994751) req@ffff8801310f0e00 x1830882983206656/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.696107:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0e00 with x1830882983206656 ext(1990656->1994751) 00002000:00010000:2.0:1746066755.696112:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0e00 00000100:00100000:2.0:1746066755.696128:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4217 00000100:00100000:2.0:1746066755.696135:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983206656:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066755.696260:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801310f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983206656:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 125us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066755.696266:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4217 00002000:00100000:2.0:1746066755.696271:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1990656->1994751) req@ffff8801310f0e00 x1830882983206656/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.696277:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801310f0e00 with x1830882983206656 ext(1990656->1994751) 00002000:00010000:2.0:1746066755.696280:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801310f0e00 00000100:00100000:0.0:1746066755.699137:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.699398:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983206784 00000100:00100000:3.0:1746066755.699406:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983206784 00000100:00100000:3.0:1746066755.699549:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15930 00000100:00100000:3.0:1746066755.699556:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:629:x1830882983206784:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.699574:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.699590:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d175f expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.699618:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.699626:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066755.699627:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066755.699631:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.699668:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 35 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.699680:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 35 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.699693:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984444544:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.699784:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.700629:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984444544:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.700644:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.700656:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1000, rc 0) 00000100:00100000:3.0:1746066755.700678:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:629:x1830882983206784:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1123us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.700684:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15930 00000100:00100000:0.0:1746066755.701067:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.701157:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983206912 00000100:00100000:2.0:1746066755.701161:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983206912 00002000:00100000:2.0:1746066755.701188:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1056767) req@ffff880095ce1880 x1830882983206912/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 8680/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.701198:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1880 with x1830882983206912 ext(1048576->1056767) 00010000:00010000:2.0:1746066755.701204:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 36 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.701215:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 36 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:2.0:1746066755.701220:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ce1880 00000100:00100000:2.0:1746066755.701244:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 939 00000100:00100000:2.0:1746066755.701250:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2016:x1830882983206912:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066755.701729:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2016:x1830882983206912:12345-192.168.204.16@tcp:4:cat.0 Request processed in 477us (661us total) trans 17179874411 rc 0/0 00000100:00100000:0.0:1746066755.701736:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 939 00002000:00100000:0.0:1746066755.701744:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1056767) req@ffff880095ce1880 x1830882983206912/t17179874411(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 8680/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066755.701751:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1880 with x1830882983206912 ext(1048576->1056767) 00010000:00010000:0.0:1746066755.701756:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 38 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.701764:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 38 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:0.0:1746066755.701770:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ce1880 00000100:00100000:0.0:1746066755.702954:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.702997:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983207040 00000100:00100000:2.0:1746066755.703001:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983207040 00010000:00010000:2.0:1746066755.703019:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 38 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.703041:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7160 00000100:00100000:2.0:1746066755.703047:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983207040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.703057:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066755.703068:0:8395:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066755 -> 1746066756 00002000:00010000:2.0:1746066755.703071:0:8395:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066755 -> 1746066756 00010000:00010000:2.0:1746066755.703075:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 38 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.703084:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 38 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.703105:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098fac800/0xf1867c21abfa704c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d174a expref: 38 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.703131:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.703133:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.703140:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.703146:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.703172:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.703180:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984444672:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066755.703238:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.704565:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984444672:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066755.704584:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.704648:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983207040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1599us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.704656:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7160 00000100:00100000:0.0:1746066755.705648:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.705760:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983207296 00000100:00100000:2.0:1746066755.705766:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983207296 00002000:00100000:2.0:1746066755.705801:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1277952->1282047) req@ffff88012ea25c00 x1830882983207296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.705811:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25c00 with x1830882983207296 ext(1277952->1282047) 00002000:00010000:2.0:1746066755.705816:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea25c00 00000100:00100000:2.0:1746066755.705832:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4218 00000100:00100000:2.0:1746066755.705838:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983207296:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066755.706153:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2016:x1830882983207296:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 306us (498us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066755.706164:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4218 00002000:00100000:2.0:1746066755.706176:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1277952->1282047) req@ffff88012ea25c00 x1830882983207296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.706191:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25c00 with x1830882983207296 ext(1277952->1282047) 00002000:00010000:2.0:1746066755.706196:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea25c00 00000100:00100000:1.0:1746066755.731259:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.731315:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983207424 00000100:00100000:3.0:1746066755.731328:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983207424 00000100:00100000:3.0:1746066755.731387:0:7243:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16284 00000100:00100000:3.0:1746066755.731394:0:7243:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:631:x1830882983207424:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066755.731416:0:7243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.731432:0:7243:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0600/0xf1867c21abfa7076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1766 expref: -99 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.731489:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731514:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731524:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731537:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731542:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731548:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731617:0:7243:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731627:0:7243:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 39 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.731634:0:7243:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.731665:0:7243:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 39 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.731678:0:7243:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 39 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.731690:0:7243:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984444800:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.731779:0:7243:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.733071:0:7243:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7243:1830882984444800:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.733091:0:7243:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000100:00100000:0.0:1746066755.733524:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.733584:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983207680 00000100:00100000:1.0:1746066755.733589:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983207680 00000100:00100000:1.0:1746066755.733636:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5940 00000100:00100000:1.0:1746066755.733643:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+40:16320:x1830882983207680:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066755.733847:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+41:16320:x1830882983207680:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 203us (323us total) trans 8589936616 rc 0/0 00000100:00100000:1.0:1746066755.733854:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5940 00000100:00100000:0.0:1746066755.735244:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.735458:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983207808 00000100:00100000:2.0:1746066755.735469:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983207808 00010000:00010000:2.0:1746066755.735519:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.735557:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7161 00000100:00100000:2.0:1746066755.735564:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+41:2016:x1830882983207808:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.735576:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.735581:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.735591:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.735609:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa705a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1751 expref: 41 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.735634:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.735637:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.735643:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.735648:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7243 initiator: MDT0 00010000:00010000:2.0:1746066755.735670:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.735706:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+40:2016:x1830882983207808:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 144us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.735710:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7161 00010000:00010000:3.0:1746066755.735715:0:7243:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735725:0:7243:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00000004:00200000:3.0:1746066755.735765:0:7243:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:3.0:1746066755.735770:0:7243:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066755.735841:0:7243:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735853:0:7243:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735863:0:7243:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735869:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735874:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735880:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735915:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a1a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066755.735919:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735926:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735936:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066755.735939:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066755.735942:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735946:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa707d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735971:0:7243:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735979:0:7243:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735984:0:7243:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735987:0:7243:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800958a1800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066755.735990:0:7243:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.735994:0:7243:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.736001:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5e80f00) 00010000:00010000:3.0:1746066755.736003:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066755.736005:0:7243:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.736009:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa7084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7243 initiator: MDT0 00010000:00010000:3.0:1746066755.736039:0:7243:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0600/0xf1867c21abfa7076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.736051:0:7243:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 12 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.736058:0:7243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.736060:0:7243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066755.736062:0:7243:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1e00, rc 0) 00000100:00100000:3.0:1746066755.736179:0:7243:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:631:x1830882983207424:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4784us (4926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.736186:0:7243:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16284 00000100:00100000:0.0:1746066755.738676:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.739045:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983207936 00000100:00100000:3.0:1746066755.739055:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983207936 00000100:00100000:0.0:1746066755.739263:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.739299:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.739314:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983208064 00000100:00100000:0.0:1746066755.739317:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983208064 00000100:00100000:0.0:1746066755.739347:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983208192 00000100:00100000:0.0:1746066755.739349:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983208192 00000100:00100000:0.0:1746066755.739374:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15931 00000100:00100000:0.0:1746066755.739381:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983208064:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.739399:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.739417:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c9200/0xf1867c21abfa7092 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1774 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.739470:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984444928:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.739553:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.739585:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.739599:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15932 00000100:00100000:1.0:1746066755.739615:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983208192:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066755.739627:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983208448 00010000:00010000:1.0:1746066755.739631:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066755.739636:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983208448 00010000:00010000:1.0:1746066755.739646:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5729a00/0xf1867c21abfa7099 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d177b expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746066755.739665:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1990655) req@ffff88012ea25f80 x1830882983208448/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.739673:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25f80 with x1830882983208448 ext(1048576->1990655) 00002000:00010000:2.0:1746066755.739677:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea25f80 00000100:00100000:1.0:1746066755.739687:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445056:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.739692:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4219 00000100:00100000:2.0:1746066755.739696:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983208448:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066755.739732:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.739804:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15933 00000100:00100000:3.0:1746066755.739810:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983207936:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066755.739818:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.739833:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d176d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.739847:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.739848:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.739856:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.739869:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 16 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.739879:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098fadc00, rc 0) 00000100:00100000:3.0:1746066755.740413:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983207936:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 601us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.740420:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15933 00000100:00100000:3.0:1746066755.741305:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.741323:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983208704 00000100:00100000:3.0:1746066755.741326:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983208704 00002000:00100000:3.0:1746066755.741349:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1282048->2097151) req@ffff8800a4d01880 x1830882983208704/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.741358:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01880 with x1830882983208704 ext(1282048->2097151) 00002000:00010000:3.0:1746066755.741363:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01880 00000100:00100000:3.0:1746066755.741390:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4220 00000100:00100000:0.0:1746066755.741428:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984444928:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066755.741452:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9200/0xf1867c21abfa7092 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1774 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.741464:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9200/0xf1867c21abfa7092 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1774 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.741477:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9200, rc 0) 00000100:00100000:0.0:1746066755.741513:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983208064:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2132us (2250us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066755.741520:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15931 00000100:00100000:3.0:1746066755.741578:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882983208704:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:1.0:1746066755.744695:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066755 -> 1746066756 00000100:00100000:1.0:1746066755.744721:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445056:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066755.744778:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5729a00/0xf1867c21abfa7099 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d177b expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.744791:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5729a00/0xf1867c21abfa7099 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d177b expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.744820:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729a00, rc 0) 00000100:00100000:1.0:1746066755.744866:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983208192:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5256us (5565us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066755.744874:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15932 00000100:00100000:2.0:1746066755.748982:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983208448:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9277us (9389us total) trans 0 rc 942080/942080 00000100:00100000:2.0:1746066755.748994:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4219 00002000:00100000:2.0:1746066755.749005:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1990655) req@ffff88012ea25f80 x1830882983208448/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.749014:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25f80 with x1830882983208448 ext(1048576->1990655) 00002000:00010000:2.0:1746066755.749019:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ea25f80 00000100:00100000:0.0:1746066755.750933:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.751165:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.751223:0:7243:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983208960 00000100:00100000:3.0:1746066755.751232:0:7243:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983208960 00000100:00100000:3.0:1746066755.751276:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983209216 00000100:00100000:3.0:1746066755.751278:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983209216 00000100:00100000:3.0:1746066755.751293:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16285 00000100:00100000:3.0:1746066755.751299:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:631:x1830882983208960:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066755.751320:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.751338:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa70a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1782 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.751434:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.751447:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.751454:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066755.751635:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16286 00000100:00100000:1.0:1746066755.751643:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+55:637:x1830882983209216:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066755.751655:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066755.751663:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa70b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1789 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.751702:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066755.751784:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 13 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.751798:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 13 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.751810:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984445184:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.751878:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882983208704:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10475us (10567us total) trans 0 rc 815104/815104 00000100:00100000:3.0:1746066755.751912:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.751914:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4220 00002000:00100000:2.0:1746066755.751924:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1282048->2097151) req@ffff8800a4d01880 x1830882983208704/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 815104/815104 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746066755.751937:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00002000:00100000:2.0:1746066755.751938:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01880 with x1830882983208704 ext(1282048->2097151) 00002000:00010000:2.0:1746066755.751943:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01880 00010000:00010000:1.0:1746066755.751945:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066755.753735:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984445184:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.753758:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066755.754198:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.754271:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983209344 00000100:00100000:2.0:1746066755.754281:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983209344 00010000:00010000:2.0:1746066755.754315:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 14 pid: 7243 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.754354:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7162 00000100:00100000:2.0:1746066755.754362:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983209344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.754374:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.754379:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 14 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.754389:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 14 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.754407:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1e00/0xf1867c21abfa708b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1766 expref: 14 pid: 7243 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.754435:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.754439:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.754449:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.754455:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.754464:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.754469:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.754473:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.754516:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066755.754524:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066755.754534:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1746066755.754546:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000100:00100000:2.0:1746066755.754575:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983209344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 213us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.754581:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7162 00010000:00010000:1.0:1746066755.754676:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa70b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 58 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.754692:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 57 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.754699:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066755.754702:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066755.754705:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729c00, rc 0) 00000100:00100000:1.0:1746066755.754742:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+57:637:x1830882983209216:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3099us (3575us total) trans 8589936617 rc 0/0 00010000:00010000:3.0:1746066755.754746:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066755.754753:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16286 00010000:00010000:3.0:1746066755.754754:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066755.754772:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066755.754861:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0400/0xf1867c21abfa70a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.754873:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.754879:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.754910:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066755.754913:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1a00, rc 0) 00000100:00100000:3.0:1746066755.754936:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:631:x1830882983208960:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3636us (4054us total) trans 8589936618 rc 0/0 00000100:00100000:3.0:1746066755.754943:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16285 00000100:00100000:0.0:1746066755.755450:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.755506:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.755693:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983209472 00000100:00100000:1.0:1746066755.755699:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983209472 00000100:00100000:1.0:1746066755.755737:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983209600 00000100:00100000:1.0:1746066755.755739:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983209600 00000100:00100000:1.0:1746066755.755761:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15934 00000100:00100000:1.0:1746066755.755767:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:2015:x1830882983209472:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066755.755780:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066755.755794:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5728200/0xf1867c21abfa70d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1790 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066755.755839:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445312:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.755904:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15935 00000100:00100000:0.0:1746066755.755912:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983209600:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066755.755913:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746066755.755919:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.755925:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8c00/0xf1867c21abfa70d8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1797 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.755950:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984445440:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.755971:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.757376:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.757432:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983209728 00000100:00100000:3.0:1746066755.757438:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983209728 00000100:00100000:3.0:1746066755.757769:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16287 00000100:00100000:3.0:1746066755.757776:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:631:x1830882983209728:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066755.757795:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.757812:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0600/0xf1867c21abfa70df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d179e expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.757903:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984445440:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066755.757933:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8c00/0xf1867c21abfa70d8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1797 expref: 40 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066755.757945:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8c00/0xf1867c21abfa70d8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1797 expref: 40 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.758080:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.758095:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.758101:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 56 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.758107:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.758141:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 56 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.758153:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 56 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.758164:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984445568:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066755.758181:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8c00, rc 0) 00000100:00100000:0.0:1746066755.758221:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983209600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2309us (2724us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066755.758229:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15935 00010000:00010000:3.0:1746066755.758240:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.758248:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 14 pid: 7244 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.758255:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984445696:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.758272:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.758580:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445312:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066755.758615:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728200/0xf1867c21abfa70d1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1790 expref: 38 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.758624:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728200/0xf1867c21abfa70d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1790 expref: 38 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.758631:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728200, rc 0) 00000100:00100000:1.0:1746066755.758656:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983209472:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2889us (3206us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066755.758663:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15934 00000100:00100000:3.0:1746066755.759632:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984445568:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066755.759750:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.759924:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983209856 00000100:00100000:2.0:1746066755.759931:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983209856 00010000:00010000:2.0:1746066755.759953:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 57 pid: 7245 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.759974:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7163 00000100:00100000:2.0:1746066755.759980:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+57:2016:x1830882983209856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.759989:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.759994:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 57 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.760004:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 57 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.760091:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa70bc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1789 expref: 57 pid: 7245 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.760113:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.760117:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.760125:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.760130:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.760135:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066755.760197:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+56:2016:x1830882983209856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 214us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.760206:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7163 00000100:00100000:3.0:1746066755.762227:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984445696:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066755.762258:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066755.762377:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.762492:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.762574:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983209984 00000100:00100000:2.0:1746066755.762581:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983209984 00010000:00010000:2.0:1746066755.762608:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 15 pid: 7244 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.762641:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7164 00000100:00100000:2.0:1746066755.762648:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983209984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066755.762660:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066755.762665:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 15 pid: 7244 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.762673:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 15 pid: 7244 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.762697:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1a00/0xf1867c21abfa70ae lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1782 expref: 15 pid: 7244 timeout: 823 lvb_type: 0 00010000:00010000:2.0:1746066755.762711:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066755.762715:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.762723:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.762730:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.762747:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.762826:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983210112 00000100:00100000:1.0:1746066755.762831:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983210112 00000100:00100000:1.0:1746066755.762866:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15936 00000100:00100000:1.0:1746066755.762871:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+37:639:x1830882983210112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066755.762913:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066755.762919:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983209984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 235us (507us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066755.762928:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17a5 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.762931:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7164 00010000:00010000:1.0:1746066755.762950:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.762957:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066755.762959:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066755.762962:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.763008:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.763014:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066755.763064:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:3.0:1746066755.763068:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066755.763083:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.763112:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a0600/0xf1867c21abfa70df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.763124:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.763130:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.763132:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066755.763134:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a1800, rc 0) 00010000:00010000:1.0:1746066755.763370:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.763458:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 23 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:1.0:1746066755.763473:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066755.763561:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.763684:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:631:x1830882983209728:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5907us (6312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.763691:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16287 00000100:00100000:1.0:1746066755.765407:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066755.765452:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 38 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.765472:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728a00, rc 0) 00000100:00100000:1.0:1746066755.765513:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+38:639:x1830882983210112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2641us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.765520:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15936 00000100:00100000:0.0:1746066755.765671:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.765825:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.765846:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983210240 00000100:00100000:2.0:1746066755.765852:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983210240 00000100:00100000:2.0:1746066755.765906:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15937 00000100:00100000:2.0:1746066755.765913:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983210240:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066755.765926:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.765938:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa70f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17ac expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066755.765979:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445952:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066755.766044:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.766145:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983210368 00000100:00100000:0.0:1746066755.766148:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983210368 00000100:00100000:0.0:1746066755.766174:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15938 00000100:00100000:0.0:1746066755.766179:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983210368:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.766185:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066755.766241:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.766274:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983210496 00000100:00100000:3.0:1746066755.766279:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983210496 00002000:00100000:3.0:1746066755.766306:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1990656->2097151) req@ffff88012b166a00 x1830882983210496/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.766314:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b166a00 with x1830882983210496 ext(1990656->2097151) 00010000:00010000:3.0:1746066755.766320:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 24 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.766331:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 24 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066755.766338:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b166a00 00000100:00100000:3.0:1746066755.766350:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 940 00000100:00100000:3.0:1746066755.766355:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983210496:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:0.0:1746066755.766754:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa70fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17b3 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.766781:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea26300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984446080:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066755.766812:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c4603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.766847:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.767315:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983210624 00000100:00100000:2.0:1746066755.767319:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983210624 00000100:00100000:2.0:1746066755.767342:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15939 00000100:00100000:2.0:1746066755.767347:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:637:x1830882983210624:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.767357:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.767368:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17ba expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.767386:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.767394:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 15 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.767401:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 43 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.767407:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.767409:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.767412:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2236416->2523135] (req 2236416->2523135) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 43 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.767432:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 43 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.767441:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 43 pid: 9592 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066755.767449:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984446208:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.767952:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 15 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.767961:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 15 pid: 3528 timeout: 823 lvb_type: 1 00000100:00100000:2.0:1746066755.767969:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984446336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066755.768122:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea26300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984446080:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066755.768141:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa70fb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17b3 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.768151:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c9e00/0xf1867c21abfa70fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17b3 expref: 11 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.768161:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9e00, rc 0) 00000100:00100000:1.0:1746066755.768179:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983210368:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2001us (2354us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066755.768185:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15938 00010000:00010000:2.0:1746066755.768638:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 27 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.768656:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 27 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:2.0:1746066755.768669:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984446464:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.768879:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.768967:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984445952:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066755.768995:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa70f4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ac expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.769005:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575be00/0xf1867c21abfa70f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ac expref: 9 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.769014:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575be00, rc 0) 00000100:00100000:2.0:1746066755.769041:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983210240:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3128us (3370us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066755.769051:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15937 00000100:00100000:3.0:1746066755.769282:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983210496:12345-192.168.204.16@tcp:4:cat.0 Request processed in 2923us (3037us total) trans 17179874412 rc 0/0 00000100:00100000:3.0:1746066755.769291:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 940 00002000:00100000:3.0:1746066755.769298:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1990656->2097151) req@ffff88012b166a00 x1830882983210496/t17179874412(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.769306:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b166a00 with x1830882983210496 ext(1990656->2097151) 00010000:00010000:3.0:1746066755.769313:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 26 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.769321:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 26 pid: 20361 timeout: 823 lvb_type: 0 00002000:00010000:3.0:1746066755.769328:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b166a00 00000100:00100000:0.0:1746066755.773114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.773149:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984446208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.773162:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984446336:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.773169:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983210752 00000100:00100000:2.0:1746066755.773170:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984446464:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066755.773177:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983210752 00010000:00010000:2.0:1746066755.773203:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2236416->2523135] (req 2236416->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 43 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.773209:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 16 pid: 3528 timeout: 823 lvb_type: 1 00010000:00010000:2.0:1746066755.773218:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575ba00, rc 0) 00000100:00100000:3.0:1746066755.773250:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7165 00000100:00100000:3.0:1746066755.773258:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983210752:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.773272:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.773296:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 16 pid: 3528 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066755.773306:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 16 pid: 3528 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066755.773329:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa6f73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16c5 expref: 16 pid: 3528 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066755.773342:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.773414:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983210752:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 157us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.773417:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+43:637:x1830882983210624:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6066us (6567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.773421:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7165 00000100:00100000:2.0:1746066755.773424:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15939 00000100:00100000:0.0:1746066755.774869:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.774952:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.775015:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983211136 00000100:00100000:3.0:1746066755.775020:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983211136 00010000:00010000:3.0:1746066755.775041:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 28 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:3.0:1746066755.775058:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7166 00000100:00100000:3.0:1746066755.775063:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983211136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.775074:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.775087:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 28 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.775096:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 28 pid: 9590 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746066755.775157:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983211008 00000100:00100000:0.0:1746066755.775161:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983211008 00000100:00100000:0.0:1746066755.775188:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16288 00000100:00100000:0.0:1746066755.775193:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:631:x1830882983211008:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066755.775209:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066755.775223:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7109 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17c1 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.775249:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576be00/0xf1867c21abfa6e15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1624 expref: 28 pid: 9590 timeout: 823 lvb_type: 0 00010000:00010000:3.0:1746066755.775263:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.775291:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983211136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 227us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.775296:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7166 00010000:00010000:0.0:1746066755.775315:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775625:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775637:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775650:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775656:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775662:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775667:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066755.775671:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775677:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775684:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066755.775686:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066755.775689:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.775693:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7110 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066755.776035:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7109 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c1 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.776042:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7109 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c1 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.776049:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8a00, rc 0) 00000100:00100000:2.0:1746066755.776690:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.776727:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983211264 00000100:00100000:3.0:1746066755.776732:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983211264 00010000:00010000:3.0:1746066755.776749:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 43 pid: 9592 timeout: 823 lvb_type: 1 00000100:00100000:3.0:1746066755.776771:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7167 00000100:00100000:3.0:1746066755.776776:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983211264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.776784:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.776795:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 43 pid: 9592 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066755.776803:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 43 pid: 9592 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066755.776815:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d895800/0xf1867c21abfa6e69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1640 expref: 43 pid: 9592 timeout: 823 lvb_type: 1 00010000:00010000:3.0:1746066755.776826:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.776828:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.776834:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.776841:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.776867:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.776878:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984446592:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066755.777124:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:631:x1830882983211008:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 959us (1286us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066755.777132:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16288 00000100:00100000:3.0:1746066755.777415:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066755.777418:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.777482:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983211392 00000100:00100000:0.0:1746066755.777486:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983211392 00010000:00010000:0.0:1746066755.777513:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 26 pid: 20361 timeout: 823 lvb_type: 0 00000100:00100000:0.0:1746066755.777531:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7168 00000100:00100000:0.0:1746066755.777537:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2016:x1830882983211392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066755.777545:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066755.777558:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 26 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.777567:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 26 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.777581:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a0000/0xf1867c21abfa7068 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1758 expref: 26 pid: 20361 timeout: 823 lvb_type: 0 00010000:00010000:0.0:1746066755.777591:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.777593:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066755.777597:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.777604:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.777622:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 37 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.777635:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b40b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984446720:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066755.777675:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.778725:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.778776:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983211648 00000100:00100000:1.0:1746066755.778780:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983211648 00000100:00100000:1.0:1746066755.778815:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5941 00000100:00100000:1.0:1746066755.778821:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:631:x1830882983211648:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066755.779032:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:631:x1830882983211648:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 210us (307us total) trans 8589936619 rc 0/0 00000100:00100000:1.0:1746066755.779039:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5941 00000100:00100000:0.0:1746066755.779251:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b40b4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984446720:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066755.779269:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066755.779328:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983211392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1791us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.779335:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7168 00000100:00100000:3.0:1746066755.779347:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984446592:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066755.779357:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.779374:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983211264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2598us (2685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.779379:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7167 00000100:00100000:0.0:1746066755.780853:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.781004:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983211904 00000100:00100000:3.0:1746066755.781011:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983211904 00002000:00100000:3.0:1746066755.781042:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2236416->2240511) req@ffff88012faf5180 x1830882983211904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.781057:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5180 with x1830882983211904 ext(2236416->2240511) 00002000:00010000:3.0:1746066755.781062:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5180 00000100:00100000:3.0:1746066755.781114:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4221 00000100:00100000:3.0:1746066755.781120:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882983211904:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066755.781235:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882983211904:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 115us (386us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066755.781240:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4221 00002000:00100000:3.0:1746066755.781245:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2236416->2240511) req@ffff88012faf5180 x1830882983211904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.781251:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5180 with x1830882983211904 ext(2236416->2240511) 00002000:00010000:3.0:1746066755.781254:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5180 00000100:00100000:0.0:1746066755.781553:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.781762:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983212160 00000100:00100000:2.0:1746066755.781766:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983212160 00002000:00100000:2.0:1746066755.781812:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf4000 x1830882983212160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.781821:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4000 with x1830882983212160 ext(1048576->2097151) 00002000:00010000:2.0:1746066755.781824:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf4000 00000100:00100000:2.0:1746066755.781844:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4222 00000100:00100000:2.0:1746066755.781849:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983212160:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066755.785682:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.785742:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983212416 00000100:00100000:3.0:1746066755.785751:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983212416 00002000:00100000:3.0:1746066755.785794:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2519040->2523135) req@ffff88012faf5500 x1830882983212416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.785801:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5500 with x1830882983212416 ext(2519040->2523135) 00002000:00010000:3.0:1746066755.785806:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5500 00000100:00100000:3.0:1746066755.785832:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4223 00000100:00100000:3.0:1746066755.785839:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983212416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066755.786009:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983212416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 170us (336us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066755.786016:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4223 00002000:00100000:3.0:1746066755.786023:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2519040->2523135) req@ffff88012faf5500 x1830882983212416/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.786030:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf5500 with x1830882983212416 ext(2519040->2523135) 00002000:00010000:3.0:1746066755.786032:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf5500 00000100:00100000:2.0:1746066755.789959:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983212160:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8101us (8397us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066755.789972:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4222 00002000:00100000:2.0:1746066755.789982:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012faf4000 x1830882983212160/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.789991:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf4000 with x1830882983212160 ext(1048576->2097151) 00002000:00010000:2.0:1746066755.789995:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf4000 00000100:00100000:0.0:1746066755.792479:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.792552:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983212672 00000100:00100000:1.0:1746066755.792563:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983212672 00000100:00100000:1.0:1746066755.792619:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5942 00000100:00100000:1.0:1746066755.792627:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+56:637:x1830882983212672:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066755.792826:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4a932635-1bad-46b9-b237-470f1d1c8595+57:637:x1830882983212672:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 198us (520us total) trans 8589936620 rc 0/0 00000100:00100000:1.0:1746066755.792833:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5942 00000100:00100000:0.0:1746066755.793766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.793837:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983212800 00000100:00100000:2.0:1746066755.793844:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983212800 00000100:00100000:2.0:1746066755.794005:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15940 00000100:00100000:2.0:1746066755.794012:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+38:639:x1830882983212800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066755.794026:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.794044:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17c8 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.794072:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.794080:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.794082:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066755.794086:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.794123:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.794136:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 24 pid: 20361 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066755.794153:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984446848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.794233:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.795186:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984446848:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.795205:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.795217:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575aa00, rc 0) 00000100:00100000:2.0:1746066755.795243:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:639:x1830882983212800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1232us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.795249:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15940 00000100:00100000:0.0:1746066755.795711:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.795749:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983212928 00000100:00100000:2.0:1746066755.795754:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983212928 00002000:00100000:2.0:1746066755.795779:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1282047) req@ffff8800b40b4e00 x1830882983212928/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.795788:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b4e00 with x1830882983212928 ext(1048576->1282047) 00010000:00010000:2.0:1746066755.795795:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 25 pid: 20361 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066755.795806:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 25 pid: 20361 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066755.795811:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b40b4e00 00000100:00100000:2.0:1746066755.795842:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 941 00000100:00100000:2.0:1746066755.795848:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+25:2016:x1830882983212928:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066755.798941:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983212928:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3083us (3221us total) trans 17179874413 rc 0/0 00000100:00100000:0.0:1746066755.798952:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 941 00002000:00100000:0.0:1746066755.798962:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1282047) req@ffff8800b40b4e00 x1830882983212928/t17179874413(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:161/0 lens 488/448 e 0 to 0 dl 1746066766 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066755.798972:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b40b4e00 with x1830882983212928 ext(1048576->1282047) 00010000:00010000:0.0:1746066755.798981:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 27 pid: 20361 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746066755.798996:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 27 pid: 20361 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746066755.799003:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800b40b4e00 00000100:00100000:0.0:1746066755.802555:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.802665:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983213056 00000100:00100000:3.0:1746066755.802676:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983213056 00010000:00010000:3.0:1746066755.802714:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 27 pid: 20361 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066755.802742:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7169 00000100:00100000:3.0:1746066755.802749:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882983213056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.802764:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.802783:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 27 pid: 20361 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066755.802796:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 27 pid: 20361 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066755.802822:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800958a1000/0xf1867c21abfa706f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d175f expref: 27 pid: 20361 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066755.803058:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.803060:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066755.803069:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.803078:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.803112:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.803125:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984446976:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066755.803993:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.805818:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984446976:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066755.805837:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.805869:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882983213056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3120us (3325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.805879:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7169 00000100:00100000:0.0:1746066755.807311:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.807359:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983213312 00000100:00100000:2.0:1746066755.807367:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983213312 00002000:00100000:2.0:1746066755.807462:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096e6ad80 x1830882983213312/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.807469:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6ad80 with x1830882983213312 ext(1048576->2097151) 00002000:00010000:2.0:1746066755.807474:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e6ad80 00000100:00100000:2.0:1746066755.807506:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4224 00000100:00100000:2.0:1746066755.807514:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983213312:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066755.814584:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2014:x1830882983213312:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7057us (7263us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066755.814598:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4224 00002000:00100000:2.0:1746066755.814610:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096e6ad80 x1830882983213312/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.814620:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6ad80 with x1830882983213312 ext(1048576->2097151) 00002000:00010000:2.0:1746066755.814626:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e6ad80 00000100:00100000:0.0:1746066755.824021:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.824093:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983213568 00000100:00100000:3.0:1746066755.824104:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983213568 00002000:00100000:3.0:1746066755.824154:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096e69f80 x1830882983213568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 504/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.824165:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69f80 with x1830882983213568 ext(2097152->4194303) 00002000:00010000:3.0:1746066755.824170:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e69f80 00000100:00100000:3.0:1746066755.824201:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4225 00000100:00100000:3.0:1746066755.824210:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882983213568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066755.838423:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2016:x1830882983213568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14202us (14400us total) trans 0 rc 1810432/1810432 00000100:00100000:3.0:1746066755.838439:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4225 00002000:00100000:3.0:1746066755.838450:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880096e69f80 x1830882983213568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 504/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 1810432/1810432 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.838465:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69f80 with x1830882983213568 ext(2097152->4194303) 00002000:00010000:3.0:1746066755.838471:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e69f80 00000100:00100000:0.0:1746066755.847106:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.847673:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983213824 00000100:00100000:3.0:1746066755.847684:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983213824 00002000:00100000:3.0:1746066755.847735:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096e6b480 x1830882983213824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.847746:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6b480 with x1830882983213824 ext(4194304->5033983) 00002000:00010000:3.0:1746066755.847752:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e6b480 00000100:00100000:3.0:1746066755.847785:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4226 00000100:00100000:3.0:1746066755.847793:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983213824:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066755.852792:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983213824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4986us (5685us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066755.852805:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4226 00002000:00100000:3.0:1746066755.852817:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096e6b480 x1830882983213824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.852826:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6b480 with x1830882983213824 ext(4194304->5033983) 00002000:00010000:3.0:1746066755.852832:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096e6b480 00000100:00100000:0.0:1746066755.909959:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.910029:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983214080 00000100:00100000:2.0:1746066755.910039:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983214080 00000100:00100000:2.0:1746066755.910098:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16289 00000100:00100000:2.0:1746066755.910108:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+57:645:x1830882983214080:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.910155:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.910174:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfa711e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17cf expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.910276:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.910292:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.910299:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066755.910333:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.910344:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 13 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066755.910356:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984447104:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.910504:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.911635:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984447104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.911654:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066755.915216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.915411:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983214208 00000100:00100000:3.0:1746066755.915422:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983214208 00010000:00010000:3.0:1746066755.915461:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 14 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066755.915500:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7170 00000100:00100000:3.0:1746066755.915509:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983214208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.915525:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066755.915531:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 14 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066755.915542:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 14 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066755.915564:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a1800/0xf1867c21abfa70e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d179e expref: 14 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066755.915595:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.915600:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.915610:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.915616:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.915637:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066755.915696:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983214208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 188us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.915706:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7170 00010000:00010000:3.0:1746066755.916210:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066755.916217:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066755.916237:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066755.916369:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575ac00/0xf1867c21abfa711e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 60 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.916382:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 59 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.916388:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.916390:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066755.916393:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b800, rc 0) 00000100:00100000:3.0:1746066755.916930:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+59:645:x1830882983214080:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6822us (6983us total) trans 8589936621 rc 0/0 00000100:00100000:3.0:1746066755.916936:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16289 00000100:00100000:0.0:1746066755.919288:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.919334:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983214336 00000100:00100000:2.0:1746066755.919344:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983214336 00000100:00100000:2.0:1746066755.919392:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15941 00000100:00100000:2.0:1746066755.919400:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:645:x1830882983214336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066755.919417:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066755.919434:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17d6 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.919462:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.919472:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.919479:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 7 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.919486:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.919488:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066755.919500:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2863104->2932735] (req 2863104->2932735) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 40 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.919531:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 7 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.919544:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 7 pid: 3528 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746066755.919557:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984447232:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.919758:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 25 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066755.919767:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 25 pid: 9592 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746066755.919774:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984447360:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.919803:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 40 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.919811:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 40 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066755.919819:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984447488:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.919835:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066755.921799:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984447232:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.922444:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984447360:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066755.922453:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093cced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984447488:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066755.922483:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2863104->2932735] (req 2863104->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 40 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066755.922509:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a575b400, rc 0) 00000100:00100000:2.0:1746066755.922563:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+40:645:x1830882983214336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3162us (3282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066755.922570:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15941 00000100:00100000:0.0:1746066755.925767:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.925911:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.925974:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.926008:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983214464 00000100:00100000:0.0:1746066755.926012:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.926018:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983214464 00000100:00100000:0.0:1746066755.926043:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983214592 00010000:00010000:1.0:1746066755.926046:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 8 pid: 3528 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746066755.926050:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983214592 00000100:00100000:1.0:1746066755.926066:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983214720 00010000:00010000:0.0:1746066755.926066:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 26 pid: 9592 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066755.926067:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983214720 00010000:00010000:1.0:1746066755.926074:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 40 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066755.926084:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7171 00000100:00100000:1.0:1746066755.926088:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983214464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.926100:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066755.926117:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 8 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066755.926125:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 8 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066755.926143:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37600/0xf1867c21abfa6f7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16cc expref: 8 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066755.926159:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.926191:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2015:x1830882983214464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066755.926236:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983214976 00000100:00100000:3.0:1746066755.926241:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983214976 00000100:00100000:3.0:1746066755.926268:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16290 00000100:00100000:3.0:1746066755.926274:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+40:649:x1830882983214976:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066755.926295:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.926310:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfa713a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17dd expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.926405:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7172 00010000:00010000:3.0:1746066755.926407:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066755.926410:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7171 00000100:00100000:0.0:1746066755.926413:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983214592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066755.926420:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066755.926420:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7173 00010000:00010000:0.0:1746066755.926420:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066755.926423:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983214720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066755.926428:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066755.926429:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 26 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746066755.926430:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066755.926432:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 40 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746066755.926438:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 26 pid: 9592 timeout: 824 lvb_type: 1 00000004:00200000:3.0:1746066755.926440:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:1.0:1746066755.926445:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 40 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066755.926634:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9da00/0xf1867c21abfa713a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 43 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.926652:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 42 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066755.926659:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066755.926662:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066755.926665:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9c200, rc 0) 00000100:00100000:3.0:1746066755.926687:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+42:649:x1830882983214976:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 413us (806us total) trans 8589936622 rc 0/0 00000100:00100000:3.0:1746066755.926692:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16290 00010000:00010000:0.0:1746066755.926727:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa37c00/0xf1867c21abfa6ff1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d170b expref: 26 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066755.926729:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009db77400/0xf1867c21abfa6ed2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1671 expref: 40 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066755.926735:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.926737:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.926741:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.926747:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066755.926752:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066755.926768:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 39 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066755.926768:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983214592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 357us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066755.926773:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7172 00000100:00100000:1.0:1746066755.926778:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984447616:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066755.926822:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066755.928531:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066755.928752:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983215232 00000100:00100000:3.0:1746066755.928759:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983215232 00002000:00100000:3.0:1746066755.928796:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2863104->2867199) req@ffff8800945d4a80 x1830882983215232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.928805:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4a80 with x1830882983215232 ext(2863104->2867199) 00002000:00010000:3.0:1746066755.928810:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d4a80 00000100:00100000:3.0:1746066755.928827:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4227 00000100:00100000:3.0:1746066755.928834:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983215232:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066755.928994:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983215232:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 159us (467us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066755.929000:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4227 00002000:00100000:3.0:1746066755.929005:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2863104->2867199) req@ffff8800945d4a80 x1830882983215232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066755.929012:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d4a80 with x1830882983215232 ext(2863104->2867199) 00002000:00010000:3.0:1746066755.929016:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d4a80 00000100:00100000:1.0:1746066755.929134:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984447616:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066755.929156:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066755.929189:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983214720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2762us (3174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.929197:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7173 00000100:00100000:0.0:1746066755.933684:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.933816:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983215488 00000100:00100000:2.0:1746066755.933828:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983215488 00002000:00100000:2.0:1746066755.933923:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2928640->2932735) req@ffff8800945d6d80 x1830882983215488/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.933935:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d6d80 with x1830882983215488 ext(2928640->2932735) 00002000:00010000:2.0:1746066755.933943:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d6d80 00000100:00100000:2.0:1746066755.934139:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4228 00000100:00100000:2.0:1746066755.934152:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983215488:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066755.934597:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2015:x1830882983215488:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 444us (924us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066755.934605:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4228 00002000:00100000:2.0:1746066755.934612:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2928640->2932735) req@ffff8800945d6d80 x1830882983215488/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 488/4536 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.934620:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800945d6d80 with x1830882983215488 ext(2928640->2932735) 00002000:00010000:2.0:1746066755.934623:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800945d6d80 00000100:00100000:0.0:1746066755.984780:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.984856:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.984946:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983215616 00000100:00100000:1.0:1746066755.984958:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983215616 00000100:00100000:0.0:1746066755.984958:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066755.985006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066755.985159:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983215744 00000100:00100000:1.0:1746066755.985162:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983215744 00000100:00100000:1.0:1746066755.985181:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983215872 00000100:00100000:1.0:1746066755.985183:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983215872 00000100:00100000:1.0:1746066755.985192:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983216000 00000100:00100000:1.0:1746066755.985194:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983216000 00000100:00100000:1.0:1746066755.985209:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15942 00000100:00100000:1.0:1746066755.985216:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882983215616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066755.985232:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066755.985246:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17e4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.985265:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.985267:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.985275:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.985288:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.985298:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093506600, rc 0) 00000100:00100000:1.0:1746066755.985346:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983215616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 130us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.985352:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15942 00000100:00100000:1.0:1746066755.985366:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15943 00000100:00100000:1.0:1746066755.985370:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882983215744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066755.985376:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066755.985382:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17eb expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066755.985392:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.985393:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066755.985397:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.985404:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.985410:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507000, rc 0) 00000100:00100000:1.0:1746066755.985422:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983215744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 52us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066755.985426:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15943 00000100:00100000:1.0:1746066755.985434:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15944 00000100:00100000:1.0:1746066755.985438:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882983215872:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066755.985446:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066755.985454:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093506200/0xf1867c21abfa715d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17f2 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066755.985485:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984447744:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066755.985526:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15945 00000100:00100000:1.0:1746066755.985536:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.985539:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882983216000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066755.985554:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066755.985567:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa7164 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d17f9 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066755.985609:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984447872:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066755.985659:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066755.987552:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984447872:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.987583:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa7164 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17f9 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066755.987593:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984447744:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066755.987595:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f9c000/0xf1867c21abfa7164 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17f9 expref: 28 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.987617:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093506200/0xf1867c21abfa715d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17f2 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066755.987623:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f9c000, rc 0) 00010000:00010000:1.0:1746066755.987628:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093506200/0xf1867c21abfa715d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17f2 expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066755.987643:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093506200, rc 0) 00000100:00100000:3.0:1746066755.987656:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+27:2013:x1830882983216000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2121us (2650us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066755.987668:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15945 00000100:00100000:1.0:1746066755.987671:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882983215872:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2231us (2722us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066755.987678:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15944 00000100:00100000:0.0:1746066755.997171:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066755.997316:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983216256 00000100:00100000:2.0:1746066755.997326:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983216256 00002000:00100000:2.0:1746066755.997765:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009677df80 x1830882983216256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 504/0 e 0 to 0 dl 1746066766 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066755.997812:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677df80 with x1830882983216256 ext(2097152->4194303) 00002000:00010000:2.0:1746066755.997819:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677df80 00000100:00100000:2.0:1746066755.997851:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4229 00000100:00100000:2.0:1746066755.997858:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983216256:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.006030:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.006711:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983216512 00000100:00100000:3.0:1746066756.006722:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983216512 00000100:00100000:1.0:1746066756.006733:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:3.0:1746066756.006769:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095ce3100 x1830882983216512/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.006783:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3100 with x1830882983216512 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.006792:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce3100 00000100:00100000:3.0:1746066756.006810:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983216768 00000100:00100000:3.0:1746066756.006812:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983216768 00000100:00100000:1.0:1746066756.006820:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4230 00002000:00100000:3.0:1746066756.006826:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095ce3800 x1830882983216768/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066756.006829:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983216512:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746066756.006832:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3800 with x1830882983216768 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.006834:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce3800 00000100:00100000:3.0:1746066756.006858:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4231 00000100:00100000:3.0:1746066756.006863:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983216768:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.019312:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983216256:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21440us (22137us total) trans 0 rc 2027520/2027520 00000100:00100000:2.0:1746066756.019325:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4229 00002000:00100000:2.0:1746066756.019339:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009677df80 x1830882983216256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:161/0 lens 504/440 e 0 to 0 dl 1746066766 ref 1 fl Complete:/200/0 rc 2027520/2027520 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.019356:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677df80 with x1830882983216256 ext(2097152->4194303) 00002000:00010000:2.0:1746066756.019362:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677df80 00000100:00100000:3.0:1746066756.027733:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882983216768:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20855us (20986us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066756.027747:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4231 00002000:00100000:3.0:1746066756.027762:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095ce3800 x1830882983216768/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.027771:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3800 with x1830882983216768 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.027778:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce3800 00000100:00100000:3.0:1746066756.029020:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882983216512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22190us (23003us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066756.029027:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4230 00002000:00100000:3.0:1746066756.029034:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095ce3100 x1830882983216512/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.029041:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3100 with x1830882983216512 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.029045:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ce3100 00000100:00100000:0.0:1746066756.038693:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.039442:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983216896 00000100:00100000:1.0:1746066756.039451:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983216896 00000100:00100000:1.0:1746066756.039521:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15946 00000100:00100000:1.0:1746066756.039529:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:649:x1830882983216896:12345-192.168.204.16@tcp:101:multiop.0 00000100:00100000:0.0:1746066756.039536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066756.039549:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.039567:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1800 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.039626:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983217024 00000100:00100000:2.0:1746066756.039633:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983217024 00000100:00100000:2.0:1746066756.039663:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15947 00000100:00100000:2.0:1746066756.039668:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983217024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.039674:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.039680:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e0b400/0xf1867c21abfa7172 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1807 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066756.039964:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.039976:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984448000:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066756.039979:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983217152 00000100:00100000:0.0:1746066756.039982:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983217152 00000100:00100000:0.0:1746066756.040014:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15948 00000100:00100000:0.0:1746066756.040021:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882983217152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066756.040029:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066756.040038:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800979a6200/0xf1867c21abfa7179 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d180e expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.040054:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.040066:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984448128:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066756.040087:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066756.040088:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00010000:00010000:1.0:1746066756.040096:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.040097:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.040101:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2666496->3145727] (req 2666496->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.040119:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 41 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.040130:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 41 pid: 12233 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.040138:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984448256:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.040160:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746066756.041748:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066756 -> 1746066757 00000100:00100000:0.0:1746066756.041762:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.041767:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984448128:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066756.041791:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800979a6200/0xf1867c21abfa7179 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d180e expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.041807:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800979a6200/0xf1867c21abfa7179 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d180e expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.042136:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800979a6200, rc 0) 00000100:00100000:0.0:1746066756.042149:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984448256:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066756.042166:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2666496->3145727] (req 2666496->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.042169:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882983217152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2148us (2205us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.042176:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15948 00010000:00010000:0.0:1746066756.042179:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507400, rc 0) 00000100:00100000:0.0:1746066756.042315:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:649:x1830882983216896:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2786us (3633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066756.042321:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15946 00000100:00100000:0.0:1746066756.043084:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983217280 00000100:00100000:0.0:1746066756.043089:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983217280 00002000:00100000:0.0:1746066756.043123:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2236416->2523135) req@ffff88009677ce00 x1830882983217280/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.043132:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ce00 with x1830882983217280 ext(2236416->2523135) 00010000:00010000:0.0:1746066756.043138:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 42 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746066756.043149:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 42 pid: 12233 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746066756.043155:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009677ce00 00000100:00100000:0.0:1746066756.043168:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 942 00000100:00100000:0.0:1746066756.043173:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983217280:12345-192.168.204.16@tcp:4:cat.0 00002000:00010000:2.0:1746066756.043472:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066756 -> 1746066757 00000100:00100000:2.0:1746066756.043481:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984448000:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.043512:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e0b400/0xf1867c21abfa7172 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1807 expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.043522:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e0b400/0xf1867c21abfa7172 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1807 expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.043548:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0b400, rc 0) 00000100:00100000:2.0:1746066756.043570:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983217024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3901us (4035us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.043575:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15947 00000100:00100000:1.0:1746066756.047588:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.047842:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983217408 00000100:00100000:3.0:1746066756.047853:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983217408 00000100:00100000:1.0:1746066756.048077:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15949 00000100:00100000:1.0:1746066756.048086:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:656:x1830882983217408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.048106:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.048124:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1815 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.048153:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.048899:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2666496->3145727] (req 2666496->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.048906:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746066756.048911:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.048950:0:9592:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2666496->3145727] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.048964:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.048979:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093506400, rc 0) 00000100:00100000:1.0:1746066756.049026:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:656:x1830882983217408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 941us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.049032:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15949 00000100:00100000:2.0:1746066756.050543:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983217280:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7365us (8779us total) trans 21474841861 rc 0/0 00000100:00100000:2.0:1746066756.050552:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 942 00002000:00100000:2.0:1746066756.050562:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2236416->2523135) req@ffff88009677ce00 x1830882983217280/t21474841861(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.050572:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677ce00 with x1830882983217280 ext(2236416->2523135) 00010000:00010000:2.0:1746066756.050580:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 44 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.050592:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 44 pid: 12233 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.050599:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009677ce00 00000100:00100000:0.0:1746066756.056010:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.056126:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983217536 00000100:00100000:1.0:1746066756.056136:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983217536 00010000:00010000:1.0:1746066756.056175:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 44 pid: 12233 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.056217:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7174 00000100:00100000:1.0:1746066756.056683:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2014:x1830882983217536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.056698:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.056722:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 44 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.056734:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 44 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.056758:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a575ba00/0xf1867c21abfa7102 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2236416->2523135) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17ba expref: 44 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.056790:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.056792:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.056800:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.056814:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.056850:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.056862:0:11928:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 28 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.056874:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984448512:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066756.057443:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.060650:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.060844:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984448512:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066756.060865:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.060897:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983217792 00000100:00100000:2.0:1746066756.060904:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983217792 00000100:00100000:1.0:1746066756.060928:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983217536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4702us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.060938:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7174 00002000:00100000:2.0:1746066756.060947:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2666496->2670591) req@ffff88012ce07800 x1830882983217792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.060957:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07800 with x1830882983217792 ext(2666496->2670591) 00010000:00010000:2.0:1746066756.060966:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.060979:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.060986:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce07800 00000100:00100000:2.0:1746066756.061013:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 943 00000100:00100000:2.0:1746066756.061021:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983217792:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.061132:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983217792:12345-192.168.204.16@tcp:3:cat.0 Request processed in 111us (492us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066756.061137:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 943 00002000:00100000:2.0:1746066756.061142:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2666496->2670591) req@ffff88012ce07800 x1830882983217792/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.061150:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07800 with x1830882983217792 ext(2666496->2670591) 00010000:00010000:2.0:1746066756.061154:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.061163:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.061169:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce07800 00000100:00100000:0.0:1746066756.068290:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.068348:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.068435:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983218176 00000100:00100000:2.0:1746066756.068443:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983218176 00000100:00100000:2.0:1746066756.068510:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15950 00000100:00100000:2.0:1746066756.068519:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:649:x1830882983218176:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066756.068537:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.068555:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d181c expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.068585:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.068592:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066756.068595:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746066756.068597:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983218048 00010000:00010000:2.0:1746066756.068599:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.068602:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983218048 00010000:00010000:2.0:1746066756.068631:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 38 pid: 12233 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066756.068632:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2666496->3145727) req@ffff88012ce07b80 x1830882983218048/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066756.068642:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 38 pid: 12233 timeout: 824 lvb_type: 0 00002000:00100000:1.0:1746066756.068642:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07b80 with x1830882983218048 ext(2666496->3145727) 00010000:00010000:1.0:1746066756.068649:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.068654:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984448640:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.068664:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 29 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:1.0:1746066756.068670:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce07b80 00000100:00100000:1.0:1746066756.068697:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 944 00000100:00100000:1.0:1746066756.068703:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983218048:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066756.068721:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.074073:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.074106:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984448640:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066756.074112:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983218304 00000100:00100000:2.0:1746066756.074119:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983218304 00010000:00010000:3.0:1746066756.074138:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 28 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.074154:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0bc00, rc 0) 00002000:00100000:2.0:1746066756.074160:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2863104->2932735) req@ffff880093ccd180 x1830882983218304/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.074171:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd180 with x1830882983218304 ext(2863104->2932735) 00010000:00010000:2.0:1746066756.074178:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 39 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.074190:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 39 pid: 12233 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.074197:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:649:x1830882983218176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5680us (5848us total) trans 0 rc 0/0 00002000:00010000:2.0:1746066756.074197:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ccd180 00000100:00100000:3.0:1746066756.074205:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15950 00000100:00100000:2.0:1746066756.074218:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 945 00000100:00100000:2.0:1746066756.074226:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+39:2016:x1830882983218304:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066756.076102:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983218048:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7392us (7816us total) trans 21474841862 rc 0/0 00000100:00100000:0.0:1746066756.076112:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 944 00002000:00100000:0.0:1746066756.076120:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2666496->3145727) req@ffff88012ce07b80 x1830882983218048/t21474841862(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.076128:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ce07b80 with x1830882983218048 ext(2666496->3145727) 00010000:00010000:0.0:1746066756.076135:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746066756.076148:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746066756.076155:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ce07b80 00000100:00100000:0.0:1746066756.077839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.077952:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983218432 00000100:00100000:1.0:1746066756.077960:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983218432 00010000:00010000:1.0:1746066756.077989:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.078015:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7175 00000100:00100000:1.0:1746066756.078022:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983218432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.078034:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066756.078048:0:11928:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066756 -> 1746066757 00002000:00010000:1.0:1746066756.078051:0:11928:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066756 -> 1746066757 00010000:00010000:1.0:1746066756.078056:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.078066:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.078087:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093507400/0xf1867c21abfa716b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2666496->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1800 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.078117:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.078119:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.078126:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.078134:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.078195:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 30 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.078207:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984448768:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066756.078964:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.078995:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983218304:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4767us (4929us total) trans 17179874414 rc 0/0 00000100:00100000:2.0:1746066756.079003:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 945 00002000:00100000:2.0:1746066756.079012:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2863104->2932735) req@ffff880093ccd180 x1830882983218304/t17179874414(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.079022:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccd180 with x1830882983218304 ext(2863104->2932735) 00010000:00010000:2.0:1746066756.079030:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 41 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.079042:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 41 pid: 12233 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.079048:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093ccd180 00000100:00100000:1.0:1746066756.080257:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984448768:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066756.080274:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.080322:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983218432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2289us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.080330:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7175 00000100:00100000:0.0:1746066756.082930:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.082962:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983218560 00000100:00100000:1.0:1746066756.082970:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983218560 00010000:00010000:1.0:1746066756.083000:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 41 pid: 12233 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.083029:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7176 00000100:00100000:1.0:1746066756.083034:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983218560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.083046:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.083062:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 41 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.083070:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 41 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.083092:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575b400/0xf1867c21abfa7133 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2863104->2932735) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17d6 expref: 41 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.083110:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.083112:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.083117:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.083124:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.083156:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.083176:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984448896:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066756.083251:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.083782:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.083825:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983218816 00000100:00100000:2.0:1746066756.083832:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983218816 00002000:00100000:2.0:1746066756.084043:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095dd4000 x1830882983218816/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.084052:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4000 with x1830882983218816 ext(2097152->3145727) 00002000:00010000:2.0:1746066756.084057:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4000 00000100:00100000:2.0:1746066756.084076:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4232 00000100:00100000:2.0:1746066756.084082:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983218816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.085153:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984448896:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066756.085170:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.085205:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+40:2016:x1830882983218560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2169us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.085215:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7176 00000100:00100000:0.0:1746066756.087989:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.088080:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983219072 00000100:00100000:2.0:1746066756.088088:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983219072 00002000:00100000:2.0:1746066756.088131:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2449408->2453503) req@ffff880095dd4380 x1830882983219072/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.088146:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4380 with x1830882983219072 ext(2449408->2453503) 00002000:00010000:2.0:1746066756.088151:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd4380 00000100:00100000:2.0:1746066756.088182:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4233 00000100:00100000:2.0:1746066756.088190:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983219072:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.088340:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983219072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 150us (360us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066756.088347:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4233 00002000:00100000:2.0:1746066756.088356:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2449408->2453503) req@ffff880095dd4380 x1830882983219072/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.088363:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4380 with x1830882983219072 ext(2449408->2453503) 00002000:00010000:2.0:1746066756.088366:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd4380 00000100:00100000:2.0:1746066756.090266:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983218816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6178us (6479us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066756.090274:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4232 00002000:00100000:2.0:1746066756.090282:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880095dd4000 x1830882983218816/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.090289:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd4000 with x1830882983218816 ext(2097152->3145727) 00002000:00010000:2.0:1746066756.090294:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd4000 00000100:00100000:0.0:1746066756.096796:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.096842:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.096915:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983219456 00000100:00100000:3.0:1746066756.096919:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983219584 00000100:00100000:3.0:1746066756.096924:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983219584 00000100:00100000:2.0:1746066756.096924:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983219456 00002000:00100000:3.0:1746066756.096966:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095dd7480 x1830882983219584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.096967:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2453504->3145727) req@ffff880095dd6d80 x1830882983219456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.096976:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882983219584 ext(3145728->4194303) 00002000:00100000:2.0:1746066756.096976:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6d80 with x1830882983219456 ext(2453504->3145727) 00002000:00010000:3.0:1746066756.096981:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd7480 00002000:00010000:2.0:1746066756.096981:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6d80 00000100:00100000:3.0:1746066756.096998:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4234 00000100:00100000:3.0:1746066756.097003:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983219584:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.097016:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4235 00000100:00100000:2.0:1746066756.097021:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983219456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066756.097711:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.097728:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983219840 00000100:00100000:0.0:1746066756.097731:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983219840 00002000:00100000:0.0:1746066756.097749:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095dd5f80 x1830882983219840/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.097756:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5f80 with x1830882983219840 ext(3145728->4194303) 00002000:00010000:0.0:1746066756.097759:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5f80 00000100:00100000:0.0:1746066756.097779:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4236 00000100:00100000:0.0:1746066756.097786:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983219840:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.105214:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983219456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8178us (8414us total) trans 0 rc 692224/692224 00000100:00100000:2.0:1746066756.105227:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4235 00002000:00100000:2.0:1746066756.105242:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (2453504->3145727) req@ffff880095dd6d80 x1830882983219456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.105252:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd6d80 with x1830882983219456 ext(2453504->3145727) 00002000:00010000:2.0:1746066756.105258:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd6d80 00000100:00100000:3.0:1746066756.109033:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983219584:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12017us (12177us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066756.109046:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4234 00002000:00100000:3.0:1746066756.109059:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095dd7480 x1830882983219584/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.109068:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd7480 with x1830882983219584 ext(3145728->4194303) 00002000:00010000:3.0:1746066756.109073:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095dd7480 00000100:00100000:2.0:1746066756.112574:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983219840:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14777us (14852us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066756.112586:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4236 00002000:00100000:2.0:1746066756.112597:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095dd5f80 x1830882983219840/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.112607:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095dd5f80 with x1830882983219840 ext(3145728->4194303) 00002000:00010000:2.0:1746066756.112613:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095dd5f80 00000100:00100000:0.0:1746066756.116839:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.116928:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983220096 00000100:00100000:2.0:1746066756.116939:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983220096 00002000:00100000:2.0:1746066756.116991:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880098fb6d80 x1830882983220096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.117001:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb6d80 with x1830882983220096 ext(4194304->5033983) 00002000:00010000:2.0:1746066756.117006:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb6d80 00000100:00100000:2.0:1746066756.117036:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4237 00000100:00100000:2.0:1746066756.117045:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983220096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.121553:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983220096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4495us (4710us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066756.121569:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4237 00002000:00100000:2.0:1746066756.121583:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880098fb6d80 x1830882983220096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.121593:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb6d80 with x1830882983220096 ext(4194304->5033983) 00002000:00010000:2.0:1746066756.121599:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb6d80 00000100:00100000:0.0:1746066756.156246:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.156295:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.156308:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983220352 00000100:00100000:3.0:1746066756.156319:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983220352 00000100:00100000:3.0:1746066756.156362:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983220224 00000100:00100000:3.0:1746066756.156363:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983220224 00000100:00100000:3.0:1746066756.156378:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15951 00000100:00100000:3.0:1746066756.156386:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983220352:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066756.156395:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15952 00010000:00010000:3.0:1746066756.156404:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.156420:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0152400/0xf1867c21abfa718e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d182a expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.156474:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449024:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066756.156568:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983220224:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.156576:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.156586:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1823 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.156599:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.156601:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.156609:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 44 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.156623:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 44 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.156632:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66400, rc 0) 00000100:00100000:1.0:1746066756.156656:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983220224:12345-192.168.204.16@tcp:101:cat.0 Request processed in 255us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.156661:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15952 00000100:00100000:3.0:1746066756.156665:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76e40 going to sleep for 11 seconds 00002000:00010000:3.0:1746066756.158405:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066756 -> 1746066757 00002000:00010000:3.0:1746066756.158409:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066756 -> 1746066757 00000100:00100000:3.0:1746066756.158428:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449024:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066756.158453:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0152400/0xf1867c21abfa718e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d182a expref: 41 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.158465:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0152400/0xf1867c21abfa718e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d182a expref: 41 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.158498:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0152400, rc 0) 00000100:00100000:3.0:1746066756.158534:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:2013:x1830882983220352:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2148us (2756us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066756.158540:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15951 00000100:00100000:0.0:1746066756.168583:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.170352:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983220608 00000100:00100000:2.0:1746066756.170364:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983220608 00002000:00100000:2.0:1746066756.170411:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098fb7b80 x1830882983220608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.170421:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb7b80 with x1830882983220608 ext(2097152->3145727) 00002000:00010000:2.0:1746066756.170427:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb7b80 00000100:00100000:2.0:1746066756.170457:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4238 00000100:00100000:2.0:1746066756.170464:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983220608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.178727:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983220608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8247us (10140us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066756.178740:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4238 00002000:00100000:2.0:1746066756.178754:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098fb7b80 x1830882983220608/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.178764:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb7b80 with x1830882983220608 ext(2097152->3145727) 00002000:00010000:2.0:1746066756.178770:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb7b80 00000100:00100000:0.0:1746066756.182533:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.183092:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983220736 00000100:00100000:2.0:1746066756.183101:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983220736 00000100:00100000:2.0:1746066756.183144:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15953 00000100:00100000:2.0:1746066756.183152:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+40:664:x1830882983220736:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.183170:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.183186:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1831 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.183217:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.183224:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066756.183226:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066756.183228:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.183256:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 27 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.183265:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 27 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.183276:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449152:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066756.183356:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.186132:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.186972:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449152:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066756.187003:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.187025:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71a00, rc 0) 00000100:00100000:2.0:1746066756.187082:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:664:x1830882983220736:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3930us (4559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.187092:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15953 00000100:00100000:3.0:1746066756.187965:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983220864 00000100:00100000:3.0:1746066756.187973:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983220864 00002000:00100000:3.0:1746066756.188012:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2453503) req@ffff880098fb4000 x1830882983220864/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.188022:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4000 with x1830882983220864 ext(2097152->2453503) 00010000:00010000:3.0:1746066756.188029:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 28 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.188041:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 28 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746066756.188048:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fb4000 00000100:00100000:3.0:1746066756.188077:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 946 00000100:00100000:3.0:1746066756.188331:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983220864:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:3.0:1746066756.197184:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983220864:12345-192.168.204.16@tcp:4:cat.0 Request processed in 9088us (11046us total) trans 17179874415 rc 0/0 00000100:00100000:3.0:1746066756.197196:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 946 00002000:00100000:3.0:1746066756.197209:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2453503) req@ffff880098fb4000 x1830882983220864/t17179874415(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.197218:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb4000 with x1830882983220864 ext(2097152->2453503) 00010000:00010000:3.0:1746066756.197229:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 30 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.197246:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 30 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746066756.197252:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fb4000 00000100:00100000:0.0:1746066756.202792:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.202930:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983220992 00000100:00100000:1.0:1746066756.202940:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983220992 00010000:00010000:1.0:1746066756.202978:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 30 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.203016:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7177 00000100:00100000:1.0:1746066756.203023:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983220992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.203038:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.203057:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 30 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.203069:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 30 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.203093:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096e0bc00/0xf1867c21abfa7187 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d181c expref: 30 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.203118:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.203120:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.203128:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.203137:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.203171:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.203189:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984449280:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066756.203282:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066756.204744:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984449280:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066756.204762:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.204799:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983220992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1776us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.204809:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7177 00000100:00100000:0.0:1746066756.214057:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.214115:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.214211:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983221248 00000100:00100000:2.0:1746066756.214221:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983221248 00002000:00100000:2.0:1746066756.214272:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880098fb5f80 x1830882983221248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.214283:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb5f80 with x1830882983221248 ext(2097152->4194303) 00002000:00010000:2.0:1746066756.214288:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fb5f80 00000100:00100000:2.0:1746066756.214306:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983221504 00000100:00100000:2.0:1746066756.214308:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983221504 00002000:00100000:2.0:1746066756.214319:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880098fb6300 x1830882983221504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.214326:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb6300 with x1830882983221504 ext(3145728->4194303) 00002000:00010000:2.0:1746066756.214329:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb6300 00000100:00100000:2.0:1746066756.214352:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4239 00000100:00100000:2.0:1746066756.214361:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983221248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.214930:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4240 00000100:00100000:1.0:1746066756.214938:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983221504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.223638:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983221504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8684us (9505us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066756.223653:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4240 00002000:00100000:1.0:1746066756.223667:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880098fb6300 x1830882983221504/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.223677:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb6300 with x1830882983221504 ext(3145728->4194303) 00002000:00010000:1.0:1746066756.223684:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb6300 00000100:00100000:2.0:1746066756.234564:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983221248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20191us (20506us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066756.234578:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4239 00002000:00100000:2.0:1746066756.234591:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880098fb5f80 x1830882983221248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.234607:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb5f80 with x1830882983221248 ext(2097152->4194303) 00002000:00010000:2.0:1746066756.234613:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fb5f80 00000100:00100000:0.0:1746066756.238007:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.238080:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983221760 00000100:00100000:2.0:1746066756.238090:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983221760 00002000:00100000:2.0:1746066756.238138:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880098fb7480 x1830882983221760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.238148:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb7480 with x1830882983221760 ext(4194304->5033983) 00002000:00010000:2.0:1746066756.238154:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb7480 00000100:00100000:2.0:1746066756.238191:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4241 00000100:00100000:2.0:1746066756.238199:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983221760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066756.241595:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.241669:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983221888 00000100:00100000:2.0:1746066756.241681:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983221888 00000100:00100000:2.0:1746066756.241730:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15954 00000100:00100000:2.0:1746066756.241738:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:663:x1830882983221888:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066756.241757:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.241776:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1838 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.241805:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.241813:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.241819:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.241821:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.241824:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1286144->1986559] (req 1286144->1986559) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.241853:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 28 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.241865:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 28 pid: 9592 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746066756.241876:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449408:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.241878:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2015:x1830882983221760:12345-192.168.204.16@tcp:3:cat.0 Request processed in 3679us (3881us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066756.241904:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4241 00002000:00100000:3.0:1746066756.241912:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880098fb7480 x1830882983221760/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.241920:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb7480 with x1830882983221760 ext(4194304->5033983) 00002000:00010000:3.0:1746066756.241924:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fb7480 00010000:00010000:2.0:1746066756.241976:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 42 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.241985:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 42 pid: 12233 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.241996:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449536:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066756.242029:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.242869:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449408:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066756.244602:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.244717:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983222016 00000100:00100000:1.0:1746066756.244725:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983222016 00000100:00100000:2.0:1746066756.244740:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984449536:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.244774:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15955 00010000:00010000:2.0:1746066756.244775:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1286144->1986559] (req 1286144->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 43 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.244782:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+43:2014:x1830882983222016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.244792:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70400, rc 0) 00010000:00010000:1.0:1746066756.244798:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.244813:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfa71aa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d183f expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.244829:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+44:663:x1830882983221888:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3091us (3246us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066756.244830:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066756.244836:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15954 00010000:00010000:1.0:1746066756.244840:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfa71aa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d183f expref: 44 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.244848:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098f77e00/0xf1867c21abfa71aa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d183f expref: 43 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.244867:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f77e00, rc 0) 00000100:00100000:1.0:1746066756.244915:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983222016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 134us (318us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.244920:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15955 00000100:00100000:2.0:1746066756.245074:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.245138:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.245181:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983222144 00000100:00100000:3.0:1746066756.245186:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983222144 00010000:00010000:3.0:1746066756.245206:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 29 pid: 9592 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746066756.245224:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983222272 00000100:00100000:3.0:1746066756.245226:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983222272 00010000:00010000:3.0:1746066756.245234:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 42 pid: 12233 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.245242:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7178 00000100:00100000:1.0:1746066756.245249:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983222144:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066756.245255:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7179 00010000:00010000:1.0:1746066756.245258:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066756.245261:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983222272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.245269:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.245276:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 29 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746066756.245277:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 42 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.245287:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 29 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746066756.245303:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 42 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.245320:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a575aa00/0xf1867c21abfa7117 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17c8 expref: 42 pid: 12233 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.245338:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066756.245353:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa7156 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17eb expref: 29 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066756.245362:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746066756.245370:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+41:2015:x1830882983222272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.245376:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7179 00010000:00010000:1.0:1746066756.245439:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.245446:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.245454:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.245481:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.245507:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984449664:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066756.246249:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.246478:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.246616:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983222400 00000100:00100000:2.0:1746066756.246621:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983222400 00000100:00100000:2.0:1746066756.246722:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15956 00000100:00100000:2.0:1746066756.246729:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882983222400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.246741:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.246750:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa71b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1846 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.246783:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984449792:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.247253:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.247364:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.247369:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984449664:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066756.247384:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.247395:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983222656 00000100:00100000:3.0:1746066756.247399:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983222656 00000100:00100000:1.0:1746066756.247409:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983222144:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2159us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.247418:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7178 00002000:00100000:3.0:1746066756.247427:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1286144->1290239) req@ffff8800958adc00 x1830882983222656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.247437:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adc00 with x1830882983222656 ext(1286144->1290239) 00002000:00010000:3.0:1746066756.247441:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958adc00 00000100:00100000:3.0:1746066756.247454:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4242 00000100:00100000:3.0:1746066756.247459:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882983222656:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066756.247582:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882983222656:12345-192.168.204.16@tcp:3:cat.0 Request processed in 122us (218us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066756.247589:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4242 00002000:00100000:3.0:1746066756.247594:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1286144->1290239) req@ffff8800958adc00 x1830882983222656/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.247601:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adc00 with x1830882983222656 ext(1286144->1290239) 00002000:00010000:3.0:1746066756.247603:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958adc00 00002000:00010000:2.0:1746066756.248410:0:11630:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066756 -> 1746066757 00002000:00010000:2.0:1746066756.248414:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066756 -> 1746066757 00002000:00010000:2.0:1746066756.248416:0:11630:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066756 -> 1746066757 00000100:00100000:2.0:1746066756.248426:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984449792:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.248447:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa71b1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1846 expref: 42 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.248458:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70600/0xf1867c21abfa71b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1846 expref: 42 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.248700:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70600, rc 0) 00000100:00100000:2.0:1746066756.248739:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:2013:x1830882983222400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2009us (2260us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.248746:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15956 00000100:00100000:2.0:1746066756.254592:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.254684:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983222912 00000100:00100000:3.0:1746066756.254695:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983222912 00002000:00100000:3.0:1746066756.254753:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1982464->1986559) req@ffff880093ccdc00 x1830882983222912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.254770:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdc00 with x1830882983222912 ext(1982464->1986559) 00002000:00010000:3.0:1746066756.254775:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccdc00 00000100:00100000:3.0:1746066756.254807:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4243 00000100:00100000:3.0:1746066756.254822:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983222912:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066756.255013:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983222912:12345-192.168.204.16@tcp:3:cat.0 Request processed in 189us (429us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066756.255020:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4243 00002000:00100000:3.0:1746066756.255027:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1982464->1986559) req@ffff880093ccdc00 x1830882983222912/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.255033:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccdc00 with x1830882983222912 ext(1982464->1986559) 00002000:00010000:3.0:1746066756.255036:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccdc00 00000100:00100000:0.0:1746066756.352644:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.352708:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.352818:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983223040 00000100:00100000:2.0:1746066756.352829:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983223040 00000100:00100000:2.0:1746066756.353574:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983223168 00000100:00100000:2.0:1746066756.353578:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983223168 00000100:00100000:1.0:1746066756.353640:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15957 00000100:00100000:1.0:1746066756.353651:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983223040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.353672:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.353694:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d184d expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.353756:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984449920:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066756.353838:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.354191:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15958 00000100:00100000:3.0:1746066756.354199:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983223168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.354206:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.354215:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1854 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.354228:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.354230:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.354238:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.354252:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.354267:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0153e00, rc 0) 00000100:00100000:3.0:1746066756.354294:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983223168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 97us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.354300:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15958 00000100:00100000:1.0:1746066756.356671:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984449920:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066756.356705:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71b8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d184d expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.356718:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d184d expref: 30 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.356774:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507000, rc 0) 00000100:00100000:1.0:1746066756.357141:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983223040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3490us (4506us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.357148:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15957 00000100:00100000:0.0:1746066756.362038:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.362271:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983223296 00000100:00100000:1.0:1746066756.362280:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983223296 00000100:00100000:1.0:1746066756.362343:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15959 00000100:00100000:1.0:1746066756.362351:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+29:671:x1830882983223296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.362371:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.362389:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d185b expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.362423:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.362430:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.362432:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.362435:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.362491:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 40 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.362655:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 40 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.362670:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984450048:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.362769:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.366833:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.367051:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983223424 00000100:00100000:3.0:1746066756.367060:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983223424 00002000:00100000:3.0:1746066756.367110:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1286144->1986559) req@ffff8800958aca80 x1830882983223424/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.367121:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aca80 with x1830882983223424 ext(1286144->1986559) 00010000:00010000:3.0:1746066756.367131:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 41 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.367146:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 41 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746066756.367153:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958aca80 00000100:00100000:3.0:1746066756.367176:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 947 00000100:00100000:3.0:1746066756.367184:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+41:2016:x1830882983223424:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066756.367923:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984450048:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.367952:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.367968:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507a00, rc 0) 00000100:00100000:1.0:1746066756.369479:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+30:671:x1830882983223296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7123us (7445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.369498:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15959 00000100:00100000:3.0:1746066756.374002:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983223424:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6809us (7171us total) trans 17179874416 rc 0/0 00000100:00100000:3.0:1746066756.374012:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 947 00002000:00100000:3.0:1746066756.374023:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1286144->1986559) req@ffff8800958aca80 x1830882983223424/t17179874416(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.374034:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958aca80 with x1830882983223424 ext(1286144->1986559) 00010000:00010000:3.0:1746066756.374044:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 43 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.374056:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 43 pid: 9592 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746066756.374061:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800958aca80 00000100:00100000:1.0:1746066756.378668:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.378756:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983223552 00000100:00100000:2.0:1746066756.378766:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983223552 00010000:00010000:2.0:1746066756.378807:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 43 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.379224:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7180 00000100:00100000:2.0:1746066756.379233:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+43:2015:x1830882983223552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.379250:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066756.379271:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 43 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.379284:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 43 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.379311:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70400/0xf1867c21abfa71a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1286144->1986559) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1838 expref: 43 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.379332:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.379333:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.379341:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.379353:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.379387:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.379400:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984450176:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066756.381142:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.382042:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.382206:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983223680 00000100:00100000:1.0:1746066756.382214:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983223680 00000100:00100000:1.0:1746066756.382259:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15960 00000100:00100000:1.0:1746066756.382265:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+30:668:x1830882983223680:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066756.382283:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.382301:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1862 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.382329:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 42 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.382339:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.382346:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.382348:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.382352:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2985984->3145727] (req 2985984->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.382494:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984450176:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.382512:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066756.382567:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 31 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.382581:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 31 pid: 9592 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066756.382594:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984450304:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.382689:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2015:x1830882983223552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3456us (4029us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.382699:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7180 00010000:00010000:1.0:1746066756.383033:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 41 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.383146:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 41 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.383154:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984450432:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.383178:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.386505:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.386757:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.386808:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984450304:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.386841:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983223936 00000100:00100000:3.0:1746066756.386849:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983223936 00002000:00100000:3.0:1746066756.386922:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880093ccf480 x1830882983223936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.386932:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccf480 with x1830882983223936 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.386937:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccf480 00000100:00100000:3.0:1746066756.386970:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4244 00000100:00100000:3.0:1746066756.386979:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983223936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066756.387234:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.387261:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983224064 00000100:00100000:2.0:1746066756.387264:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983224064 00000100:00100000:0.0:1746066756.387276:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983224192 00000100:00100000:0.0:1746066756.387281:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983224192 00010000:00010000:2.0:1746066756.387286:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 33 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746066756.387301:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 42 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.387307:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7181 00000100:00100000:2.0:1746066756.387312:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:2014:x1830882983224064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.387321:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066756.387322:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7182 00000100:00100000:0.0:1746066756.387328:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983224192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.387335:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 33 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746066756.387336:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066756.387346:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 33 pid: 9592 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066756.387395:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984450432:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066756.387460:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 42 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.387474:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0153e00/0xf1867c21abfa71bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1854 expref: 33 pid: 9592 timeout: 824 lvb_type: 1 00010000:00010000:0.0:1746066756.387474:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 42 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746066756.387503:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa719c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1831 expref: 42 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.387504:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.387507:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.387513:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.387521:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.387530:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066756.387553:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.387564:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984450560:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066756.387571:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+41:2014:x1830882983224192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 242us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066756.387577:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7182 00000100:00100000:2.0:1746066756.387611:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00010000:00010000:1.0:1746066756.387766:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 33 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.387775:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093506200, rc 0) 00000100:00100000:1.0:1746066756.387810:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+33:668:x1830882983223680:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5545us (5774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.387820:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15960 00000100:00100000:2.0:1746066756.392658:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984450560:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066756.392680:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.392726:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983224064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5411us (5967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.392737:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7181 00000100:00100000:0.0:1746066756.392922:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.393191:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983224448 00000100:00100000:1.0:1746066756.393199:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983224448 00002000:00100000:1.0:1746066756.393239:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2985984->2990079) req@ffff880135d62d80 x1830882983224448/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.393248:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62d80 with x1830882983224448 ext(2985984->2990079) 00002000:00010000:1.0:1746066756.393253:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d62d80 00000100:00100000:1.0:1746066756.393280:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4245 00000100:00100000:1.0:1746066756.393288:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983224448:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066756.393330:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983223936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6352us (6848us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066756.393336:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4244 00002000:00100000:3.0:1746066756.393341:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880093ccf480 x1830882983223936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.393348:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ccf480 with x1830882983223936 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.393351:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ccf480 00000100:00100000:1.0:1746066756.393392:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983224448:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 105us (472us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066756.393398:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4245 00002000:00100000:1.0:1746066756.393402:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2985984->2990079) req@ffff880135d62d80 x1830882983224448/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.393408:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62d80 with x1830882983224448 ext(2985984->2990079) 00002000:00010000:1.0:1746066756.393411:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d62d80 00000100:00100000:0.0:1746066756.397286:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.397394:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.397466:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983224576 00000100:00100000:3.0:1746066756.397477:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983224576 00000100:00100000:1.0:1746066756.397490:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983224704 00000100:00100000:1.0:1746066756.397494:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983224704 00000100:00100000:3.0:1746066756.397535:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16291 00000100:00100000:1.0:1746066756.397535:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15961 00000100:00100000:3.0:1746066756.397542:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:674:x1830882983224576:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746066756.397542:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+30:668:x1830882983224704:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066756.397560:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.397560:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.397577:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfa71d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1869 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.397577:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1870 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.397610:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.397618:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.397624:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.397625:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.397628:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3706879] (req 3145728->3706879) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.397633:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066756.397643:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066756.397652:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066756.397657:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.397663:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066756.397667:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066756.397668:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 43 pid: 11630 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746066756.397672:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066756.397681:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984450688:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.397742:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066756.397753:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 58 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.397759:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.397761:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 31 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.397764:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066756.397768:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.397775:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984450816:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.397779:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 41 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.397786:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 41 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.397792:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096208000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.397793:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984450944:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.397817:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 58 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.397825:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 58 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.397831:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984451072:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.397845:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00080000:0.0:1746066756.397939:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066756.401739:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984450944:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.401752:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984451072:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.401779:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066756.401976:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984450688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.401990:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984450816:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.402014:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3706879] (req 3145728->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 31 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.402030:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f77800, rc 0) 00000100:00100000:1.0:1746066756.402463:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+31:668:x1830882983224704:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4919us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.402471:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15961 00000100:00100000:0.0:1746066756.403457:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.403497:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.403565:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.403842:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983224960 00000100:00100000:1.0:1746066756.403852:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983224960 00010000:00010000:1.0:1746066756.403934:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 42 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.403965:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983224832 00000100:00100000:1.0:1746066756.403970:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983224832 00010000:00010000:1.0:1746066756.403986:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 44 pid: 11630 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066756.404003:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983225088 00000100:00100000:1.0:1746066756.404007:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983225088 00010000:00010000:1.0:1746066756.404020:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 59 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.404037:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7183 00000100:00100000:1.0:1746066756.404043:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+42:2016:x1830882983224960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.404061:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.404066:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 42 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.404076:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 42 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.404098:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9c200/0xf1867c21abfa7141 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17dd expref: 42 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.404118:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066756.404123:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066756.404132:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066756.404137:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066756.404143:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.404188:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+41:2016:x1830882983224960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.404195:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7183 00000100:00100000:1.0:1746066756.404212:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7184 00000100:00100000:1.0:1746066756.404218:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983224832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.404228:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.404253:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 44 pid: 11630 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066756.404267:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 44 pid: 11630 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066756.404282:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa7195 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1823 expref: 44 pid: 11630 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066756.404296:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.404318:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+43:2016:x1830882983224832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.404324:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7184 00000100:00100000:2.0:1746066756.404341:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7185 00000100:00100000:2.0:1746066756.404350:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+59:2016:x1830882983225088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.404359:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066756.404365:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 59 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.404374:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 59 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.404387:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a575b800/0xf1867c21abfa7125 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17cf expref: 59 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.404400:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066756.404403:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404409:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404416:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404435:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.404453:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+58:2016:x1830882983225088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.404459:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7185 00010000:00010000:2.0:1746066756.404533:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404541:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066756.404596:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:2.0:1746066756.404600:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:0.0:1746066756.404612:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1746066756.404620:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404630:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404643:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404648:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404654:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404659:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404665:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0152200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066756.404669:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404676:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404683:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066756.404686:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066756.404690:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404694:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa71e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404703:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404707:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404713:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404716:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0152600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066756.404719:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404722:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404727:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096922700) 00010000:00010000:2.0:1746066756.404730:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066756.404732:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404736:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152600/0xf1867c21abfa71e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.404766:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153e00/0xf1867c21abfa71d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.404777:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.404782:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066756.404784:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066756.404786:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7600, rc 0) 00000100:00100000:2.0:1746066756.404810:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:674:x1830882983224576:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 7269us (7538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.404816:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16291 00000100:00100000:0.0:1746066756.406216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.407218:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.407657:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983225472 00000100:00100000:1.0:1746066756.407667:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983225472 00002000:00100000:1.0:1746066756.407721:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2985983) req@ffff880135d61180 x1830882983225472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.407733:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d61180 with x1830882983225472 ext(2097152->2985983) 00002000:00010000:1.0:1746066756.407739:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d61180 00000100:00100000:1.0:1746066756.407791:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4246 00000100:00100000:1.0:1746066756.407802:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983225472:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066756.408507:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983225216 00000100:00100000:3.0:1746066756.408512:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983225216 00010000:00010000:3.0:1746066756.408534:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.408556:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7186 00000100:00100000:3.0:1746066756.408562:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+31:2016:x1830882983225216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.408574:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.408595:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.408607:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.408632:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093506400/0xf1867c21abfa7180 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1815 expref: 31 pid: 9592 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.408656:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.408658:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.408666:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.408676:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.408716:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 30 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.408732:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984451200:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.408846:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.409067:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.409088:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.409101:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.409137:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.410073:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983225600 00000100:00100000:1.0:1746066756.410077:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983225600 00000100:00100000:1.0:1746066756.410111:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983225856 00000100:00100000:1.0:1746066756.410113:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983225856 00000100:00100000:1.0:1746066756.410126:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983225728 00000100:00100000:1.0:1746066756.410128:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983225728 00000100:00100000:1.0:1746066756.410143:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983225984 00000100:00100000:1.0:1746066756.410145:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983225984 00000100:00100000:1.0:1746066756.410166:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15962 00000100:00100000:1.0:1746066756.410174:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983225600:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066756.410192:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.410209:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1877 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.410294:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15963 00000100:00100000:3.0:1746066756.410303:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882983225856:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066756.410314:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.410324:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa71fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1885 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.410363:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984451328:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066756.410400:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.410418:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15964 00000100:00100000:3.0:1746066756.410423:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983225728:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066756.410428:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.410434:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d187e expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.410445:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.410447:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.410452:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.410463:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.410478:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6600, rc 0) 00000100:00100000:3.0:1746066756.410505:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882983225728:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 83us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.410510:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15964 00000100:00100000:3.0:1746066756.410525:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15965 00000100:00100000:3.0:1746066756.410529:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983225984:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066756.410533:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.410538:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa720c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d188c expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.410556:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984451456:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066756.410572:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066756.412302:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.412304:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.412320:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.412337:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 11 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.412350:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093507000, rc 0) 00000100:00100000:1.0:1746066756.412401:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882983225600:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2228us (3335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.412408:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15962 00000100:00080000:1.0:1746066756.412436:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746066756.412440:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066756.413787:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984451200:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.413806:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.413838:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983225216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5274us (7625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.413847:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7186 00000100:00100000:1.0:1746066756.419110:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983225472:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11297us (11879us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746066756.419122:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4246 00002000:00100000:1.0:1746066756.419136:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2985983) req@ffff880135d61180 x1830882983225472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.419145:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d61180 with x1830882983225472 ext(2097152->2985983) 00002000:00010000:1.0:1746066756.419150:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d61180 00000100:00100000:3.0:1746066756.419349:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984451328:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066756.419383:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa71fe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1885 expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.419397:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa71fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1885 expref: 16 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.419417:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6a00, rc 0) 00000100:00100000:3.0:1746066756.419443:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882983225856:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9142us (10353us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066756.419449:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15963 00000100:00100000:2.0:1746066756.419717:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984451456:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.419732:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa720c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d188c expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.419742:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa720c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d188c expref: 10 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.419763:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00000100:00100000:2.0:1746066756.419783:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983225984:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9252us (10644us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.419788:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15965 00000100:00100000:1.0:1746066756.420272:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.421357:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983226240 00000100:00100000:0.0:1746066756.421366:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983226240 00002000:00100000:0.0:1746066756.421406:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3702784->3706879) req@ffff88012c492d80 x1830882983226240/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.421420:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492d80 with x1830882983226240 ext(3702784->3706879) 00002000:00010000:0.0:1746066756.421425:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c492d80 00000100:00100000:0.0:1746066756.421452:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4247 00000100:00100000:0.0:1746066756.421458:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983226240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066756.421652:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983226240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 193us (1380us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066756.421658:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4247 00002000:00100000:0.0:1746066756.421664:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3702784->3706879) req@ffff88012c492d80 x1830882983226240/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.421671:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492d80 with x1830882983226240 ext(3702784->3706879) 00002000:00010000:0.0:1746066756.421673:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c492d80 00000100:00100000:1.0:1746066756.422345:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.422383:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983226496 00000100:00100000:2.0:1746066756.422387:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983226496 00000100:00100000:2.0:1746066756.422429:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16292 00000100:00100000:2.0:1746066756.422435:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:674:x1830882983226496:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066756.422448:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.422466:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428e00/0xf1867c21abfa7213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1893 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.422583:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.422598:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.422608:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.422638:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.422650:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 15 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.422662:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984451584:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066756.424184:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.427248:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.428575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.428608:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.428644:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.428672:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983227136 00000100:00100000:0.0:1746066756.428681:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983227136 00002000:00100000:0.0:1746066756.428729:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3706880->4194303) req@ffff880135d62a00 x1830882983227136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.428739:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62a00 with x1830882983227136 ext(3706880->4194303) 00002000:00010000:0.0:1746066756.428746:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d62a00 00000100:00100000:0.0:1746066756.428763:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983227392 00000100:00100000:0.0:1746066756.428765:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983227392 00002000:00100000:0.0:1746066756.428778:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880135d60000 x1830882983227392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.428786:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d60000 with x1830882983227392 ext(3145728->4194303) 00002000:00010000:0.0:1746066756.428789:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d60000 00000100:00100000:0.0:1746066756.428803:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4248 00000100:00100000:0.0:1746066756.428811:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983227136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.429696:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984451584:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066756.429721:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066756.429749:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4249 00000100:00100000:2.0:1746066756.429756:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983227392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066756.430449:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983226880 00000100:00100000:3.0:1746066756.430454:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983226880 00010000:00010000:3.0:1746066756.430479:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 16 pid: 7244 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.430516:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7187 00000100:00100000:3.0:1746066756.430522:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983226880:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.430532:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.430537:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 16 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.430547:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 16 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.430568:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c7600/0xf1867c21abfa71f0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1869 expref: 16 pid: 7244 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.430593:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066756.430598:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066756.430609:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066756.430616:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066756.430632:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.430967:0:11615:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983226752 00000100:00100000:1.0:1746066756.430971:0:11615:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983226752 00000100:00100000:1.0:1746066756.431000:0:11615:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5943 00000100:00100000:1.0:1746066756.431005:0:11615:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+41:668:x1830882983226752:12345-192.168.204.16@tcp:35:multiop.0 00010000:00010000:2.0:1746066756.433391:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.433403:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066756.433425:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066756.433546:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e428e00/0xf1867c21abfa7213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1893 expref: 17 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.433724:0:11615:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e2051f12-252a-4bb3-b8f3-833317fca821+42:668:x1830882983226752:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 2716us (6489us total) trans 8589936623 rc 0/0 00000100:00100000:1.0:1746066756.433735:0:11615:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5943 00010000:00010000:2.0:1746066756.435792:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1893 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.435809:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066756.435811:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066756.435815:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429c00, rc 0) 00000100:00100000:2.0:1746066756.435875:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:674:x1830882983226496:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 13438us (13529us total) trans 8589936624 rc 0/0 00000100:00100000:2.0:1746066756.435897:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16292 00000100:00100000:3.0:1746066756.437607:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983226880:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7076us (9025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.437620:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7187 00000100:00100000:2.0:1746066756.443195:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983227136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14372us (14573us total) trans 0 rc 487424/487424 00000100:00100000:2.0:1746066756.443207:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4248 00002000:00100000:2.0:1746066756.443220:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3706880->4194303) req@ffff880135d62a00 x1830882983227136/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 487424/487424 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.443231:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d62a00 with x1830882983227136 ext(3706880->4194303) 00002000:00010000:2.0:1746066756.443237:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d62a00 00000100:00100000:2.0:1746066756.446293:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983227392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16525us (17635us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066756.446306:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4249 00002000:00100000:2.0:1746066756.446319:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880135d60000 x1830882983227392/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.446329:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d60000 with x1830882983227392 ext(3145728->4194303) 00002000:00010000:2.0:1746066756.446334:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d60000 00000100:00100000:2.0:1746066756.451946:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.452056:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983227648 00000100:00100000:0.0:1746066756.452067:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983227648 00000100:00100000:0.0:1746066756.452128:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16293 00000100:00100000:0.0:1746066756.452137:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:674:x1830882983227648:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066756.452184:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066756.452187:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746066756.452217:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e429c00/0xf1867c21abfa721a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1893 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.452249:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066756.452254:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066756.452267:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa7228 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d189a expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.452375:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452388:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452397:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452409:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452415:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452421:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452427:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097017600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066756.452431:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452438:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452445:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066756.452447:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746066756.452450:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452455:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097017600/0xf1867c21abfa722f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066756.452477:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa7228 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d189a expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.454929:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097016c00/0xf1867c21abfa7228 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d189a expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.454948:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097016c00, rc 0) 00000100:00100000:0.0:1746066756.455033:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:674:x1830882983227648:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2896us (3094us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066756.455042:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16293 00000100:00100000:0.0:1746066756.458656:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.459152:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983227904 00000100:00100000:2.0:1746066756.459165:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983227904 00002000:00100000:2.0:1746066756.459225:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880135d61500 x1830882983227904/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.459236:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d61500 with x1830882983227904 ext(4194304->5033983) 00002000:00010000:2.0:1746066756.459242:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d61500 00000100:00100000:2.0:1746066756.459274:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4250 00000100:00100000:2.0:1746066756.459283:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983227904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066756.465038:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.465145:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983228160 00000100:00100000:1.0:1746066756.465155:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983228160 00000100:00100000:1.0:1746066756.465224:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5944 00000100:00100000:1.0:1746066756.465232:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:674:x1830882983228160:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066756.465465:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:674:x1830882983228160:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 233us (436us total) trans 8589936625 rc 0/0 00000100:00100000:1.0:1746066756.465473:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5944 00000100:00100000:2.0:1746066756.466987:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983227904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7698us (8339us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066756.466996:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4250 00002000:00100000:2.0:1746066756.467006:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880135d61500 x1830882983227904/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.467015:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d61500 with x1830882983227904 ext(4194304->5033983) 00002000:00010000:2.0:1746066756.467021:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d61500 00000100:00100000:0.0:1746066756.481516:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.481584:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.481707:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983228288 00000100:00100000:2.0:1746066756.481718:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983228288 00000100:00100000:0.0:1746066756.481744:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.481828:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983228416 00000100:00100000:2.0:1746066756.481831:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983228416 00000100:00100000:3.0:1746066756.481842:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983228544 00000100:00100000:3.0:1746066756.481846:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983228544 00000100:00100000:2.0:1746066756.481848:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15966 00000100:00100000:1.0:1746066756.481855:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15967 00000100:00100000:2.0:1746066756.481856:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983228288:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066756.481865:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983228416:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066756.481873:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15968 00010000:00010000:2.0:1746066756.481875:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.481876:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066756.481878:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983228544:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.481907:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.481914:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa723d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18a8 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.481915:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa7244 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18af expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.481915:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18a1 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.481936:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.481938:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.481947:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 44 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.481962:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 44 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066756.481963:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984451840:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066756.481963:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984451712:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.481972:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e428a00, rc 0) 00000100:00100000:1.0:1746066756.482146:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.482372:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.482437:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983228288:12345-192.168.204.16@tcp:101:cat.0 Request processed in 580us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.482443:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15966 00000100:00100000:3.0:1746066756.486031:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984451840:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066756.486070:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984451712:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066756.486073:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa7244 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18af expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.486089:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa7244 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18af expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.486092:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa723d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a8 expref: 44 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.486102:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418600/0xf1867c21abfa723d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a8 expref: 44 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.486169:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6200, rc 0) 00010000:00010000:1.0:1746066756.486202:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418600, rc 0) 00000100:00100000:3.0:1746066756.486514:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983228544:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4633us (4768us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.486514:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983228416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4650us (4930us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.486522:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15967 00000100:00100000:3.0:1746066756.486601:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15968 00000100:00100000:0.0:1746066756.496248:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.496316:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983228800 00000100:00100000:2.0:1746066756.496326:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983228800 00002000:00100000:2.0:1746066756.496379:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098924a80 x1830882983228800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.496390:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924a80 with x1830882983228800 ext(1048576->2097151) 00002000:00010000:2.0:1746066756.496396:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924a80 00000100:00100000:2.0:1746066756.496457:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4251 00000100:00100000:2.0:1746066756.496466:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983228800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.504519:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+42:2014:x1830882983228800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8042us (8270us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066756.504532:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4251 00002000:00100000:2.0:1746066756.504544:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098924a80 x1830882983228800/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.504555:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924a80 with x1830882983228800 ext(1048576->2097151) 00002000:00010000:2.0:1746066756.504562:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924a80 00000100:00100000:0.0:1746066756.510768:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.510815:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.510873:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983228928 00000100:00100000:2.0:1746066756.510874:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983229056 00000100:00100000:1.0:1746066756.510897:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983228928 00000100:00100000:2.0:1746066756.510899:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983229056 00000100:00100000:2.0:1746066756.510940:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15969 00000100:00100000:1.0:1746066756.510946:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15970 00000100:00100000:2.0:1746066756.510948:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983229056:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066756.510952:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983228928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.510966:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.510966:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.510982:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfa7252 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18bd expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.510982:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfa724b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18b6 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.511031:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984452096:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066756.511032:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984451968:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.511101:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a00d8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066756.511109:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.513533:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984452096:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066756.513533:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984451968:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.513561:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfa7252 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18bd expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.513561:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfa724b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18b6 expref: 44 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.513572:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e429800/0xf1867c21abfa7252 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18bd expref: 43 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.513572:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419800/0xf1867c21abfa724b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18b6 expref: 44 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.513586:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e429800, rc 0) 00010000:00010000:1.0:1746066756.513590:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419800, rc 0) 00000100:00100000:2.0:1746066756.513634:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:2013:x1830882983229056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2686us (2817us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.513634:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:2013:x1830882983228928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2681us (2875us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.513641:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15969 00000100:00100000:1.0:1746066756.513645:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15970 00010000:00010000:2.0:1746066756.516419:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066756.518075:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.518150:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983229184 00000100:00100000:1.0:1746066756.518160:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983229184 00000100:00100000:1.0:1746066756.518224:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15971 00000100:00100000:1.0:1746066756.518232:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+43:680:x1830882983229184:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.518253:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.518270:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18c4 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.518301:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.518309:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.518311:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.518314:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.518343:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.518355:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 29 pid: 12237 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.518373:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984452224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.518464:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.523829:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.524000:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983229312 00000100:00100000:2.0:1746066756.524010:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983229312 00002000:00100000:2.0:1746066756.524063:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3706879) req@ffff880098924700 x1830882983229312/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.524074:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924700 with x1830882983229312 ext(3145728->3706879) 00010000:00010000:2.0:1746066756.524085:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 30 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.524099:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 30 pid: 12237 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.524106:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098924700 00000100:00100000:2.0:1746066756.524136:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 948 00000100:00100000:2.0:1746066756.524142:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983229312:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066756.524256:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984452224:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.524280:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.524294:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418200, rc 0) 00000100:00100000:1.0:1746066756.524316:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:680:x1830882983229184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6086us (6249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.524322:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15971 00000100:00100000:0.0:1746066756.530935:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.530998:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983229440 00000100:00100000:1.0:1746066756.531008:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983229440 00000100:00100000:1.0:1746066756.531070:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15972 00000100:00100000:1.0:1746066756.531079:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+44:673:x1830882983229440:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066756.531100:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.531118:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18cb expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.531146:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.531149:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.531152:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->4194303] (req 3862528->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 45 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.531164:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->4194303] (req 3862528->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 45 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.531179:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418800, rc 0) 00000100:00100000:1.0:1746066756.531223:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:673:x1830882983229440:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 146us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.531229:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15972 00000100:00100000:3.0:1746066756.537078:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983229312:12345-192.168.204.16@tcp:4:cat.0 Request processed in 12923us (13246us total) trans 21474841863 rc 0/0 00000100:00100000:3.0:1746066756.537093:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 948 00002000:00100000:3.0:1746066756.537106:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3706879) req@ffff880098924700 x1830882983229312/t21474841863(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.537113:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924700 with x1830882983229312 ext(3145728->3706879) 00010000:00010000:3.0:1746066756.537123:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.537137:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746066756.537142:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098924700 00000100:00100000:0.0:1746066756.543992:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.544526:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983229568 00000100:00100000:3.0:1746066756.544536:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983229568 00010000:00010000:3.0:1746066756.544574:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.544615:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7188 00000100:00100000:3.0:1746066756.544622:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983229568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.544637:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.544657:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.544675:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.544697:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f77800/0xf1867c21abfa71db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3706879) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1870 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.544725:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.544728:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.544736:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.544745:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.544753:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.544754:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.544756:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.544762:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.544790:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.544802:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984452352:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.544905:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 44 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.544912:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984452480:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.544938:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.550580:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984452480:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066756.550685:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.550733:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.550817:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983229824 00000100:00100000:2.0:1746066756.550825:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983229824 00000100:00100000:3.0:1746066756.550870:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984452352:192.168.204.16@tcp:105: 00002000:00100000:2.0:1746066756.550874:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3862528->3866623) req@ffff880098926d80 x1830882983229824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.550903:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882983229824 ext(3862528->3866623) 00002000:00010000:2.0:1746066756.550907:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926d80 00010000:00010000:3.0:1746066756.550910:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.550930:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983230080 00000100:00100000:2.0:1746066756.550932:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983230080 00002000:00100000:2.0:1746066756.550943:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098926a00 x1830882983230080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.550949:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926a00 with x1830882983230080 ext(2097152->3145727) 00002000:00010000:2.0:1746066756.550952:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926a00 00000100:00100000:2.0:1746066756.550963:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4252 00000100:00100000:3.0:1746066756.550968:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983229568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6344us (6984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.550968:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983229824:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066756.550977:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7188 00000100:00100000:3.0:1746066756.551011:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4253 00000100:00100000:3.0:1746066756.551016:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+46:2013:x1830882983230080:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066756.551089:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983229824:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 120us (405us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066756.551099:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4252 00002000:00100000:2.0:1746066756.551103:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3862528->3866623) req@ffff880098926d80 x1830882983229824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.551111:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926d80 with x1830882983229824 ext(3862528->3866623) 00002000:00010000:2.0:1746066756.551113:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926d80 00000100:00100000:0.0:1746066756.558368:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.558437:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983230208 00000100:00100000:3.0:1746066756.558447:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983230208 00000100:00100000:3.0:1746066756.558520:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15973 00000100:00100000:3.0:1746066756.558529:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:673:x1830882983230208:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066756.558551:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.558570:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18d2 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.558601:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.558607:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.558609:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.558613:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->3801087] (req 3145728->3801087) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.558644:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.558656:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 29 pid: 12237 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.558668:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984452608:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.558880:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.560380:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882983230080:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9357us (9640us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066756.560390:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4253 00002000:00100000:3.0:1746066756.560402:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098926a00 x1830882983230080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.560411:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098926a00 with x1830882983230080 ext(2097152->3145727) 00002000:00010000:3.0:1746066756.560417:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098926a00 00000100:00100000:0.0:1746066756.562616:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.562786:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984452608:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.562816:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->3801087] (req 3145728->3801087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.562836:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6000, rc 0) 00000100:00100000:3.0:1746066756.562908:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:673:x1830882983230208:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4355us (4581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.562918:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15973 00000100:00100000:2.0:1746066756.563272:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983230336 00000100:00100000:2.0:1746066756.563282:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983230336 00002000:00100000:2.0:1746066756.563326:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2985984->3145727) req@ffff880098927480 x1830882983230336/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.563336:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927480 with x1830882983230336 ext(2985984->3145727) 00010000:00010000:2.0:1746066756.563342:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 30 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.563356:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 30 pid: 12237 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.563362:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098927480 00000100:00100000:2.0:1746066756.563380:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 949 00000100:00100000:2.0:1746066756.563387:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983230336:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066756.569125:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.569220:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983230464 00000100:00100000:2.0:1746066756.569236:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983230336:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5849us (6630us total) trans 17179874417 rc 0/0 00000100:00100000:2.0:1746066756.569248:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 949 00002000:00100000:2.0:1746066756.569260:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2985984->3145727) req@ffff880098927480 x1830882983230336/t17179874417(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.569274:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098927480 with x1830882983230336 ext(2985984->3145727) 00010000:00010000:2.0:1746066756.569285:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.569299:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.569305:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098927480 00000100:00100000:3.0:1746066756.569332:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983230464 00000100:00100000:3.0:1746066756.569383:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15974 00000100:00100000:3.0:1746066756.569391:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+43:680:x1830882983230464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.569406:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.569421:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18d9 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.569444:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.569446:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.569450:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.569461:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 44 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.569470:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6200, rc 0) 00000100:00100000:3.0:1746066756.569511:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:680:x1830882983230464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 121us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.569516:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15974 00000100:00100000:0.0:1746066756.578453:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.578628:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983230592 00000100:00100000:3.0:1746066756.578636:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983230592 00010000:00010000:3.0:1746066756.578668:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.578773:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7189 00000100:00100000:3.0:1746066756.578782:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983230592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.578797:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.578812:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.578824:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.578841:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093506200/0xf1867c21abfa71cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2985984->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1862 expref: 32 pid: 12237 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.579104:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.579107:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.579114:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.579122:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.579130:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.579131:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.579134:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.579141:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.579167:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.579179:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984452736:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.579419:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.579427:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984452864:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.579448:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066756.584242:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.584298:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983230848 00000100:00100000:2.0:1746066756.584306:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983230848 00002000:00100000:2.0:1746066756.584341:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012c491880 x1830882983230848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.584351:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491880 with x1830882983230848 ext(2097152->3145727) 00002000:00010000:2.0:1746066756.584355:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491880 00000100:00100000:2.0:1746066756.584379:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4254 00000100:00100000:2.0:1746066756.584385:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983230848:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066756.585389:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984452736:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.585400:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984452864:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.585416:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.585456:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983230592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6674us (7009us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.585464:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7189 00000100:00100000:0.0:1746066756.589425:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.589513:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983231104 00000100:00100000:2.0:1746066756.589524:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983231104 00002000:00100000:2.0:1746066756.589562:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3796992->3801087) req@ffff880098924e00 x1830882983231104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.589571:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924e00 with x1830882983231104 ext(3796992->3801087) 00002000:00010000:2.0:1746066756.589576:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924e00 00000100:00100000:2.0:1746066756.589613:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4255 00000100:00100000:2.0:1746066756.589620:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983231104:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066756.589746:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983231104:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 126us (332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066756.589751:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4255 00002000:00100000:2.0:1746066756.589756:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7a:0x0] (3796992->3801087) req@ffff880098924e00 x1830882983231104/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.589764:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098924e00 with x1830882983231104 ext(3796992->3801087) 00002000:00010000:2.0:1746066756.589766:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098924e00 00000100:00100000:2.0:1746066756.590239:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983230848:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 5854us (6004us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066756.590245:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4254 00002000:00100000:2.0:1746066756.590250:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88012c491880 x1830882983230848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.590257:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491880 with x1830882983230848 ext(2097152->3145727) 00002000:00010000:2.0:1746066756.590260:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c491880 00000100:00100000:0.0:1746066756.597621:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.597689:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.597738:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983231488 00000100:00100000:3.0:1746066756.597746:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983231488 00000100:00100000:1.0:1746066756.597795:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983231360 00000100:00100000:1.0:1746066756.597799:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983231360 00000100:00100000:1.0:1746066756.597936:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5945 00000100:00100000:1.0:1746066756.597944:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+58:673:x1830882983231360:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066756.597947:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15975 00000100:00100000:3.0:1746066756.597954:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+45:680:x1830882983231488:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.597966:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.597980:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18e0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.598000:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 46 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.598012:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.598013:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.598017:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.598039:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 46 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.598050:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 46 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.598060:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984452992:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.598129:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066756.598148:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+59:673:x1830882983231360:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 205us (466us total) trans 8589936626 rc 0/0 00000100:00100000:1.0:1746066756.598155:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5945 00000100:00100000:3.0:1746066756.600846:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984452992:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.600877:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 46 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.600921:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00000100:00100000:3.0:1746066756.600951:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+46:680:x1830882983231488:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2997us (3336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.600958:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15975 00000100:00100000:0.0:1746066756.601646:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.601745:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983231616 00000100:00100000:2.0:1746066756.601753:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983231616 00002000:00100000:2.0:1746066756.601795:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3862528->4194303) req@ffff88012e422a00 x1830882983231616/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.601805:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422a00 with x1830882983231616 ext(3862528->4194303) 00010000:00010000:2.0:1746066756.601813:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 46 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.601826:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 46 pid: 9590 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.601838:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e422a00 00000100:00100000:2.0:1746066756.601867:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 950 00000100:00100000:2.0:1746066756.601875:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983231616:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066756.605542:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983231616:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3656us (3891us total) trans 21474841864 rc 0/0 00000100:00100000:2.0:1746066756.605553:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 950 00002000:00100000:2.0:1746066756.605564:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3862528->4194303) req@ffff88012e422a00 x1830882983231616/t21474841864(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.605574:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e422a00 with x1830882983231616 ext(3862528->4194303) 00010000:00010000:2.0:1746066756.605584:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 48 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.605599:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 48 pid: 9590 timeout: 824 lvb_type: 0 00002000:00010000:2.0:1746066756.605606:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e422a00 00000100:00100000:0.0:1746066756.608211:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.608308:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983231744 00000100:00100000:3.0:1746066756.608319:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983231744 00010000:00010000:3.0:1746066756.608371:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 48 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.608436:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7190 00000100:00100000:3.0:1746066756.608443:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882983231744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.608458:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.608475:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 48 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.608501:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 48 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.608520:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7260 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [3862528->18446744073709551615] (req 3862528->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18cb expref: 48 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.608546:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.608548:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.608554:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.608561:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.608759:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.608770:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984453120:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.609232:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.611616:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984453120:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.611633:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.611663:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882983231744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3220us (3461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.611672:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7190 00000100:00100000:0.0:1746066756.614350:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.614393:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.614537:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983232128 00000100:00100000:1.0:1746066756.614544:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983232128 00000100:00100000:2.0:1746066756.614581:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983232256 00002000:00100000:1.0:1746066756.614582:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3801088->4194303) req@ffff88012e421f80 x1830882983232128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066756.614584:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983232256 00002000:00100000:1.0:1746066756.614592:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421f80 with x1830882983232128 ext(3801088->4194303) 00002000:00010000:1.0:1746066756.614597:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421f80 00002000:00100000:2.0:1746066756.614600:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012e421180 x1830882983232256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.614606:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882983232256 ext(3145728->4194303) 00002000:00010000:2.0:1746066756.614609:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421180 00000100:00100000:1.0:1746066756.614626:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4256 00000100:00100000:2.0:1746066756.614631:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4257 00000100:00100000:1.0:1746066756.614633:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983232128:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066756.614635:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983232256:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066756.623196:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983232256:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8553us (8796us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066756.623200:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983232128:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8556us (8844us total) trans 0 rc 393216/393216 00000100:00100000:2.0:1746066756.623206:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4257 00000100:00100000:1.0:1746066756.623210:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4256 00002000:00100000:2.0:1746066756.623217:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012e421180 x1830882983232256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.623217:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3801088->4194303) req@ffff88012e421f80 x1830882983232128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 393216/393216 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.623226:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421180 with x1830882983232256 ext(3145728->4194303) 00002000:00100000:1.0:1746066756.623226:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e421f80 with x1830882983232128 ext(3801088->4194303) 00002000:00010000:2.0:1746066756.623231:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e421180 00002000:00010000:1.0:1746066756.623231:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e421f80 00000100:00100000:0.0:1746066756.628178:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.628239:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983232384 00000100:00100000:3.0:1746066756.628247:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983232384 00000100:00100000:3.0:1746066756.628295:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15976 00000100:00100000:3.0:1746066756.628304:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983232384:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.628320:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.628334:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa727c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18e7 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.628381:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984453248:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066756.628472:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.629669:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984453248:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066756.629685:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa727c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e7 expref: 45 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.629693:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa727c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e7 expref: 45 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.629712:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6e00, rc 0) 00000100:00100000:3.0:1746066756.629744:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983232384:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1441us (1571us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066756.629750:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15976 00000100:00100000:0.0:1746066756.632612:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.632685:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983232640 00000100:00100000:1.0:1746066756.632692:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983232640 00002000:00100000:1.0:1746066756.632726:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012e423100 x1830882983232640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.632735:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423100 with x1830882983232640 ext(4194304->5033983) 00002000:00010000:1.0:1746066756.632740:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423100 00000100:00100000:1.0:1746066756.632815:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4258 00000100:00100000:1.0:1746066756.632824:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882983232640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.637144:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882983232640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4313us (4530us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066756.637154:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4258 00002000:00100000:1.0:1746066756.637165:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012e423100 x1830882983232640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.637174:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e423100 with x1830882983232640 ext(4194304->5033983) 00002000:00010000:1.0:1746066756.637180:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e423100 00000100:00100000:0.0:1746066756.641626:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.642048:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983232768 00000100:00100000:3.0:1746066756.642057:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983232768 00000100:00100000:3.0:1746066756.642105:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15977 00000100:00100000:3.0:1746066756.642113:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983232768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.642128:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.642145:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7600/0xf1867c21abfa7283 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18ee expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.642191:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984453376:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066756.642801:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.644733:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984453376:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066756.644767:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7600/0xf1867c21abfa7283 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18ee expref: 45 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.644779:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7600/0xf1867c21abfa7283 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18ee expref: 45 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.644809:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7600, rc 0) 00000100:00100000:3.0:1746066756.644861:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983232768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2748us (3242us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066756.644868:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15977 00000100:00100000:0.0:1746066756.646867:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.646978:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983232896 00000100:00100000:3.0:1746066756.646987:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983232896 00000100:00100000:3.0:1746066756.647124:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15978 00000100:00100000:3.0:1746066756.647131:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983232896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.647150:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.647166:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7a00/0xf1867c21abfa728a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18f5 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.647214:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984453504:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066756.647305:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.649265:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984453504:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066756.649296:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7a00/0xf1867c21abfa728a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18f5 expref: 45 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.649308:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7a00/0xf1867c21abfa728a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18f5 expref: 45 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.649335:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7a00, rc 0) 00000100:00100000:3.0:1746066756.649375:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983232896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2243us (2513us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066756.649383:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15978 00000100:00100000:0.0:1746066756.668383:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.668631:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983233152 00000100:00100000:2.0:1746066756.668641:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983233152 00000100:00100000:2.0:1746066756.668695:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16294 00000100:00100000:2.0:1746066756.668704:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+42:684:x1830882983233152:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066756.668730:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.668750:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa7291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d18fc expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.668861:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.668876:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066756.668921:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066756.668932:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:2.0:1746066756.669033:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0152200/0xf1867c21abfa7291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 45 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.669075:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 44 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.669083:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066756.669086:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066756.669089:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0153a00, rc 0) 00000100:00100000:2.0:1746066756.670091:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+44:684:x1830882983233152:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1177us (1509us total) trans 8589936627 rc 0/0 00000100:00100000:2.0:1746066756.670099:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16294 00000100:00100000:0.0:1746066756.692566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.692643:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983233280 00000100:00100000:3.0:1746066756.692654:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983233280 00000100:00100000:0.0:1746066756.692666:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.692755:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983233408 00000100:00100000:3.0:1746066756.692758:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983233408 00000100:00100000:3.0:1746066756.692790:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15979 00000100:00100000:3.0:1746066756.692803:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983233280:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.692826:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.692847:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1903 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.692868:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15980 00010000:00010000:3.0:1746066756.692876:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066756.692877:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882983233408:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.692879:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.692904:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.692906:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.692915:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d0ce00/0xf1867c21abfa72ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d190a expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.692920:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 32 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.692931:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6a00, rc 0) 00000100:00100000:1.0:1746066756.692962:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984453632:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066756.692978:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983233280:12345-192.168.204.16@tcp:101:cat.0 Request processed in 180us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.692984:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15979 00000100:00100000:1.0:1746066756.693022:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.694723:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.694738:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984453632:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066756.694764:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d0ce00/0xf1867c21abfa72ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d190a expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.694775:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d0ce00/0xf1867c21abfa72ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d190a expref: 32 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.694791:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0ce00, rc 0) 00000100:00100000:1.0:1746066756.694819:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882983233408:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1943us (2152us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.694824:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15980 00000100:00100000:1.0:1746066756.695022:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983233536 00000100:00100000:1.0:1746066756.695027:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983233536 00000100:00100000:1.0:1746066756.695064:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15981 00000100:00100000:1.0:1746066756.695070:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:684:x1830882983233536:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066756.695079:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.695090:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1911 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.695108:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.695121:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.695128:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 46 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.695134:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.695136:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.695139:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.695159:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 46 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.695171:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 46 pid: 3528 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066756.695182:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984453760:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.695232:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.695239:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 14 pid: 3528 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066756.695246:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984453888:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.695268:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.695274:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 33 pid: 11630 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.695280:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454016:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.695291:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066756.696170:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984453760:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.698495:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984453888:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.698507:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454016:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.698540:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.698556:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0cc00, rc 0) 00000100:00100000:1.0:1746066756.698612:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:684:x1830882983233536:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3541us (3891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.698621:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15981 00000100:00100000:0.0:1746066756.699319:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.699359:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.699424:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983233664 00000100:00100000:1.0:1746066756.699431:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983233664 00010000:00010000:1.0:1746066756.699459:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 15 pid: 3528 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066756.699494:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983233792 00000100:00100000:1.0:1746066756.699497:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983233792 00010000:00010000:1.0:1746066756.699508:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 47 pid: 3528 timeout: 824 lvb_type: 1 00000100:00100000:2.0:1746066756.699516:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7191 00000100:00100000:2.0:1746066756.699524:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983233664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.699537:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066756.699559:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 15 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746066756.699569:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 15 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:2.0:1746066756.699591:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37a00/0xf1867c21abfa6f6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d16be expref: 15 pid: 3528 timeout: 824 lvb_type: 1 00000100:00100000:0.0:1746066756.699803:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066756.700117:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.700228:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983233664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 705us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.700235:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7191 00000100:00100000:1.0:1746066756.700299:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983233920 00000100:00100000:1.0:1746066756.700303:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983233920 00010000:00010000:1.0:1746066756.700317:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 33 pid: 11630 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.700332:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7192 00000100:00100000:1.0:1746066756.700337:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983233792:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.700345:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.700354:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 47 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066756.700362:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 47 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066756.700374:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa6c86 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1544 expref: 47 pid: 3528 timeout: 824 lvb_type: 1 00010000:00010000:1.0:1746066756.700382:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.700398:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095803b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983233792:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.700403:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7192 00000100:00100000:1.0:1746066756.700413:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7193 00000100:00100000:1.0:1746066756.700417:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983233920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066756.700423:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066756.700430:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 33 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.700653:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 33 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.700666:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d894a00/0xf1867c21abfa6bec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d14f7 expref: 33 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:1.0:1746066756.700675:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.700677:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.700683:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 32 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.700691:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 32 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.700720:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 32 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.700732:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984454144:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066756.700957:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.704414:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.704461:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983234176 00000100:00100000:0.0:1746066756.704470:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983234176 00002000:00100000:0.0:1746066756.704530:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1957888->1961983) req@ffff880094304380 x1830882983234176/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.704540:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830882983234176 ext(1957888->1961983) 00002000:00010000:0.0:1746066756.704546:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304380 00000100:00100000:1.0:1746066756.704564:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984454144:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066756.704567:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4259 00000100:00100000:0.0:1746066756.704574:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983234176:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:1.0:1746066756.704586:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066756.704628:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983233920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4209us (4824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.704637:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7193 00000100:00100000:0.0:1746066756.704704:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983234176:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 130us (300us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066756.704710:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4259 00002000:00100000:0.0:1746066756.704715:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1957888->1961983) req@ffff880094304380 x1830882983234176/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.704722:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094304380 with x1830882983234176 ext(1957888->1961983) 00002000:00010000:0.0:1746066756.704725:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094304380 00000100:00100000:0.0:1746066756.707141:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.707248:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.707313:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983234560 00000100:00100000:2.0:1746066756.707321:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983234560 00002000:00100000:2.0:1746066756.707360:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1957887) req@ffff880096fd7800 x1830882983234560/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.707368:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7800 with x1830882983234560 ext(1048576->1957887) 00002000:00010000:2.0:1746066756.707373:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd7800 00000100:00100000:2.0:1746066756.707390:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4260 00000100:00100000:2.0:1746066756.707397:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983234560:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.708047:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983234304 00000100:00100000:1.0:1746066756.708052:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983234304 00000100:00100000:1.0:1746066756.708098:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15982 00000100:00100000:1.0:1746066756.708109:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:684:x1830882983234304:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066756.708120:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.708137:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1918 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.708161:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 45 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.708169:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 45 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.708305:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 34 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.708312:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.708314:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.708317:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->2404351] (req 2097152->2404351) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.708347:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 34 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.708359:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 34 pid: 11630 timeout: 824 lvb_type: 1 00000100:00100000:1.0:1746066756.708375:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454272:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.708469:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 45 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.708486:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 45 pid: 11630 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.708494:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454400:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.708520:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 45 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.708528:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 45 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.708535:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454528:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.708553:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.711142:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.711178:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.711207:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983234688 00000100:00100000:1.0:1746066756.711216:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983234688 00000100:00100000:3.0:1746066756.711232:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983234816 00000100:00100000:3.0:1746066756.711236:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983234816 00010000:00010000:1.0:1746066756.711249:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 36 pid: 11630 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746066756.711254:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 46 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.711276:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7194 00000100:00100000:3.0:1746066756.711283:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983234816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.711448:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.711469:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 46 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.711493:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 46 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.711524:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.711562:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983234816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 278us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.711572:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7194 00000100:00100000:3.0:1746066756.711591:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7195 00000100:00100000:3.0:1746066756.711596:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983234688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.711604:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.711611:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 36 pid: 11630 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746066756.711621:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 36 pid: 11630 timeout: 824 lvb_type: 1 00010000:00010000:3.0:1746066756.711631:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.711644:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983234688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.711649:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7195 00010000:00010000:3.0:1746066756.711829:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6a00/0xf1867c21abfa72a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1903 expref: 35 pid: 11630 timeout: 824 lvb_type: 1 00000100:00100000:3.0:1746066756.711845:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454272:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.711855:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454400:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.711862:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418200/0xf1867c21abfa7259 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18c4 expref: 45 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.711869:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984454528:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.711921:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->2404351] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.711932:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d0c000, rc 0) 00000100:00100000:3.0:1746066756.711969:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:684:x1830882983234304:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3865us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.711975:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15982 00000100:00100000:0.0:1746066756.716678:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.716938:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983234944 00000100:00100000:3.0:1746066756.716948:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983234944 00010000:00010000:3.0:1746066756.716984:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 45 pid: 11630 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.717013:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7196 00000100:00100000:3.0:1746066756.717021:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983234944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.717037:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.717059:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 45 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.717072:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 45 pid: 11630 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.717123:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096fd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983234560:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9724us (9873us total) trans 0 rc 909312/909312 00000100:00100000:2.0:1746066756.717132:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4260 00002000:00100000:2.0:1746066756.717142:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1957887) req@ffff880096fd7800 x1830882983234560/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 909312/909312 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746066756.717150:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa7275 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18e0 expref: 45 pid: 11630 timeout: 824 lvb_type: 0 00002000:00100000:2.0:1746066756.717151:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096fd7800 with x1830882983234560 ext(1048576->1957887) 00002000:00010000:2.0:1746066756.717156:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096fd7800 00010000:00010000:3.0:1746066756.717165:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.717167:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.717174:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.717187:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.717219:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.717232:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984454656:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.718136:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.720593:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.720705:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.720824:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983235072 00000100:00100000:3.0:1746066756.720832:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983235072 00000100:00100000:3.0:1746066756.720877:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983235200 00000100:00100000:3.0:1746066756.720879:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983235200 00000100:00100000:0.0:1746066756.720916:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15983 00000100:00100000:0.0:1746066756.720925:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983235072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066756.720943:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066756.720960:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419600/0xf1867c21abfa72c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d191f expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.720963:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984454656:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066756.720983:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.720989:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15984 00000100:00100000:3.0:1746066756.720994:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882983235200:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.721001:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.721009:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa72c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1926 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066756.721013:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984454784:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.721027:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983234944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4006us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.721031:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984454912:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.721036:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7196 00000100:00100000:0.0:1746066756.721079:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.721133:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.723041:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.723122:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983235456 00000100:00100000:2.0:1746066756.723130:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983235456 00002000:00100000:2.0:1746066756.723166:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2400256->2404351) req@ffff88009d9b2a00 x1830882983235456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.723181:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2a00 with x1830882983235456 ext(2400256->2404351) 00002000:00010000:2.0:1746066756.723185:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b2a00 00000100:00100000:2.0:1746066756.723200:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4261 00000100:00100000:3.0:1746066756.723204:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984454912:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.723206:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983235456:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066756.723231:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa72c9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1926 expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.723243:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6800/0xf1867c21abfa72c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1926 expref: 32 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.723257:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6800, rc 0) 00000100:00100000:3.0:1746066756.723290:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882983235200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2295us (2585us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066756.723297:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15984 00000100:00100000:2.0:1746066756.723317:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983235456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 110us (283us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066756.723323:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4261 00002000:00100000:2.0:1746066756.723327:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2400256->2404351) req@ffff88009d9b2a00 x1830882983235456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.723338:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2a00 with x1830882983235456 ext(2400256->2404351) 00002000:00010000:2.0:1746066756.723341:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b2a00 00000100:00100000:1.0:1746066756.723385:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984454784:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066756.723410:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419600/0xf1867c21abfa72c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d191f expref: 33 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.723427:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419600/0xf1867c21abfa72c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d191f expref: 33 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.723445:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419600, rc 0) 00000100:00100000:1.0:1746066756.723497:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2014:x1830882983235072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2573us (2912us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.723504:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15983 00000100:00100000:0.0:1746066756.728921:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.728980:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983235712 00000100:00100000:2.0:1746066756.728987:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983235712 00002000:00100000:2.0:1746066756.729023:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2404352->3145727) req@ffff88009d9b0380 x1830882983235712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.729030:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0380 with x1830882983235712 ext(2404352->3145727) 00002000:00010000:2.0:1746066756.729033:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0380 00000100:00100000:2.0:1746066756.729056:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4262 00000100:00100000:2.0:1746066756.729061:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983235712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.734039:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983235712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4969us (5156us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746066756.734050:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4262 00002000:00100000:2.0:1746066756.734061:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2404352->3145727) req@ffff88009d9b0380 x1830882983235712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.734075:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0380 with x1830882983235712 ext(2404352->3145727) 00002000:00010000:2.0:1746066756.734080:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b0380 00000100:00100000:0.0:1746066756.738302:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.738431:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983235840 00000100:00100000:1.0:1746066756.738442:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983235840 00000100:00100000:1.0:1746066756.738514:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15985 00000100:00100000:1.0:1746066756.738522:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:687:x1830882983235840:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.738536:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.738552:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d192d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.738573:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.738575:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066756.738581:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.738593:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.738601:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5fc00, rc 0) 00000100:00100000:1.0:1746066756.738648:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:687:x1830882983235840:12345-192.168.204.16@tcp:101:cat.0 Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.738657:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15985 00000100:00100000:0.0:1746066756.745806:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.745864:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.746920:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983236096 00000100:00100000:3.0:1746066756.746925:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983236352 00000100:00100000:1.0:1746066756.746931:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983236096 00000100:00100000:3.0:1746066756.746933:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983236352 00002000:00100000:3.0:1746066756.746980:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009d9b3100 x1830882983236352/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.746982:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88009d9b1c00 x1830882983236096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.746991:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3100 with x1830882983236352 ext(3145728->4194303) 00002000:00100000:1.0:1746066756.746992:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882983236096 ext(2097152->3145727) 00002000:00010000:3.0:1746066756.746997:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b3100 00002000:00010000:1.0:1746066756.746997:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:3.0:1746066756.747039:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4263 00000100:00100000:1.0:1746066756.747048:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4264 00000100:00100000:1.0:1746066756.747055:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983236096:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066756.747058:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983236352:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.756354:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983236096:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9290us (10551us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066756.756366:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4264 00002000:00100000:1.0:1746066756.756377:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff88009d9b1c00 x1830882983236096/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.756386:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1c00 with x1830882983236096 ext(2097152->3145727) 00002000:00010000:1.0:1746066756.756391:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b1c00 00000100:00100000:3.0:1746066756.757474:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983236352:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10419us (11600us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066756.757494:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4263 00002000:00100000:3.0:1746066756.757504:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88009d9b3100 x1830882983236352/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.757512:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b3100 with x1830882983236352 ext(3145728->4194303) 00002000:00010000:3.0:1746066756.757518:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b3100 00000100:00100000:0.0:1746066756.763671:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.763843:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983236480 00000100:00100000:1.0:1746066756.763855:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983236480 00000100:00100000:1.0:1746066756.763953:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15986 00000100:00100000:1.0:1746066756.763962:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:687:x1830882983236480:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.763978:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.763993:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1934 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.764023:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.764029:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.764031:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066756.764034:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.764060:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.764070:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 43 pid: 11630 timeout: 824 lvb_type: 0 00000100:00100000:1.0:1746066756.764080:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984455040:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066756.764183:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066756.765248:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984455040:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066756.765270:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066756.765280:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5f600, rc 0) 00000100:00100000:1.0:1746066756.765326:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:687:x1830882983236480:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1365us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.765333:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15986 00000100:00100000:0.0:1746066756.766542:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.767470:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983236608 00000100:00100000:3.0:1746066756.767492:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983236608 00002000:00100000:3.0:1746066756.767559:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3801087) req@ffff8800967a8a80 x1830882983236608/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.767574:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882983236608 ext(3145728->3801087) 00010000:00010000:3.0:1746066756.767584:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 44 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:3.0:1746066756.767598:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 44 pid: 11630 timeout: 824 lvb_type: 0 00002000:00010000:3.0:1746066756.767606:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967a8a80 00000100:00100000:3.0:1746066756.767639:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 951 00000100:00100000:3.0:1746066756.767647:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983236608:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066756.770402:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.770493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.770558:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983236736 00000100:00100000:1.0:1746066756.770566:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983236736 00000100:00100000:1.0:1746066756.771499:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983236992 00000100:00100000:1.0:1746066756.771503:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983236992 00000100:00100000:3.0:1746066756.771565:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15987 00000100:00100000:3.0:1746066756.771576:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983236736:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.771593:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.771610:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7600/0xf1867c21abfa72de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d193b expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.771654:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984455168:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066756.771714:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15988 00000100:00100000:1.0:1746066756.771719:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983236992:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066756.771727:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066756.771736:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa72e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1949 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.771756:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984455296:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066756.772047:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066756.772294:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.772322:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.772776:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983236864 00000100:00100000:2.0:1746066756.772781:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983236864 00000100:00100000:2.0:1746066756.772818:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15989 00000100:00100000:2.0:1746066756.772823:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983236864:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.772830:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.772840:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa72ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1942 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.772866:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984455424:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.772928:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00002000:00010000:3.0:1746066756.776489:0:13363:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066755 -> 1746066757 00002000:00010000:3.0:1746066756.776496:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066755 -> 1746066757 00002000:00010000:3.0:1746066756.776498:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066755 -> 1746066757 00000100:00100000:3.0:1746066756.776511:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984455168:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.776511:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984455424:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066756.776536:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7600/0xf1867c21abfa72de lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d193b expref: 47 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.776545:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa72ec lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1942 expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.776553:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7600/0xf1867c21abfa72de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d193b expref: 47 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.776553:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa72ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1942 expref: 47 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.776567:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418c00, rc 0) 00010000:00010000:3.0:1746066756.776574:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7600, rc 0) 00000100:00100000:2.0:1746066756.776602:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983236864:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3778us (4280us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.776609:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15989 00000100:00100000:1.0:1746066756.776633:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984455296:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066756.776650:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa72e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1949 expref: 47 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.776656:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a589a400/0xf1867c21abfa72e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1949 expref: 47 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066756.776673:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a589a400, rc 0) 00000100:00100000:1.0:1746066756.776692:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983236992:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4973us (6199us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066756.776697:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15988 00000100:00100000:3.0:1746066756.776779:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+44:2016:x1830882983236736:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5204us (6385us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066756.776784:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15987 00000100:00100000:0.0:1746066756.778780:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983236608:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11124us (12235us total) trans 17179874418 rc 0/0 00000100:00100000:0.0:1746066756.778792:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 951 00002000:00100000:0.0:1746066756.778803:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3801087) req@ffff8800967a8a80 x1830882983236608/t17179874418(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.778818:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882983236608 ext(3145728->3801087) 00010000:00010000:0.0:1746066756.778826:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 46 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:0.0:1746066756.778840:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 46 pid: 11630 timeout: 824 lvb_type: 0 00002000:00010000:0.0:1746066756.778846:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800967a8a80 00000100:00100000:1.0:1746066756.783279:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.783452:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983237120 00000100:00100000:2.0:1746066756.783467:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983237120 00010000:00010000:2.0:1746066756.783518:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 46 pid: 11630 timeout: 824 lvb_type: 0 00000100:00100000:2.0:1746066756.783559:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7197 00000100:00100000:2.0:1746066756.783566:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983237120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.783587:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066756.783606:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 46 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.783617:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 46 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.783641:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7267 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3801087) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d2 expref: 46 pid: 11630 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.783655:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.783656:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.783662:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.783669:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.783702:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 32 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.783719:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984455552:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066756.785104:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880095fde300 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.785285:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.785357:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983237248 00000100:00100000:3.0:1746066756.785364:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983237248 00000100:00100000:3.0:1746066756.785739:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15990 00000100:00100000:3.0:1746066756.785747:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+44:691:x1830882983237248:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066756.785764:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.785780:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1950 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.785805:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.785813:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.785815:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066756.785819:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 45 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.785843:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 31 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.785860:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 31 pid: 9590 timeout: 824 lvb_type: 0 00000100:00100000:3.0:1746066756.785870:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984455680:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.785957:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.787970:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984455552:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066756.788014:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.788055:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983237120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4487us (4786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.788067:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7197 00000100:00100000:3.0:1746066756.789913:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984455680:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.789943:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 45 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.789961:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00000100:00100000:3.0:1746066756.790017:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+45:691:x1830882983237248:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4270us (4732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.790025:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15990 00000100:00100000:0.0:1746066756.790105:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.790169:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983237376 00000100:00100000:2.0:1746066756.790181:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983237376 00002000:00100000:2.0:1746066756.790220:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1957888->2097151) req@ffff880097a8aa00 x1830882983237376/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.790228:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8aa00 with x1830882983237376 ext(1957888->2097151) 00010000:00010000:2.0:1746066756.790599:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 32 pid: 9590 timeout: 824 lvb_type: 0 00010000:00010000:2.0:1746066756.790615:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 32 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746066756.790622:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a8aa00 00000100:00100000:2.0:1746066756.790643:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 952 00000100:00100000:2.0:1746066756.790650:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:2013:x1830882983237376:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066756.792160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.792323:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983237632 00000100:00100000:1.0:1746066756.792331:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983237632 00002000:00100000:1.0:1746066756.792366:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880097a88000 x1830882983237632/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.792381:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88000 with x1830882983237632 ext(3145728->4194303) 00002000:00010000:1.0:1746066756.792386:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a88000 00000100:00100000:1.0:1746066756.792414:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4265 00000100:00100000:1.0:1746066756.792421:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983237632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066756.797794:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+34:2013:x1830882983237376:12345-192.168.204.16@tcp:4:cat.0 Request processed in 7132us (7677us total) trans 21474841865 rc 0/0 00000100:00100000:3.0:1746066756.797808:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 952 00002000:00100000:3.0:1746066756.797822:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1957888->2097151) req@ffff880097a8aa00 x1830882983237376/t21474841865(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.797832:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8aa00 with x1830882983237376 ext(1957888->2097151) 00010000:00010000:3.0:1746066756.797843:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 34 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.797860:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 34 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746066756.797868:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a8aa00 00000100:00100000:1.0:1746066756.803510:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983237632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11077us (11342us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066756.803522:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4265 00002000:00100000:1.0:1746066756.803535:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880097a88000 x1830882983237632/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.803545:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88000 with x1830882983237632 ext(3145728->4194303) 00002000:00010000:1.0:1746066756.803552:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a88000 00000001:00080000:0.0:1746066756.803966:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841865 is committed 00000001:00080000:0.0:1746066756.803976:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841864 is committed 00000001:00080000:0.0:1746066756.804034:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841848 is committed 00000001:00080000:0.0:1746066756.804094:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841810 is committed 00000100:00100000:2.0:1746066756.804204:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.804643:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983237760 00000100:00100000:0.0:1746066756.804655:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983237760 00010000:00010000:0.0:1746066756.804685:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 8 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066756.804708:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7198 00000100:00100000:0.0:1746066756.804713:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983237760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066756.804726:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066756.804745:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 8 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066756.804760:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 8 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066756.804783:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0cc00/0xf1867c21abfa72b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1911 expref: 8 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066756.804806:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066756.804808:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066756.804815:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.804822:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.804852:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 17 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066756.804873:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984455808:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066756.804955:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.812046:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746066756.812070:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3775:1830882984456320:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.812107:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984456448:0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.812142:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.812142:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066756.812183:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456320 00000100:00100000:1.0:1746066756.812186:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3776:1830882984456960:0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.812191:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456320 00000100:00100000:1.0:1746066756.812205:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.812217:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984457472:0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.812230:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456960 00000100:00100000:3.0:1746066756.812232:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456960 00000100:00100000:1.0:1746066756.812232:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.812244:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:1.0:1746066756.812248:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984456064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746066756.812254:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1746066756.812261:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3775:x1830882984456320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.812268:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.812281:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882984455936:0@lo:400:kworker.0 00000100:00100000:2.0:1746066756.812360:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3774:1830882984456704:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.812564:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066756.812574:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3775:x1830882984456320:12345-0@lo:400:kworker.0 Request processed in 312us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.812581:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1746066756.812593:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984456576:0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.812600:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:3.0:1746066756.812604:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3776:x1830882984456960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.812612:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.812625:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3776:1830882984457088:0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.812629:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3776:x1830882984456960:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.812634:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1746066756.812640:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.812652:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882984457600:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.812665:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066756.812683:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456448 00000100:00100000:2.0:1746066756.812686:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456448 00000100:00100000:2.0:1746066756.812711:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984457472 00000100:00100000:2.0:1746066756.812713:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984457472 00000100:00100000:2.0:1746066756.812727:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456576 00000100:00100000:2.0:1746066756.812729:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456576 00000100:00100000:2.0:1746066756.812749:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1746066756.812754:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984456448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066756.812784:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984456448:12345-0@lo:400:kworker.0 Request processed in 30us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.812789:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1746066756.812798:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1746066756.812802:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009666c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984457472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066756.812822:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009666c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3776:x1830882984457472:12345-0@lo:400:kworker.0 Request processed in 21us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.812827:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1746066756.812833:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1746066756.812837:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984456576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066756.812856:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984456576:12345-0@lo:400:kworker.0 Request processed in 19us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.812861:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1746066756.814663:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984455808:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066756.814690:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.814728:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+7:2014:x1830882983237760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 10013us (10524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.814737:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7198 00000100:00100000:2.0:1746066756.814805:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.814881:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.814910:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983238144 00000100:00100000:2.0:1746066756.814916:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983238144 00000100:00100000:2.0:1746066756.814939:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15991 00000100:00100000:2.0:1746066756.814944:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+7:2015:x1830882983238144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.814960:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.814976:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1957 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.814995:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.814998:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.815005:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.815019:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 8 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.815029:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ece400, rc 0) 00000100:00100000:2.0:1746066756.815049:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882983238144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 104us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.815054:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15991 00000100:00100000:2.0:1746066756.815070:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983238016 00000100:00100000:2.0:1746066756.815072:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983238016 00002000:00100000:2.0:1746066756.815094:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880094306300 x1830882983238016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.815103:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830882983238016 ext(1048576->2097151) 00002000:00010000:2.0:1746066756.815107:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306300 00000100:00100000:2.0:1746066756.815119:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4266 00000100:00100000:2.0:1746066756.815124:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882983238016:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.815720:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984456448:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.815735:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3776:1830882984456960:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.815746:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984457472:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.815771:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984456576:0@lo:400:kworker.0 00000100:00080000:1.0:1746066756.815789:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746066756.815793:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746066756.815796:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746066756.815822:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3775:1830882984456320:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.815830:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984456192:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.815859:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.815898:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3775:1830882984456832:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.815917:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066756.815965:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984457088 00000100:00100000:0.0:1746066756.815971:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984457088 00000100:00100000:1.0:1746066756.815978:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984457344:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.815993:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066756.815996:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984457600 00000100:00100000:0.0:1746066756.815998:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984457600 00000100:00100000:0.0:1746066756.816005:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456832 00000100:00100000:0.0:1746066756.816007:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456832 00000100:00100000:1.0:1746066756.816017:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456064 00000100:00100000:0.0:1746066756.816017:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1746066756.816020:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456064 00000100:00100000:0.0:1746066756.816022:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3776:x1830882984457088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066756.816055:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3776:x1830882984457088:12345-0@lo:400:kworker.0 Request processed in 34us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066756.816060:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1746066756.816067:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1746066756.816071:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882984457600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066756.816086:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3776:x1830882984457600:12345-0@lo:400:kworker.0 Request processed in 16us (3420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066756.816092:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1746066756.816097:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1746066756.816100:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3775:x1830882984456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.816109:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456192 00000100:00100000:1.0:1746066756.816112:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456192 00000100:00100000:0.0:1746066756.816116:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3775:x1830882984456832:12345-0@lo:400:kworker.0 Request processed in 15us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066756.816120:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1746066756.816123:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1746066756.816128:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984456064:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746066756.816133:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1746066756.816136:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3775:1830882984456832:0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.816142:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882984456192:12345-0@lo:400:kworker.0 00000004:00000024:1.0:1746066756.816154:0:7249:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445572608 avail 1316110336 00000100:00100000:0.0:1746066756.816158:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984455936 00000100:00100000:0.0:1746066756.816160:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984455936 00000100:00100000:3.0:1746066756.816176:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882984456192:12345-0@lo:400:kworker.0 Request processed in 36us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066756.816177:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1746066756.816180:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984456064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (3912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066756.816181:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009673d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3776:x1830882984455936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.816182:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1746066756.816185:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1746066756.816200:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984457344 00000100:00100000:0.0:1746066756.816200:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009673d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3776:x1830882984455936:12345-0@lo:400:kworker.0 Request processed in 18us (3636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.816203:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984457344 00000100:00100000:0.0:1746066756.816204:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1746066756.816226:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1746066756.816227:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984456192:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.816231:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984457344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.816254:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984457344:12345-0@lo:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.816258:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1746066756.816265:0:3775:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841848 gen 2 00000100:00080000:1.0:1746066756.816266:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746066756.816268:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1746066756.816270:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f765500, transno 21474841798 00000004:00080000:0.0:1746066756.816276:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f765180, transno 21474841799 00000004:00080000:0.0:1746066756.816278:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f764e00, transno 21474841800 00000004:00080000:0.0:1746066756.816280:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f766300, transno 21474841801 00000004:00080000:0.0:1746066756.816282:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f765c00, transno 21474841802 00000100:00100000:1.0:1746066756.816284:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984456064:0@lo:41:osp-pre-1-0.0 00000004:00080000:0.0:1746066756.816284:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f767480, transno 21474841803 00000004:00080000:0.0:1746066756.816286:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f764a80, transno 21474841804 00000004:00080000:0.0:1746066756.816288:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f767b80, transno 21474841805 00000004:00080000:0.0:1746066756.816290:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f765880, transno 21474841806 00000100:00100000:1.0:1746066756.816291:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882984455936:0@lo:400:kworker.0 00000004:00080000:0.0:1746066756.816292:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecbb80, transno 21474841811 00000004:00080000:0.0:1746066756.816294:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8e00, transno 21474841812 00000004:00080000:0.0:1746066756.816296:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecb480, transno 21474841813 00000004:00080000:0.0:1746066756.816298:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec9500, transno 21474841814 00000100:00100000:1.0:1746066756.816300:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3776:1830882984457088:0@lo:400:kworker.0 00000004:00080000:0.0:1746066756.816300:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8380, transno 21474841815 00000004:00080000:0.0:1746066756.816302:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec9880, transno 21474841816 00000004:00080000:0.0:1746066756.816304:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8000, transno 21474841817 00000100:00100000:3.0:1746066756.816305:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066756.816306:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec9f80, transno 21474841818 00000100:00100000:1.0:1746066756.816307:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3776:1830882984457600:0@lo:400:kworker.0 00000004:00080000:0.0:1746066756.816308:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed4a80, transno 21474841819 00000004:00080000:0.0:1746066756.816310:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f764700, transno 21474841820 00000004:00080000:0.0:1746066756.816311:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f764380, transno 21474841821 00000004:00080000:0.0:1746066756.816314:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54d880, transno 21474841822 00000004:00080000:0.0:1746066756.816316:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f766d80, transno 21474841823 00000004:00080000:0.0:1746066756.816318:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f766680, transno 21474841824 00000004:00080000:0.0:1746066756.816320:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011f767100, transno 21474841825 00000004:00080000:0.0:1746066756.816322:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cec380, transno 21474841826 00000004:00080000:0.0:1746066756.816324:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b54dc00, transno 21474841827 00000100:00100000:3.0:1746066756.816325:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801310f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984457216:0@lo:400:kworker.0 00000004:00080000:0.0:1746066756.816326:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cedf80, transno 21474841828 00000004:00080000:0.0:1746066756.816329:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c492680, transno 21474841831 00000004:00080000:0.0:1746066756.816331:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c493480, transno 21474841832 00000004:00080000:0.0:1746066756.816333:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c492300, transno 21474841833 00000004:00080000:0.0:1746066756.816335:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c493100, transno 21474841834 00000004:00080000:0.0:1746066756.816338:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c491c00, transno 21474841835 00000004:00080000:0.0:1746066756.816340:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c493800, transno 21474841836 00000004:00080000:0.0:1746066756.816342:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c491500, transno 21474841837 00000100:00100000:3.0:1746066756.816344:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066756.816344:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ea24a80, transno 21474841838 00000004:00080000:0.0:1746066756.816346:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c490a80, transno 21474841839 00000004:00080000:0.0:1746066756.816348:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f0380, transno 21474841840 00000004:00080000:0.0:1746066756.816350:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3800, transno 21474841841 00000004:00080000:0.0:1746066756.816352:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1880, transno 21474841842 00000004:00080000:0.0:1746066756.816354:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fbce00, transno 21474841843 00000004:00080000:0.0:1746066756.816356:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3100, transno 21474841844 00000004:00080000:0.0:1746066756.816358:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f2300, transno 21474841845 00000004:00080000:0.0:1746066756.816360:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f1500, transno 21474841846 00000004:00080000:0.0:1746066756.816361:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801310f3480, transno 21474841847 00000004:00080000:0.0:1746066756.816364:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5d80000, transno 21474841848 00000100:00100000:0.0:1746066756.816367:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009666fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984457344:0@lo:400:kworker.0 00000004:00080000:0.0:1746066756.816601:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 45 done 00000100:00100000:1.0:1746066756.817160:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984457216 00000100:00100000:3.0:1746066756.817165:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984457728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746066756.817165:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984457216 00000100:00100000:1.0:1746066756.817183:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1746066756.817185:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066756.817188:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882984457216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066756.817209:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984456704 00000100:00100000:3.0:1746066756.817212:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984456704 00000100:00100000:1.0:1746066756.817222:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3774:x1830882984457216:12345-0@lo:400:kworker.0 Request processed in 34us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066756.817230:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1746066756.817236:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1746066756.817238:0:11960:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984457728 00000100:00100000:1.0:1746066756.817240:0:11960:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984457728 00000100:00100000:3.0:1746066756.817241:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882984456704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.817249:0:11960:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1746066756.817252:0:11960:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882984457728:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746066756.817267:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3774:x1830882984456704:12345-0@lo:400:kworker.0 Request processed in 26us (962us total) trans 0 rc 0/0 00000004:00000024:1.0:1746066756.817268:0:11960:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445646336 avail 1316184064 00000100:00100000:3.0:1746066756.817273:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1746066756.817293:0:11960:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3774:x1830882984457728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.817297:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3774:1830882984456704:0@lo:400:kworker.0 00000100:00100000:1.0:1746066756.817298:0:11960:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1746066756.817306:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801310f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984457216:0@lo:400:kworker.0 00000100:00080000:1.0:1746066756.817307:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746066756.817316:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3774:1830882984457728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746066756.825046:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882983238016:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9907us (10227us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066756.825059:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4266 00002000:00100000:2.0:1746066756.825072:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880094306300 x1830882983238016/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.825081:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094306300 with x1830882983238016 ext(1048576->2097151) 00002000:00010000:2.0:1746066756.825087:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094306300 00000100:00100000:0.0:1746066756.828041:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984457856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066756.828108:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066756.828156:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984457856 00000100:00100000:3.0:1746066756.828165:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984457856 00000100:00100000:3.0:1746066756.828218:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1746066756.828227:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984457856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746066756.828255:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 331776 granted 1080940992 pending 0 free 3906408448 avail 3663511552 00000100:00100000:3.0:1746066756.828302:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3775:x1830882984457856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.828309:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1746066756.828338:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984457856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746066756.834234:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.834339:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983238400 00000100:00100000:2.0:1746066756.834349:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983238400 00002000:00100000:2.0:1746066756.834395:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a88700 x1830882983238400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.834405:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88700 with x1830882983238400 ext(4194304->5033983) 00002000:00010000:2.0:1746066756.834411:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a88700 00000100:00100000:2.0:1746066756.834429:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4267 00000100:00100000:2.0:1746066756.834436:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983238400:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066756.845917:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.845953:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.846370:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983238528 00000100:00100000:2.0:1746066756.846380:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983238528 00000100:00100000:2.0:1746066756.846431:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983238656 00000100:00100000:2.0:1746066756.846433:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983238656 00000100:00100000:2.0:1746066756.846450:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15992 00000100:00100000:2.0:1746066756.846458:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882983238528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.846486:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.846503:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecee00/0xf1867c21abfa7301 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d195e expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.846561:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984457984:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.846639:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.846659:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15993 00000100:00100000:2.0:1746066756.846664:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882983238656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.846671:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.846679:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1965 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.846691:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.846693:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066756.846701:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 46 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.846717:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 46 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.846727:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecf400, rc 0) 00000100:00100000:2.0:1746066756.846744:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:2013:x1830882983238656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 80us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.846750:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15993 00000100:00100000:0.0:1746066756.847016:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.847037:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983238912 00000100:00100000:0.0:1746066756.847040:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983238912 00000100:00100000:0.0:1746066756.847074:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16295 00000100:00100000:0.0:1746066756.847079:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+59:693:x1830882983238912:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066756.847094:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066756.847105:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a23200/0xf1867c21abfa730f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d196c expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.847194:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066756.847207:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066756.847217:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066756.847227:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:0.0:1746066756.847311:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a23200/0xf1867c21abfa730f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 62 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.847333:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 61 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066756.847340:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066756.847343:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066756.847345:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22e00, rc 0) 00000100:00100000:0.0:1746066756.847360:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+61:693:x1830882983238912:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 281us (345us total) trans 8589936628 rc 0/0 00000100:00100000:0.0:1746066756.847364:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16295 00000100:00100000:0.0:1746066756.847573:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983238400:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13136us (13350us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066756.847580:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4267 00002000:00100000:0.0:1746066756.847590:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a88700 x1830882983238400/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.847599:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a88700 with x1830882983238400 ext(4194304->5033983) 00002000:00010000:0.0:1746066756.847603:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a88700 00000100:00100000:2.0:1746066756.849055:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984457984:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.849083:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecee00/0xf1867c21abfa7301 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d195e expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.849094:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecee00/0xf1867c21abfa7301 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d195e expref: 19 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.849108:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecee00, rc 0) 00000100:00100000:2.0:1746066756.849635:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:2013:x1830882983238528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3176us (3763us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.849643:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15992 00000100:00100000:0.0:1746066756.854316:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.854430:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983239040 00000100:00100000:2.0:1746066756.854440:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983239040 00000100:00100000:2.0:1746066756.855109:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15994 00000100:00100000:2.0:1746066756.855118:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+18:691:x1830882983239040:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.855140:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.855157:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1973 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.855192:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.855198:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066756.855200:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066756.855202:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.855234:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 7 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.855246:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 7 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066756.855263:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984458112:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066756.855350:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.862465:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746066756.862505:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984458240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066756.862581:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066756.863258:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984458240 00000100:00100000:3.0:1746066756.863266:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984458240 00000100:00100000:3.0:1746066756.863318:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1746066756.863327:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984458240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746066756.863359:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1066413376 pending 7356416 free 3912097792 avail 3680575488 00000100:00100000:3.0:1746066756.863416:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3777:x1830882984458240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.863422:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1746066756.863511:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984458240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746066756.867275:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.868546:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983239168 00000100:00100000:3.0:1746066756.868557:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983239168 00000100:00100000:3.0:1746066756.868623:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15995 00000100:00100000:3.0:1746066756.868633:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+33:695:x1830882983239168:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066756.868655:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.868674:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d197a expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.868708:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 34 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.868718:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.868725:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.868731:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.868733:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.868737:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1699840->1888255] (req 1699840->1888255) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 34 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.868770:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.868791:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 8 pid: 20361 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066756.868804:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984458368:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.868934:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 45 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066756.868943:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 45 pid: 20361 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066756.869079:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984458496:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.869122:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 34 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.869130:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 34 pid: 12237 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066756.869138:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984458624:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.869156:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.869249:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984458112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066756.869270:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 19 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066756.869317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.869391:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983239296 00000100:00100000:0.0:1746066756.869395:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983239296 00002000:00100000:0.0:1746066756.869422:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2404351) req@ffff8800966e0a80 x1830882983239296/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066756.869431:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882983239296 ext(2097152->2404351) 00010000:00010000:0.0:1746066756.869437:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 8 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066756.869446:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 8 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746066756.869451:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e0a80 00000100:00100000:0.0:1746066756.869472:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 953 00000100:00100000:0.0:1746066756.869507:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882983239296:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:2.0:1746066756.869552:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ecfa00, rc 0) 00000100:00100000:2.0:1746066756.869583:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:691:x1830882983239040:12345-192.168.204.16@tcp:101:cat.0 Request processed in 14465us (15279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.869588:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15994 00000100:00100000:3.0:1746066756.870441:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984458368:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066756.872378:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.872746:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984458496:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066756.872809:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983239424 00000100:00100000:2.0:1746066756.872816:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983239424 00010000:00010000:2.0:1746066756.872853:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 9 pid: 20361 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066756.873026:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7199 00000100:00100000:2.0:1746066756.873033:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983239424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.873046:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066756.873065:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 9 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066756.873075:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 9 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066756.873103:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6600/0xf1867c21abfa7205 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d187e expref: 9 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066756.873121:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.873155:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983239424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.873160:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7199 00000100:00100000:3.0:1746066756.874131:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984458624:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.874166:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1699840->1888255] (req 1699840->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 34 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.874177:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418000, rc 0) 00000100:00100000:3.0:1746066756.874206:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+34:695:x1830882983239168:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5575us (6942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.874213:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15995 00000100:00100000:0.0:1746066756.876571:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.876616:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983239552 00000100:00100000:2.0:1746066756.876623:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983239552 00010000:00010000:2.0:1746066756.876653:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 46 pid: 20361 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066756.876684:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7200 00000100:00100000:2.0:1746066756.876691:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983239552:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066756.876702:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066756.876718:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 46 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066756.876728:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 46 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066756.876748:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e428a00/0xf1867c21abfa7236 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18a1 expref: 46 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066756.876763:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066756.876798:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983239552:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066756.876805:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7200 00000100:00100000:0.0:1746066756.877789:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.877831:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983239680 00000100:00100000:3.0:1746066756.877836:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983239680 00010000:00010000:3.0:1746066756.877853:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 34 pid: 12237 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066756.877867:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7201 00000100:00100000:3.0:1746066756.877872:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882983239680:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.877879:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.877902:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 34 pid: 12237 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.877910:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 34 pid: 12237 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.877924:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093507a00/0xf1867c21abfa71c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d185b expref: 34 pid: 12237 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.877941:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.877943:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.877949:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 33 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.877953:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983239296:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8445us (8636us total) trans 21474841866 rc 0/0 00010000:00010000:3.0:1746066756.877957:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 33 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.877961:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 953 00002000:00100000:2.0:1746066756.877969:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2404351) req@ffff8800966e0a80 x1830882983239296/t21474841866(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/448 e 0 to 0 dl 1746066767 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.877977:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e0a80 with x1830882983239296 ext(2097152->2404351) 00010000:00010000:2.0:1746066756.877983:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 10 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.877987:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 33 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066756.877993:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 10 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066756.877999:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984458752:192.168.204.16@tcp:105: 00002000:00010000:2.0:1746066756.877999:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800966e0a80 00000100:00100000:3.0:1746066756.878045:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.880213:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984458752:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.880231:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.880271:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983239680:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2398us (2482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.880279:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7201 00000100:00100000:0.0:1746066756.885449:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.885564:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.885959:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983240064 00000100:00100000:3.0:1746066756.885968:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983240064 00010000:00010000:3.0:1746066756.886004:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 10 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066756.886033:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7202 00000100:00100000:3.0:1746066756.886041:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983240064:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.886055:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.886075:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 10 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.886090:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 10 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.886114:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d0c000/0xf1867c21abfa72bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2404351) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1918 expref: 10 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.886147:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.886149:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.886156:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.886164:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.886199:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 18 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.886211:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984458880:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.886291:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.886501:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983239936 00000100:00100000:2.0:1746066756.886505:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983239936 00002000:00100000:2.0:1746066756.886538:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1699840->1703935) req@ffff88011f767b80 x1830882983239936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.886547:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f767b80 with x1830882983239936 ext(1699840->1703935) 00002000:00010000:2.0:1746066756.886551:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f767b80 00000100:00100000:2.0:1746066756.886578:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4268 00000100:00100000:2.0:1746066756.886583:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983239936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066756.886704:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983239936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 120us (1265us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066756.886711:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4268 00002000:00100000:2.0:1746066756.886716:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1699840->1703935) req@ffff88011f767b80 x1830882983239936/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066756.886722:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f767b80 with x1830882983239936 ext(1699840->1703935) 00002000:00010000:2.0:1746066756.886725:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f767b80 00000100:00100000:0.0:1746066756.894488:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.894662:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984458880:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.894684:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.895263:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983240064:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 9219us (9696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.895274:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7202 00000100:00100000:1.0:1746066756.895391:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983240320 00000100:00100000:1.0:1746066756.895398:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983240320 00000100:00100000:0.0:1746066756.895401:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00100000:1.0:1746066756.895442:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1884160->1888255) req@ffff88011f764700 x1830882983240320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.895451:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764700 with x1830882983240320 ext(1884160->1888255) 00002000:00010000:1.0:1746066756.895456:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f764700 00000100:00100000:1.0:1746066756.895487:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983240704 00000100:00100000:1.0:1746066756.895490:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983240704 00002000:00100000:1.0:1746066756.895502:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88011f764380 x1830882983240704/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.895508:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764380 with x1830882983240704 ext(2097152->4194303) 00002000:00010000:1.0:1746066756.895510:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f764380 00000100:00100000:1.0:1746066756.895520:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4269 00000100:00100000:1.0:1746066756.895526:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983240320:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066756.895696:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4270 00000100:00100000:3.0:1746066756.895703:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882983240704:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066756.895957:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983240320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 430us (1490us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066756.895963:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4269 00002000:00100000:1.0:1746066756.895968:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1884160->1888255) req@ffff88011f764700 x1830882983240320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.895974:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764700 with x1830882983240320 ext(1884160->1888255) 00002000:00010000:1.0:1746066756.895977:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f764700 00000100:00100000:0.0:1746066756.896189:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.896999:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983240832 00000100:00100000:1.0:1746066756.897004:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983240832 00002000:00100000:1.0:1746066756.897023:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88011f766d80 x1830882983240832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.897030:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766d80 with x1830882983240832 ext(3145728->4194303) 00002000:00010000:1.0:1746066756.897035:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f766d80 00000100:00100000:1.0:1746066756.897061:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4271 00000100:00100000:1.0:1746066756.897067:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882983240832:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066756.904274:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882983240832:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7193us (8071us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066756.904288:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4271 00002000:00100000:1.0:1746066756.904302:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88011f766d80 x1830882983240832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.904313:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f766d80 with x1830882983240832 ext(3145728->4194303) 00002000:00010000:1.0:1746066756.904320:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011f766d80 00000100:00100000:3.0:1746066756.912792:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2013:x1830882983240704:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 17075us (17377us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066756.912805:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4270 00002000:00100000:3.0:1746066756.912818:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88011f764380 x1830882983240704/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.912828:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764380 with x1830882983240704 ext(2097152->4194303) 00002000:00010000:3.0:1746066756.912833:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f764380 00000100:00100000:0.0:1746066756.918006:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.918413:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983240960 00000100:00100000:3.0:1746066756.918423:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983240960 00000100:00100000:3.0:1746066756.918492:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15996 00000100:00100000:3.0:1746066756.918501:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+19:693:x1830882983240960:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066756.918526:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066756.918544:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1981 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.918579:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.918585:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.918587:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.918590:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3305472->3731455] (req 3305472->3731455) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 20 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.919078:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 20 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.919095:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 20 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066756.919108:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984459008:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066756.919222:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066756.924029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.924108:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983241088 00000100:00100000:2.0:1746066756.924118:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983241088 00000100:00100000:2.0:1746066756.924180:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15997 00000100:00100000:2.0:1746066756.924187:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983241088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.924202:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.924216:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa47000/0xf1867c21abfa7339 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1988 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.924257:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984459136:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.924324:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066756.924646:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984459008:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066756.924673:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3305472->3731455] (req 3305472->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 20 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.924688:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419200, rc 0) 00000100:00100000:3.0:1746066756.924733:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+20:693:x1830882983240960:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6233us (6737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.924740:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15996 00000100:00100000:0.0:1746066756.925401:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.925499:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983241216 00000100:00100000:3.0:1746066756.925505:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983241216 00010000:00010000:3.0:1746066756.925529:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 20 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066756.925714:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7203 00000100:00100000:3.0:1746066756.925722:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983241216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066756.925733:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066756.925751:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 20 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.925766:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 20 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.925786:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ecfa00/0xf1867c21abfa7324 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1973 expref: 20 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066756.925805:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.925807:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066756.925813:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.925820:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066756.925842:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066756.925851:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984459264:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066756.925920:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.927865:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984459136:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.928323:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47000/0xf1867c21abfa7339 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1988 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.928337:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47000/0xf1867c21abfa7339 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1988 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.928361:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47000, rc 0) 00000100:00100000:2.0:1746066756.928410:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983241088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4222us (4392us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.928418:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15997 00000100:00100000:3.0:1746066756.928612:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984459264:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066756.928630:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066756.928670:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983241216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2949us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066756.928680:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7203 00000100:00100000:0.0:1746066756.928965:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.929016:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983241472 00000100:00100000:3.0:1746066756.929024:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983241472 00002000:00100000:3.0:1746066756.929057:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3305472->3309567) req@ffff88011f764000 x1830882983241472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.929066:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764000 with x1830882983241472 ext(3305472->3309567) 00002000:00010000:3.0:1746066756.929071:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f764000 00000100:00100000:3.0:1746066756.929095:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4272 00000100:00100000:3.0:1746066756.929102:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983241472:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066756.929225:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983241472:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 122us (260us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066756.929231:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4272 00002000:00100000:3.0:1746066756.929236:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (3305472->3309567) req@ffff88011f764000 x1830882983241472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.929243:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764000 with x1830882983241472 ext(3305472->3309567) 00002000:00010000:3.0:1746066756.929246:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f764000 00000100:00100000:0.0:1746066756.932795:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.932880:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983241728 00000100:00100000:3.0:1746066756.932948:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983241728 00002000:00100000:3.0:1746066756.932986:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88011f765500 x1830882983241728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.932994:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f765500 with x1830882983241728 ext(4194304->5033983) 00002000:00010000:3.0:1746066756.932999:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f765500 00000100:00100000:3.0:1746066756.933130:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4273 00000100:00100000:3.0:1746066756.933138:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983241728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066756.933514:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066756.933573:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983241984 00000100:00100000:1.0:1746066756.933577:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983241984 00002000:00100000:1.0:1746066756.933594:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3727360->3731455) req@ffff88011f764e00 x1830882983241984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.933602:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764e00 with x1830882983241984 ext(3727360->3731455) 00002000:00010000:1.0:1746066756.933604:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f764e00 00000100:00100000:1.0:1746066756.933633:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4274 00000100:00100000:1.0:1746066756.933638:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882983241984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066756.933725:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882983241984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 86us (210us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066756.933731:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4274 00002000:00100000:1.0:1746066756.933737:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3727360->3731455) req@ffff88011f764e00 x1830882983241984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/4536 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066756.933743:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f764e00 with x1830882983241984 ext(3727360->3731455) 00002000:00010000:1.0:1746066756.933745:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f764e00 00000100:00100000:3.0:1746066756.938230:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011f765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983241728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5080us (5433us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066756.938246:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4273 00002000:00100000:3.0:1746066756.938258:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88011f765500 x1830882983241728/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.938267:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011f765500 with x1830882983241728 ext(4194304->5033983) 00002000:00010000:3.0:1746066756.938273:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011f765500 00000100:00100000:0.0:1746066756.941683:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.941749:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983242112 00000100:00100000:2.0:1746066756.941759:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983242112 00000100:00100000:2.0:1746066756.941822:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15998 00000100:00100000:2.0:1746066756.941830:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983242112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.941851:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.941868:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa46400/0xf1867c21abfa7340 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d198f expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.941987:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984459392:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.942081:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.943284:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984459392:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.943306:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa46400/0xf1867c21abfa7340 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d198f expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.943317:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46400/0xf1867c21abfa7340 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d198f expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.943493:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46400, rc 0) 00000100:00100000:2.0:1746066756.943532:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983242112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1702us (1857us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.943539:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15998 00000100:00100000:0.0:1746066756.946391:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.946487:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983242240 00000100:00100000:2.0:1746066756.946496:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983242240 00000100:00100000:2.0:1746066756.946548:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 15999 00000100:00100000:2.0:1746066756.946557:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983242240:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.946577:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.946594:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa46800/0xf1867c21abfa7347 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1996 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.946647:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984459520:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.946730:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.947857:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984459520:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.947879:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa46800/0xf1867c21abfa7347 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1996 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.947921:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa46800/0xf1867c21abfa7347 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1996 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.947941:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46800, rc 0) 00000100:00100000:2.0:1746066756.947967:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983242240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1411us (1584us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.947974:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 15999 00000100:00100000:0.0:1746066756.985624:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066756.986575:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983242368 00000100:00100000:2.0:1746066756.986587:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983242368 00000100:00100000:2.0:1746066756.986695:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16000 00000100:00100000:2.0:1746066756.986705:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983242368:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066756.986724:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066756.986746:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa734e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d199d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066756.986817:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984459648:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066756.987482:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066756.988314:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984459648:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066756.988338:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa734e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d199d expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.988348:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa734e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d199d expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066756.988368:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46e00, rc 0) 00000100:00100000:2.0:1746066756.988401:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983242368:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1698us (2788us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066756.988409:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16000 00000100:00100000:0.0:1746066756.997117:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066756.997180:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066756.997273:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983242624 00000100:00100000:3.0:1746066756.997283:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983242624 00002000:00100000:3.0:1746066756.997335:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c492680 x1830882983242624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 504/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.997345:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492680 with x1830882983242624 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.997351:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c492680 00000100:00100000:3.0:1746066756.997380:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983242880 00000100:00100000:3.0:1746066756.997383:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983242880 00002000:00100000:3.0:1746066756.997396:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c493480 x1830882983242880/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/0 e 0 to 0 dl 1746066767 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066756.997403:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882983242880 ext(1048576->2097151) 00002000:00010000:3.0:1746066756.997406:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:3.0:1746066756.997419:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4275 00000100:00100000:3.0:1746066756.997427:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983242624:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066756.997654:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4276 00000100:00100000:2.0:1746066756.997663:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983242880:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066757.011112:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983242624:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13675us (13997us total) trans 0 rc 860160/860160 00000100:00100000:3.0:1746066757.011124:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4275 00002000:00100000:3.0:1746066757.011136:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c492680 x1830882983242624/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 504/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 860160/860160 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.011150:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492680 with x1830882983242624 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.011157:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c492680 00000100:00100000:2.0:1746066757.015014:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983242880:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17341us (17821us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.015027:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4276 00002000:00100000:2.0:1746066757.015039:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c493480 x1830882983242880/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:162/0 lens 488/440 e 0 to 0 dl 1746066767 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.015049:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882983242880 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.015056:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:0.0:1746066757.019289:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.019395:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983243008 00000100:00100000:2.0:1746066757.019406:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983243008 00000100:00100000:2.0:1746066757.019493:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16001 00000100:00100000:2.0:1746066757.019503:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+9:703:x1830882983243008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.019524:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.019542:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19a4 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.019574:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.019582:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066757.019584:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066757.019587:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.019617:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 18 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.019629:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 18 pid: 13363 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.019641:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984459776:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.019725:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746066757.019826:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066757.022524:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.022820:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984459776:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.022849:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.022871:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47200, rc 0) 00000100:00100000:3.0:1746066757.023696:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983243136 00000100:00100000:3.0:1746066757.023705:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983243136 00000100:00100000:2.0:1746066757.023756:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:703:x1830882983243008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4252us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.023765:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16001 00002000:00100000:3.0:1746066757.024172:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3305472->3731455) req@ffff88012c493100 x1830882983243136/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.024181:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493100 with x1830882983243136 ext(3305472->3731455) 00010000:00010000:3.0:1746066757.024188:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 19 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.024199:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 19 pid: 13363 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746066757.024205:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c493100 00000100:00100000:3.0:1746066757.024223:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 954 00000100:00100000:3.0:1746066757.024228:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983243136:12345-192.168.204.16@tcp:4:cat.0 00000100:00080000:1.0:1746066757.024648:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066757.029391:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983243136:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5150us (6862us total) trans 21474841867 rc 0/0 00000100:00100000:3.0:1746066757.029405:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 954 00002000:00100000:3.0:1746066757.029419:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3305472->3731455) req@ffff88012c493100 x1830882983243136/t21474841867(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.029429:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493100 with x1830882983243136 ext(3305472->3731455) 00010000:00010000:3.0:1746066757.029440:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 21 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.029460:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 21 pid: 13363 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746066757.029468:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c493100 00000100:00100000:0.0:1746066757.034632:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.034796:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983243264 00000100:00100000:3.0:1746066757.034808:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983243264 00010000:00010000:3.0:1746066757.034856:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 21 pid: 13363 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.035527:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7204 00000100:00100000:0.0:1746066757.035538:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2013:x1830882983243264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.035553:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.035576:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 21 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.035594:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 21 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.035618:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419200/0xf1867c21abfa7332 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->3731455) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1981 expref: 21 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.035719:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.035722:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.035732:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.035742:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.035783:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.035800:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984459904:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066757.035927:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.038113:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984459904:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.038138:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.038190:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2013:x1830882983243264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2652us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.038202:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7204 00000100:00100000:0.0:1746066757.041090:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.041212:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983243520 00000100:00100000:3.0:1746066757.041220:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983243520 00002000:00100000:3.0:1746066757.041265:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012c491500 x1830882983243520/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.041274:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491500 with x1830882983243520 ext(2097152->4194303) 00002000:00010000:3.0:1746066757.041279:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491500 00000100:00100000:3.0:1746066757.041308:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4277 00000100:00100000:3.0:1746066757.041319:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983243520:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066757.054393:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983243520:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13064us (13300us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066757.054406:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4277 00002000:00100000:3.0:1746066757.054418:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012c491500 x1830882983243520/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.054427:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491500 with x1830882983243520 ext(2097152->4194303) 00002000:00010000:3.0:1746066757.054433:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491500 00000100:00100000:0.0:1746066757.066375:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.066444:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983243776 00000100:00100000:3.0:1746066757.066454:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983243776 00002000:00100000:3.0:1746066757.066513:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490a80 x1830882983243776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.066523:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490a80 with x1830882983243776 ext(4194304->5033983) 00002000:00010000:3.0:1746066757.066529:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490a80 00000100:00100000:3.0:1746066757.067215:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4278 00000100:00100000:3.0:1746066757.067224:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983243776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066757.076227:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983243776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8990us (9848us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066757.076241:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4278 00002000:00100000:3.0:1746066757.076254:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490a80 x1830882983243776/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.076265:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490a80 with x1830882983243776 ext(4194304->5033983) 00002000:00010000:3.0:1746066757.076271:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490a80 00000100:00100000:0.0:1746066757.132443:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.132555:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983243904 00000100:00100000:2.0:1746066757.132565:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983243904 00000100:00100000:2.0:1746066757.132618:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16002 00000100:00100000:2.0:1746066757.132626:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:705:x1830882983243904:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066757.132646:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.132663:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19ab expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.132692:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.132700:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.132706:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.132708:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.132711:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.132740:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 11 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.132751:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 11 pid: 11630 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066757.132762:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984460032:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.132869:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 19 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.132876:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 19 pid: 13363 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.132912:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984460160:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.132947:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.134856:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984460160:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.142923:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.143262:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983244032 00000100:00100000:2.0:1746066757.143273:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983244032 00010000:00010000:2.0:1746066757.143311:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 20 pid: 13363 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.143353:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7205 00000100:00100000:2.0:1746066757.143361:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882983244032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.143375:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.143396:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 20 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.143406:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 20 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.143435:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7200/0xf1867c21abfa72f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1950 expref: 20 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.143455:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.143514:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983244032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 152us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.143521:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7205 00000100:00100000:3.0:1746066757.144004:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984460032:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.144031:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1507328->2097151] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.144042:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47400, rc 0) 00000100:00100000:3.0:1746066757.144069:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:705:x1830882983243904:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11443us (11635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.144076:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16002 00000100:00100000:0.0:1746066757.149511:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.149580:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983244160 00000100:00100000:2.0:1746066757.149591:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983244160 00010000:00010000:2.0:1746066757.149630:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 11 pid: 11630 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066757.149666:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7206 00000100:00100000:2.0:1746066757.149675:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2014:x1830882983244160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.149690:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.149711:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 11 pid: 11630 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.149724:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 11 pid: 11630 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.149752:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5ece400/0xf1867c21abfa72fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1957 expref: 11 pid: 11630 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.149779:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.149782:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.149789:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.149796:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.149830:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 10 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.149843:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984460288:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.149946:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.152430:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984460288:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.152449:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.153064:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983244160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3385us (3559us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.153077:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7206 00000100:00100000:0.0:1746066757.154795:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.154915:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983244416 00000100:00100000:3.0:1746066757.154926:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983244416 00002000:00100000:3.0:1746066757.154980:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1507328->1511423) req@ffff88009c7fce00 x1830882983244416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.154990:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fce00 with x1830882983244416 ext(1507328->1511423) 00002000:00010000:3.0:1746066757.154997:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fce00 00000100:00100000:3.0:1746066757.155042:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4279 00000100:00100000:3.0:1746066757.155053:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983244416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066757.155240:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983244416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 187us (450us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066757.155247:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4279 00002000:00100000:3.0:1746066757.155254:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1507328->1511423) req@ffff88009c7fce00 x1830882983244416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.155260:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fce00 with x1830882983244416 ext(1507328->1511423) 00002000:00010000:3.0:1746066757.155263:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fce00 00000100:00100000:0.0:1746066757.162170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.162526:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983244544 00000100:00100000:3.0:1746066757.162537:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983244544 00000100:00100000:3.0:1746066757.162597:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16003 00000100:00100000:3.0:1746066757.162607:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:705:x1830882983244544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066757.162631:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.162652:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19b2 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.162686:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.162699:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.162701:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.162705:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->2351103] (req 2097152->2351103) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.162742:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.162755:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 11 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.162769:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984460416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.162935:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.168940:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.169034:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983244672 00000100:00100000:2.0:1746066757.169043:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983244672 00010000:00010000:2.0:1746066757.169084:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 12 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.169118:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7207 00000100:00100000:2.0:1746066757.169126:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983244672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.169142:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.169163:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 12 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.169174:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 12 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.169198:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.169200:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.169207:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 12 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.169214:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x50080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 12 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.169246:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 12 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.169259:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984460544:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.169349:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00010000:00010000:3.0:1746066757.169667:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47200/0xf1867c21abfa7355 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19a4 expref: 12 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.169684:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9592:1830882984460416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.169707:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.169717:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418a00, rc 0) 00000100:00100000:3.0:1746066757.169745:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:705:x1830882983244544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7140us (7590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.169752:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16003 00000100:00100000:3.0:1746066757.176091:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984460544:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066757.176119:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.176179:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983244672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7051us (7246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.176190:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7207 00000100:00100000:0.0:1746066757.178750:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.178829:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983244800 00000100:00100000:3.0:1746066757.178836:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983244800 00000100:00100000:3.0:1746066757.178919:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16004 00000100:00100000:3.0:1746066757.178927:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882983244800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.178947:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.178965:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094419400/0xf1867c21abfa736a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19b9 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.179017:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984460672:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066757.179089:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00080000:1.0:1746066757.179213:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066757.179810:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.179870:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983244928 00000100:00100000:2.0:1746066757.179875:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983244928 00000100:00100000:2.0:1746066757.179922:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16005 00000100:00100000:2.0:1746066757.179929:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+19:2014:x1830882983244928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.179937:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.179948:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa7371 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19c0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.179975:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984460800:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066757.180025:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.180766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.180848:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983245056 00000100:00100000:2.0:1746066757.180851:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983245056 00000100:00100000:2.0:1746066757.180877:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16006 00000100:00100000:2.0:1746066757.180900:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983245056:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.180911:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.180922:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa7378 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19c7 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.180952:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984460928:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066757.180999:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746066757.181139:0:9592:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066757 -> 1746066758 00002000:00010000:3.0:1746066757.181142:0:9592:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066757 -> 1746066758 00002000:00010000:3.0:1746066757.181144:0:9592:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066757 -> 1746066758 00000100:00100000:3.0:1746066757.181160:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984460672:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066757.181183:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094419400/0xf1867c21abfa736a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b9 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.181192:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094419400/0xf1867c21abfa736a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b9 expref: 46 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.181204:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419400, rc 0) 00000100:00100000:3.0:1746066757.181226:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2013:x1830882983244800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2301us (2483us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066757.181232:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16004 00002000:00010000:2.0:1746066757.183222:0:13363:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066757 -> 1746066758 00002000:00010000:2.0:1746066757.183227:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066757 -> 1746066758 00002000:00010000:2.0:1746066757.183229:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066757 -> 1746066758 00000100:00100000:2.0:1746066757.183248:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13363:1830882984460800:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066757.183270:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa7371 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19c0 expref: 22 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.183282:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa7371 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19c0 expref: 22 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.183311:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47a00, rc 0) 00000100:00100000:2.0:1746066757.183344:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+21:2014:x1830882983244928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3414us (3533us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066757.183351:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16005 00002000:00010000:3.0:1746066757.183454:0:20361:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066757 -> 1746066758 00002000:00010000:3.0:1746066757.183456:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066757 -> 1746066758 00002000:00010000:3.0:1746066757.183458:0:20361:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066757 -> 1746066758 00000100:00100000:3.0:1746066757.183474:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984460928:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066757.183489:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa7378 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19c7 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.183496:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa46400/0xf1867c21abfa7378 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19c7 expref: 20 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.183503:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa46400, rc 0) 00000100:00100000:3.0:1746066757.183521:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983245056:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2638us (2756us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066757.183525:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16006 00000100:00100000:0.0:1746066757.184074:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.184134:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983245312 00000100:00100000:2.0:1746066757.184139:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983245312 00002000:00100000:2.0:1746066757.184174:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2347008->2351103) req@ffff88009c7fc700 x1830882983245312/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.184183:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc700 with x1830882983245312 ext(2347008->2351103) 00002000:00010000:2.0:1746066757.184187:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc700 00000100:00100000:2.0:1746066757.184206:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4280 00000100:00100000:2.0:1746066757.184211:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983245312:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066757.184314:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983245312:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 103us (242us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066757.184319:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4280 00002000:00100000:2.0:1746066757.184324:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2347008->2351103) req@ffff88009c7fc700 x1830882983245312/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.184331:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc700 with x1830882983245312 ext(2347008->2351103) 00002000:00010000:2.0:1746066757.184334:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc700 00000100:00100000:0.0:1746066757.191095:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.191288:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983245440 00000100:00100000:3.0:1746066757.191296:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983245440 00000100:00100000:3.0:1746066757.191356:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16007 00000100:00100000:3.0:1746066757.191370:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+45:715:x1830882983245440:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.191390:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.191408:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19ce expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.191445:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.191456:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.191457:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.191461:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 46 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.191505:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 32 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.191517:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 32 pid: 13363 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.191528:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984461056:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.191612:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.195587:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984461056:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.195711:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 46 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.195729:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419600, rc 0) 00000100:00100000:3.0:1746066757.195775:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:715:x1830882983245440:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4409us (4688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.195783:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16007 00000100:00100000:0.0:1746066757.196218:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.196325:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983245568 00000100:00100000:3.0:1746066757.196331:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983245568 00002000:00100000:3.0:1746066757.196380:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1699840->1888255) req@ffff88009c7ff800 x1830882983245568/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.196394:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ff800 with x1830882983245568 ext(1699840->1888255) 00010000:00010000:3.0:1746066757.196400:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 33 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.196411:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 33 pid: 13363 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746066757.196417:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7ff800 00000100:00100000:3.0:1746066757.196442:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 955 00000100:00100000:3.0:1746066757.196447:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983245568:12345-192.168.204.16@tcp:4:multiop.0 00000100:00080000:1.0:1746066757.196738:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066757.201037:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882983245568:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 4577us (4807us total) trans 17179874419 rc 0/0 00000100:00100000:3.0:1746066757.201050:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 955 00002000:00100000:3.0:1746066757.201063:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1699840->1888255) req@ffff88009c7ff800 x1830882983245568/t17179874419(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.201076:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ff800 with x1830882983245568 ext(1699840->1888255) 00010000:00010000:3.0:1746066757.201086:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 35 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.201100:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 35 pid: 13363 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746066757.201107:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7ff800 00000100:00100000:0.0:1746066757.204015:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.204152:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983245696 00000100:00100000:3.0:1746066757.204165:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983245696 00010000:00010000:3.0:1746066757.204207:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 35 pid: 13363 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.204243:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7208 00000100:00100000:3.0:1746066757.204252:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+35:2016:x1830882983245696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.204270:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.204294:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 35 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.204307:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 35 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.204345:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094418000/0xf1867c21abfa732b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1699840->1888255) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d197a expref: 35 pid: 13363 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.204391:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.204394:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.204403:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.204412:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.204453:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.204482:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984461184:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066757.204596:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.209024:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984461184:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066757.209040:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.209059:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.209116:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983245952 00000100:00100000:2.0:1746066757.209122:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983245952 00002000:00100000:2.0:1746066757.209154:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009c7ffb80 x1830882983245952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.209169:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ffb80 with x1830882983245952 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.209173:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ffb80 00000100:00100000:2.0:1746066757.209190:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4281 00000100:00100000:2.0:1746066757.209197:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983245952:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066757.209281:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983245696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5030us (5277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.209291:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7208 00000100:00100000:2.0:1746066757.215843:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983245952:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6356us (6494us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.215856:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4281 00002000:00100000:2.0:1746066757.215868:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009c7ffb80 x1830882983245952/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.215878:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7ffb80 with x1830882983245952 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.215921:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7ffb80 00000100:00100000:0.0:1746066757.221410:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.221498:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983246080 00000100:00100000:3.0:1746066757.221508:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983246080 00000100:00100000:3.0:1746066757.221562:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16008 00000100:00100000:3.0:1746066757.221567:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+19:715:x1830882983246080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.221580:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.221592:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19d5 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.221612:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.221617:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.221618:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.221621:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.221642:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 9 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.221648:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 9 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.221658:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984461312:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.221732:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.223104:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984461312:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.223273:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.223291:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418800, rc 0) 00000100:00100000:3.0:1746066757.223339:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:715:x1830882983246080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1770us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.223351:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16008 00000100:00100000:0.0:1746066757.223804:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.225003:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983246208 00000100:00100000:2.0:1746066757.225010:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983246208 00002000:00100000:2.0:1746066757.225050:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1507328->2097151) req@ffff8800958a4e00 x1830882983246208/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.225059:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4e00 with x1830882983246208 ext(1507328->2097151) 00010000:00010000:2.0:1746066757.225066:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 10 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.225077:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 10 pid: 9592 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746066757.225083:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a4e00 00000100:00100000:2.0:1746066757.225099:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 956 00000100:00100000:2.0:1746066757.225105:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983246208:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066757.230907:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.230979:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983246336 00000100:00100000:3.0:1746066757.230991:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983246336 00000100:00100000:3.0:1746066757.231047:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16009 00000100:00100000:3.0:1746066757.231055:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+20:707:x1830882983246336:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066757.231075:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.231092:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19dc expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.231121:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.231129:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.231130:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.231134:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2809856->3145727] (req 2809856->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.231168:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 11 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.231178:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 11 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.231189:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984461440:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.231269:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.232365:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984461440:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.232387:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2809856->3145727] (req 2809856->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 21 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.232399:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418c00, rc 0) 00000100:00100000:3.0:1746066757.232440:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+21:707:x1830882983246336:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1384us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.232447:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16009 00000100:00100000:0.0:1746066757.233461:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.233514:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983246464 00000100:00100000:1.0:1746066757.233521:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983246464 00002000:00100000:1.0:1746066757.233552:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2351103) req@ffff8800958a4380 x1830882983246464/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.233559:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4380 with x1830882983246464 ext(2097152->2351103) 00010000:00010000:1.0:1746066757.233564:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 14 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.233576:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 14 pid: 9592 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.233581:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a4380 00000100:00100000:1.0:1746066757.233603:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 957 00000100:00100000:1.0:1746066757.233609:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983246464:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066757.233785:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983246208:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 8677us (9984us total) trans 21474841868 rc 0/0 00000100:00100000:2.0:1746066757.233792:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 956 00002000:00100000:2.0:1746066757.233798:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1507328->2097151) req@ffff8800958a4e00 x1830882983246208/t21474841868(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.233804:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4e00 with x1830882983246208 ext(1507328->2097151) 00010000:00010000:2.0:1746066757.233809:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 14 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.233817:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 14 pid: 9592 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746066757.233822:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a4e00 00000100:00100000:0.0:1746066757.236552:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.236616:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983246592 00000100:00100000:3.0:1746066757.236623:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983246592 00010000:00010000:3.0:1746066757.236652:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 16 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.236671:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7209 00000100:00100000:3.0:1746066757.236676:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983246592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.236686:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.236701:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 16 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.236709:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 16 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.236727:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47400/0xf1867c21abfa735c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1507328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ab expref: 16 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.236746:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.236747:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.236753:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.236759:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.236784:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.236793:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984461568:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066757.236852:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.237025:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983246464:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3416us (3566us total) trans 21474841869 rc 0/0 00000100:00100000:3.0:1746066757.237031:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 957 00002000:00100000:3.0:1746066757.237038:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2351103) req@ffff8800958a4380 x1830882983246464/t21474841869(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.237049:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4380 with x1830882983246464 ext(2097152->2351103) 00010000:00010000:3.0:1746066757.237054:0:9597:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 14 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.237061:0:9597:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 14 pid: 9592 timeout: 825 lvb_type: 0 00002000:00010000:3.0:1746066757.237066:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958a4380 00000100:00100000:0.0:1746066757.238633:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.238729:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984461568:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066757.238748:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.238776:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:2013:x1830882983246592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2099us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.238785:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7209 00000100:00100000:3.0:1746066757.238806:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983246720 00000100:00100000:3.0:1746066757.238810:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983246720 00010000:00010000:3.0:1746066757.238827:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 13 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.238842:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7210 00000100:00100000:3.0:1746066757.238847:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983246720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.238857:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.238874:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 13 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.238907:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 13 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.238927:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418a00/0xf1867c21abfa7363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2351103) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19b2 expref: 13 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.238938:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.238940:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.238945:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.238952:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.238974:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.238983:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984461696:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066757.239501:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.240690:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.240761:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.240837:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984461696:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066757.240842:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983246976 00000100:00100000:3.0:1746066757.240846:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983246976 00010000:00010000:2.0:1746066757.240853:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746066757.240898:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880096ecb480 x1830882983246976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746066757.240901:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983246720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2052us (2272us total) trans 0 rc 0/0 00002000:00100000:3.0:1746066757.240907:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecb480 with x1830882983246976 ext(1048576->2097151) 00000100:00100000:2.0:1746066757.240909:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7210 00002000:00010000:3.0:1746066757.240911:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecb480 00000100:00100000:3.0:1746066757.240935:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983247232 00000100:00100000:3.0:1746066757.240938:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983247232 00000100:00100000:2.0:1746066757.240938:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4282 00000100:00100000:2.0:1746066757.240944:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983246976:12345-192.168.204.16@tcp:3:multiop.0 00002000:00100000:3.0:1746066757.240948:0:9597:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9a:0x0] (2809856->2813951) req@ffff880096ec9500 x1830882983247232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.240959:0:9597:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9500 with x1830882983247232 ext(2809856->2813951) 00002000:00010000:3.0:1746066757.240961:0:9597:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9500 00000100:00100000:3.0:1746066757.240977:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4283 00000100:00100000:3.0:1746066757.240981:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983247232:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066757.241060:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983247232:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 77us (298us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066757.241064:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4283 00002000:00100000:3.0:1746066757.241068:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2809856->2813951) req@ffff880096ec9500 x1830882983247232/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.241073:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9500 with x1830882983247232 ext(2809856->2813951) 00002000:00010000:3.0:1746066757.241075:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9500 00000100:00100000:0.0:1746066757.246343:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.246452:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983247360 00000100:00100000:3.0:1746066757.246462:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983247360 00000100:00100000:3.0:1746066757.246530:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16010 00000100:00100000:3.0:1746066757.246538:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:707:x1830882983247360:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066757.246558:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.246575:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19e3 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.246605:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.246612:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 47 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.246622:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.246628:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.246634:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066757.246636:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066757.246639:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 7/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->2764799] (req 2097152->2764799) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 47 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.246669:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.246681:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 33 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.246694:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984461824:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.246919:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 47 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.246929:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 47 pid: 11630 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.246937:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984461952:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.246980:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 47 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.246988:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 47 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.246995:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984462080:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.247116:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.247125:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.247193:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984462208:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.247212:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.247836:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983246976:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6890us (7147us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.247845:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4282 00002000:00100000:2.0:1746066757.247856:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880096ecb480 x1830882983246976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.247865:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecb480 with x1830882983246976 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.247869:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecb480 00000100:00100000:3.0:1746066757.248682:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984461824:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.248688:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984461952:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.249200:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.249237:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.249309:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984462208:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.249365:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983247488 00000100:00100000:2.0:1746066757.249371:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983247488 00010000:00010000:2.0:1746066757.249404:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 34 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.249436:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983247616 00000100:00100000:2.0:1746066757.249439:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983247616 00010000:00010000:2.0:1746066757.249448:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 48 pid: 11630 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.249483:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7211 00000100:00100000:2.0:1746066757.249490:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983247488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.249502:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.249521:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 34 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.249531:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 34 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.249556:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5fc00/0xf1867c21abfa72d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d192d expref: 34 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.249573:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7212 00010000:00010000:2.0:1746066757.249574:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066757.249583:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2014:x1830882983247616:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.249592:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066757.249602:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:2014:x1830882983247488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 112us (402us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066757.249602:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 48 pid: 11630 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.249608:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7211 00010000:00010000:1.0:1746066757.249612:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 48 pid: 11630 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.249624:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6200/0xf1867c21abfa726e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18d9 expref: 48 pid: 11630 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.249639:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066757.249657:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882983247616:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 76us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.249663:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7212 00000100:00100000:3.0:1746066757.250934:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984462080:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.250969:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->2764799] (req 2097152->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 46 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.250982:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6000, rc 0) 00000100:00100000:3.0:1746066757.251015:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:707:x1830882983247360:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4477us (4682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.251022:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16010 00000100:00100000:0.0:1746066757.252804:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.252996:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983247744 00000100:00100000:3.0:1746066757.253004:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983247744 00010000:00010000:3.0:1746066757.253033:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.253058:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7213 00000100:00100000:3.0:1746066757.253065:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983247744:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.253113:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.253132:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.253143:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.253165:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5f600/0xf1867c21abfa72d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1934 expref: 33 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.253196:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.253227:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983247744:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 162us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.253233:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7213 00000100:00100000:0.0:1746066757.254597:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.254710:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983247872 00000100:00100000:2.0:1746066757.254788:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983247872 00010000:00010000:2.0:1746066757.254820:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 46 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066757.255015:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7214 00000100:00100000:2.0:1746066757.255022:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2014:x1830882983247872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.255034:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.255252:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 46 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.255264:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 46 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.255286:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ecf400/0xf1867c21abfa7308 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1965 expref: 46 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.255300:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.255302:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.255308:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.255316:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.255355:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 45 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.255368:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984462336:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.255589:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.257826:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984462336:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.257845:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.257914:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:2014:x1830882983247872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2891us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.257925:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7214 00000100:00100000:0.0:1746066757.262021:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.262126:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983248128 00000100:00100000:2.0:1746066757.262137:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983248128 00002000:00100000:2.0:1746066757.262184:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2809855) req@ffff880096ecb100 x1830882983248128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.262195:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecb100 with x1830882983248128 ext(2097152->2809855) 00002000:00010000:2.0:1746066757.262201:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecb100 00000100:00100000:2.0:1746066757.262238:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4284 00000100:00100000:2.0:1746066757.262246:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983248128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066757.264463:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.264971:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983248384 00000100:00100000:1.0:1746066757.264983:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983248384 00002000:00100000:1.0:1746066757.265027:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2760704->2764799) req@ffff880096eca680 x1830882983248384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.265038:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096eca680 with x1830882983248384 ext(2760704->2764799) 00002000:00010000:1.0:1746066757.265044:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096eca680 00000100:00100000:1.0:1746066757.265082:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4285 00000100:00100000:1.0:1746066757.265090:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983248384:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066757.266032:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983248384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 692us (1327us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066757.266042:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4285 00002000:00100000:1.0:1746066757.266049:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2760704->2764799) req@ffff880096eca680 x1830882983248384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.266056:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096eca680 with x1830882983248384 ext(2760704->2764799) 00002000:00010000:1.0:1746066757.266060:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096eca680 00000100:00100000:3.0:1746066757.266621:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983248128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4373us (4611us total) trans 0 rc 712704/712704 00000100:00100000:3.0:1746066757.266628:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4284 00002000:00100000:3.0:1746066757.266633:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2809855) req@ffff880096ecb100 x1830882983248128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 712704/712704 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.266641:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecb100 with x1830882983248128 ext(2097152->2809855) 00002000:00010000:3.0:1746066757.266645:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecb100 00000100:00100000:0.0:1746066757.271772:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.271923:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983248640 00000100:00100000:3.0:1746066757.271933:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983248640 00002000:00100000:3.0:1746066757.271978:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2764800->3145727) req@ffff880096ec9180 x1830882983248640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.271988:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9180 with x1830882983248640 ext(2764800->3145727) 00002000:00010000:3.0:1746066757.271993:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9180 00000100:00100000:3.0:1746066757.273439:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4286 00000100:00100000:3.0:1746066757.273454:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983248640:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066757.275661:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.276425:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983248896 00000100:00100000:1.0:1746066757.276437:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983248896 00002000:00100000:1.0:1746066757.276494:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880096ecbb80 x1830882983248896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.276504:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecbb80 with x1830882983248896 ext(3145728->4194303) 00002000:00010000:1.0:1746066757.276511:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecbb80 00000100:00100000:1.0:1746066757.276544:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4287 00000100:00100000:1.0:1746066757.276551:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983248896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066757.278235:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983248640:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4779us (6467us total) trans 0 rc 380928/380928 00000100:00100000:3.0:1746066757.278244:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4286 00002000:00100000:3.0:1746066757.278254:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2764800->3145727) req@ffff880096ec9180 x1830882983248640/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 380928/380928 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.278263:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9180 with x1830882983248640 ext(2764800->3145727) 00002000:00010000:3.0:1746066757.278268:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec9180 00000100:00100000:1.0:1746066757.282839:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983248896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6282us (7180us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066757.282849:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4287 00002000:00100000:1.0:1746066757.282856:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880096ecbb80 x1830882983248896/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.282863:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ecbb80 with x1830882983248896 ext(3145728->4194303) 00002000:00010000:1.0:1746066757.282866:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ecbb80 00000100:00100000:0.0:1746066757.283324:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.283368:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983249152 00000100:00100000:1.0:1746066757.283375:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983249152 00002000:00100000:1.0:1746066757.283403:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880096ec8e00 x1830882983249152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.283410:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882983249152 ext(3145728->4194303) 00002000:00010000:1.0:1746066757.283416:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8e00 00000100:00100000:1.0:1746066757.283438:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4288 00000100:00100000:1.0:1746066757.283444:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983249152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066757.289533:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2016:x1830882983249152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6080us (6205us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066757.289544:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4288 00002000:00100000:1.0:1746066757.289554:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880096ec8e00 x1830882983249152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.289563:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec8e00 with x1830882983249152 ext(3145728->4194303) 00002000:00010000:1.0:1746066757.289568:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096ec8e00 00000100:00100000:0.0:1746066757.301945:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.301978:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.302131:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983249408 00000100:00100000:1.0:1746066757.302140:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983249408 00002000:00100000:1.0:1746066757.302522:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096ec9880 x1830882983249408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.302532:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9880 with x1830882983249408 ext(4194304->5033983) 00002000:00010000:1.0:1746066757.302538:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9880 00000100:00100000:1.0:1746066757.302587:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4289 00000100:00100000:1.0:1746066757.302596:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2013:x1830882983249408:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066757.302767:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983249536 00000100:00100000:3.0:1746066757.302772:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983249536 00000100:00100000:3.0:1746066757.302805:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16011 00000100:00100000:3.0:1746066757.302811:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983249536:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.302822:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.302836:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19ea expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.302854:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.302856:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.302863:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 33 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.302876:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 33 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.302902:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6e00, rc 0) 00000100:00100000:3.0:1746066757.302949:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983249536:12345-192.168.204.16@tcp:101:cat.0 Request processed in 137us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.302955:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16011 00000100:00100000:1.0:1746066757.303127:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.303158:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.303180:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.303247:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983249664 00000100:00100000:3.0:1746066757.303251:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983249664 00000100:00100000:3.0:1746066757.303268:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983249920 00000100:00100000:3.0:1746066757.303270:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983249920 00000100:00100000:3.0:1746066757.303284:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983249792 00000100:00100000:3.0:1746066757.303286:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983249792 00000100:00100000:2.0:1746066757.303293:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16012 00000100:00100000:2.0:1746066757.303299:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983249664:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066757.303305:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16013 00010000:00010000:2.0:1746066757.303307:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066757.303310:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983249920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.303314:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.303315:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19f1 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.303320:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfa73a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19ff expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.303351:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984462464:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066757.303449:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.303452:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.303458:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.303481:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.303488:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47a00, rc 0) 00000100:00100000:0.0:1746066757.303497:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16014 00000100:00100000:2.0:1746066757.303503:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983249664:12345-192.168.204.16@tcp:101:cat.0 Request processed in 205us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.303504:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983249792:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066757.303508:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16012 00010000:00010000:0.0:1746066757.303511:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.303518:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa73b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d19f8 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.303539:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984462592:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066757.303926:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.304080:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00002000:00010000:3.0:1746066757.307497:0:13363:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066757 -> 1746066758 00002000:00010000:3.0:1746066757.307504:0:13363:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066757 -> 1746066758 00002000:00010000:3.0:1746066757.307506:0:13363:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066757 -> 1746066758 00000100:00100000:3.0:1746066757.307529:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984462464:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066757.307561:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfa73a9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ff expref: 34 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.307573:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6a00/0xf1867c21abfa73a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ff expref: 34 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.307597:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6a00, rc 0) 00000100:00100000:3.0:1746066757.307644:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983249920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4331us (4483us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066757.307651:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16013 00000100:00100000:1.0:1746066757.307681:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e212300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984462592:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066757.307698:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa73b0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f8 expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.307706:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cb5600/0xf1867c21abfa73b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f8 expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.307723:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb5600, rc 0) 00000100:00100000:1.0:1746066757.307992:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983249792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4488us (4810us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066757.307998:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16014 00000100:00100000:1.0:1746066757.308076:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2013:x1830882983249408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5482us (6137us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066757.308084:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4289 00002000:00100000:1.0:1746066757.308389:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096ec9880 x1830882983249408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.308400:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096ec9880 with x1830882983249408 ext(4194304->5033983) 00002000:00010000:1.0:1746066757.308405:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096ec9880 00000100:00100000:0.0:1746066757.321704:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.321748:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.321819:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983250304 00000100:00100000:1.0:1746066757.321833:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983250304 00002000:00100000:1.0:1746066757.321925:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88006e211c00 x1830882983250304/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.321935:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211c00 with x1830882983250304 ext(1048576->2097151) 00002000:00010000:1.0:1746066757.321941:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e211c00 00000100:00100000:1.0:1746066757.321974:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983250432 00000100:00100000:1.0:1746066757.321977:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983250432 00002000:00100000:1.0:1746066757.321993:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88006e211880 x1830882983250432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.322000:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211880 with x1830882983250432 ext(1048576->2097151) 00002000:00010000:1.0:1746066757.322004:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211880 00000100:00100000:1.0:1746066757.322019:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4290 00000100:00100000:1.0:1746066757.322026:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983250304:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.322255:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4291 00000100:00100000:2.0:1746066757.322266:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983250432:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.332263:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983250432:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9991us (10506us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.332273:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4291 00002000:00100000:2.0:1746066757.332284:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88006e211880 x1830882983250432/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.332293:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211880 with x1830882983250432 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.332298:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211880 00000100:00100000:1.0:1746066757.337357:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:2015:x1830882983250304:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15318us (15647us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066757.337370:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4290 00002000:00100000:1.0:1746066757.337382:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88006e211c00 x1830882983250304/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.337392:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211c00 with x1830882983250304 ext(1048576->2097151) 00002000:00010000:1.0:1746066757.337399:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88006e211c00 00000100:00100000:0.0:1746066757.342400:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.342453:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.342549:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983250688 00000100:00100000:3.0:1746066757.342557:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983250688 00000100:00100000:1.0:1746066757.342766:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983250560 00000100:00100000:1.0:1746066757.342771:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983250560 00000100:00100000:0.0:1746066757.342776:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16015 00000100:00100000:0.0:1746066757.342784:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983250688:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066757.342802:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16016 00010000:00010000:0.0:1746066757.342806:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066757.342808:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983250560:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.342816:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.342819:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cb5600/0xf1867c21abfa73b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a0d expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.342824:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa73be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a06 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.342860:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984462720:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066757.342860:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984462848:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066757.342986:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.343005:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.344137:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4ed4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984462848:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066757.344151:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cb5600/0xf1867c21abfa73b7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a0d expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.344159:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cb5600/0xf1867c21abfa73b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a0d expref: 34 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.344169:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cb5600, rc 0) 00000100:00100000:2.0:1746066757.344187:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983250688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1406us (1796us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066757.344192:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16015 00000100:00100000:1.0:1746066757.344211:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984462720:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066757.344225:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa73be lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a06 expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.344235:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bde00/0xf1867c21abfa73be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a06 expref: 14 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.344245:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bde00, rc 0) 00000100:00100000:1.0:1746066757.344400:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983250560:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1591us (1946us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066757.344406:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16016 00000100:00100000:0.0:1746066757.345686:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.345735:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983250816 00000100:00100000:1.0:1746066757.345740:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983250816 00000100:00100000:1.0:1746066757.345765:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16017 00000100:00100000:1.0:1746066757.345769:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+13:721:x1830882983250816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.345778:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.345786:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a14 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.345803:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.345810:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066757.345811:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066757.345814:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 14 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.345828:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 20 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.345835:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 20 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.345841:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984462976:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.346146:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.347462:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984462976:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066757.347495:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 14 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.347506:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bd000, rc 0) 00000100:00100000:1.0:1746066757.347577:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+14:721:x1830882983250816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1805us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.347767:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16017 00000100:00100000:0.0:1746066757.349078:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.349144:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983250944 00000100:00100000:1.0:1746066757.349149:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983250944 00002000:00100000:1.0:1746066757.349180:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2809856->3145727) req@ffff8800a4ed7100 x1830882983250944/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.349193:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7100 with x1830882983250944 ext(2809856->3145727) 00010000:00010000:1.0:1746066757.349199:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 21 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.349210:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 21 pid: 20361 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.349217:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4ed7100 00000100:00100000:1.0:1746066757.349244:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 958 00000100:00100000:1.0:1746066757.349250:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983250944:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066757.353085:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983250944:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3826us (3999us total) trans 21474841870 rc 0/0 00000100:00100000:0.0:1746066757.353096:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 958 00002000:00100000:0.0:1746066757.353107:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2809856->3145727) req@ffff8800a4ed7100 x1830882983250944/t21474841870(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.353116:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed7100 with x1830882983250944 ext(2809856->3145727) 00010000:00010000:0.0:1746066757.353125:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.353137:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746066757.353143:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4ed7100 00000100:00100000:0.0:1746066757.358549:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.358654:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983251072 00000100:00100000:2.0:1746066757.358663:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983251072 00010000:00010000:2.0:1746066757.358700:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.358738:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7215 00000100:00100000:2.0:1746066757.358745:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983251072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.358757:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.358775:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.358795:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.358815:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418c00/0xf1867c21abfa738d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19dc expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.358843:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.358846:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.358853:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.358861:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.358918:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.358929:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984463104:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.358995:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.361428:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984463104:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.361445:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.361498:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983251072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2752us (2956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.361507:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7215 00000100:00100000:0.0:1746066757.363400:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.363499:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983251328 00000100:00100000:2.0:1746066757.363505:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983251328 00002000:00100000:2.0:1746066757.363539:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800a4ed5880 x1830882983251328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.363548:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed5880 with x1830882983251328 ext(2097152->3145727) 00002000:00010000:2.0:1746066757.363553:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed5880 00000100:00100000:2.0:1746066757.363582:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4292 00000100:00100000:2.0:1746066757.363590:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983251328:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.369753:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983251328:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6155us (6350us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.369764:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4292 00002000:00100000:2.0:1746066757.369775:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff8800a4ed5880 x1830882983251328/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.369784:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed5880 with x1830882983251328 ext(2097152->3145727) 00002000:00010000:2.0:1746066757.369789:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed5880 00000100:00100000:0.0:1746066757.373299:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.373385:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983251456 00000100:00100000:1.0:1746066757.373393:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983251456 00000100:00100000:1.0:1746066757.373482:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16018 00000100:00100000:1.0:1746066757.373489:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+33:721:x1830882983251456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.373503:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.373518:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a1b expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.373540:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.373546:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066757.373548:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066757.373551:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.373577:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 44 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.373588:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 44 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.373597:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984463232:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.374065:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.376539:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984463232:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066757.376564:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 34 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.376577:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6bcc00, rc 0) 00000100:00100000:1.0:1746066757.376617:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+34:721:x1830882983251456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3129us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.376624:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16018 00000100:00100000:0.0:1746066757.377583:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.377633:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983251584 00000100:00100000:2.0:1746066757.377640:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983251584 00002000:00100000:2.0:1746066757.377675:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2764799) req@ffff8800a4ed5180 x1830882983251584/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.377684:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed5180 with x1830882983251584 ext(2097152->2764799) 00010000:00010000:2.0:1746066757.377691:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 45 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.377703:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 45 pid: 20361 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746066757.377709:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ed5180 00000100:00100000:2.0:1746066757.377734:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 959 00000100:00100000:2.0:1746066757.377741:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983251584:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066757.382179:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983251584:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4431us (4592us total) trans 17179874420 rc 0/0 00000100:00100000:2.0:1746066757.382189:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 959 00002000:00100000:2.0:1746066757.382198:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2764799) req@ffff8800a4ed5180 x1830882983251584/t17179874420(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.382213:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed5180 with x1830882983251584 ext(2097152->2764799) 00010000:00010000:2.0:1746066757.382222:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 47 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.382235:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 47 pid: 20361 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746066757.382241:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4ed5180 00000100:00100000:0.0:1746066757.385543:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.385639:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983251712 00000100:00100000:2.0:1746066757.385647:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983251712 00010000:00010000:2.0:1746066757.385680:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 47 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.385719:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7216 00000100:00100000:2.0:1746066757.385726:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983251712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.385738:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.385752:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 47 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.385762:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 47 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.385782:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6000/0xf1867c21abfa7394 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2764799) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19e3 expref: 47 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.385807:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.385809:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.385815:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.385822:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.385849:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.385859:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984463360:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.386242:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.387721:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984463360:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.387733:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.387760:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983251712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2034us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.387768:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7216 00000100:00100000:0.0:1746066757.394776:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.394959:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983251968 00000100:00100000:2.0:1746066757.394968:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983251968 00002000:00100000:2.0:1746066757.395004:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009677d500 x1830882983251968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.395013:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d500 with x1830882983251968 ext(2097152->4194303) 00002000:00010000:2.0:1746066757.395018:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677d500 00000100:00100000:2.0:1746066757.395033:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4293 00000100:00100000:2.0:1746066757.395039:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983251968:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066757.395974:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.396011:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983252224 00000100:00100000:0.0:1746066757.396015:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983252224 00002000:00100000:0.0:1746066757.396035:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012c491c00 x1830882983252224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.396041:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491c00 with x1830882983252224 ext(3145728->4194303) 00002000:00010000:0.0:1746066757.396045:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491c00 00000100:00100000:0.0:1746066757.396071:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4294 00000100:00100000:0.0:1746066757.396077:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983252224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.410870:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983252224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14783us (14889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.410880:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4294 00002000:00100000:2.0:1746066757.410931:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff88012c491c00 x1830882983252224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.410940:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491c00 with x1830882983252224 ext(3145728->4194303) 00002000:00010000:2.0:1746066757.410945:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c491c00 00000100:00100000:2.0:1746066757.414240:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983251968:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19192us (19462us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066757.414250:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4293 00002000:00100000:2.0:1746066757.414259:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009677d500 x1830882983251968/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.414268:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d500 with x1830882983251968 ext(2097152->4194303) 00002000:00010000:2.0:1746066757.414273:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677d500 00000100:00100000:0.0:1746066757.428234:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.428329:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983252480 00000100:00100000:2.0:1746066757.428341:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983252480 00002000:00100000:2.0:1746066757.428386:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009677fb80 x1830882983252480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.428396:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677fb80 with x1830882983252480 ext(4194304->5033983) 00002000:00010000:2.0:1746066757.428401:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677fb80 00000100:00100000:2.0:1746066757.428428:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4295 00000100:00100000:2.0:1746066757.428436:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983252480:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.439452:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983252480:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11010us (11223us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066757.439461:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4295 00002000:00100000:2.0:1746066757.439485:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88009677fb80 x1830882983252480/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.439491:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677fb80 with x1830882983252480 ext(4194304->5033983) 00002000:00010000:2.0:1746066757.439496:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009677fb80 00000100:00100000:0.0:1746066757.439643:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.439717:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983252608 00000100:00100000:1.0:1746066757.439724:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983252608 00000100:00100000:1.0:1746066757.439820:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16019 00000100:00100000:1.0:1746066757.439826:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983252608:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.439838:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.439850:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a22 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.439872:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.439874:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.439880:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.439914:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 23 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.439922:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:1.0:1746066757.439949:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983252608:12345-192.168.204.16@tcp:101:cat.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.439953:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16019 00000100:00100000:0.0:1746066757.440088:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.440512:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983252736 00000100:00100000:1.0:1746066757.440516:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983252736 00000100:00100000:1.0:1746066757.440537:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16020 00000100:00100000:1.0:1746066757.440542:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983252736:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.440549:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.440558:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a29 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.440568:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.440570:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.440573:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 47 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.440582:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 47 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.440590:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d400, rc 0) 00000100:00100000:1.0:1746066757.440621:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983252736:12345-192.168.204.16@tcp:101:cat.0 Request processed in 75us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.440627:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16020 00000100:00100000:2.0:1746066757.457640:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.457719:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983252992 00000100:00100000:0.0:1746066757.457727:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983252992 00002000:00100000:0.0:1746066757.457769:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880094305c00 x1830882983252992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.457779:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830882983252992 ext(2097152->4194303) 00002000:00010000:0.0:1746066757.457784:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:0.0:1746066757.457812:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4296 00000100:00100000:0.0:1746066757.457819:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983252992:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066757.460004:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.460074:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983253248 00000100:00100000:3.0:1746066757.460082:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983253248 00002000:00100000:3.0:1746066757.460114:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009677d880 x1830882983253248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.460123:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d880 with x1830882983253248 ext(2097152->4194303) 00002000:00010000:3.0:1746066757.460127:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677d880 00000100:00100000:3.0:1746066757.460146:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4297 00000100:00100000:3.0:1746066757.460152:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983253248:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066757.474659:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.474873:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983252992:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17046us (17232us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066757.474906:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4296 00002000:00100000:2.0:1746066757.474915:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880094305c00 x1830882983252992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.474924:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305c00 with x1830882983252992 ext(2097152->4194303) 00002000:00010000:2.0:1746066757.474929:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094305c00 00000100:00100000:1.0:1746066757.475026:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983253376 00000100:00100000:1.0:1746066757.475035:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983253376 00000100:00100000:1.0:1746066757.475079:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16021 00000100:00100000:1.0:1746066757.475087:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+49:724:x1830882983253376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066757.475107:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.475125:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a30 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.475158:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.475166:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 50 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.475173:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.475175:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.475178:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2564096->3145727] (req 2564096->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 50 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.475209:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 50 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.475226:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 50 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746066757.475238:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984463488:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066757.475386:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 33 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.475403:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 33 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.475413:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984463616:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.475439:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.480978:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882983253248:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20818us (20975us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066757.480988:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4297 00002000:00100000:2.0:1746066757.480997:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88009677d880 x1830882983253248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.481005:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677d880 with x1830882983253248 ext(2097152->4194303) 00000100:00100000:1.0:1746066757.481006:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984463488:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.481013:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 49 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746066757.481016:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984463616:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.481024:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 49 pid: 12255 timeout: 825 lvb_type: 1 00002000:00010000:2.0:1746066757.481030:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677d880 00010000:00010000:1.0:1746066757.481037:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2564096->3145727] (req 2564096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.481050:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c000, rc 0) 00000100:00100000:1.0:1746066757.481068:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+48:724:x1830882983253376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5982us (6421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.481075:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16021 00000100:00100000:0.0:1746066757.481619:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.482185:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983253632 00000100:00100000:2.0:1746066757.482194:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983253632 00002000:00100000:2.0:1746066757.482224:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096993c50 x1830882983253632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.482231:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096993c50 with x1830882983253632 ext(4194304->5033983) 00002000:00010000:2.0:1746066757.482234:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096993c50 00000100:00100000:2.0:1746066757.482249:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4298 00000100:00100000:2.0:1746066757.482255:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983253632:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066757.489091:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.489158:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.489215:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.489280:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983254016 00000100:00100000:1.0:1746066757.489291:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983254016 00000100:00100000:1.0:1746066757.489344:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16022 00000100:00100000:1.0:1746066757.489351:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+48:729:x1830882983254016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.489366:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.489381:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a37 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.489404:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096993c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983253632:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7147us (7784us total) trans 0 rc 839680/839680 00010000:00010000:1.0:1746066757.489405:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.489410:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2564096->3145727] (req 2564096->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.489416:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746066757.489416:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4298 00010000:00010000:1.0:1746066757.489419:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746066757.489427:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880096993c50 x1830882983253632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 839680/839680 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.489436:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096993c50 with x1830882983253632 ext(4194304->5033983) 00002000:00010000:0.0:1746066757.489442:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096993c50 00010000:00010000:1.0:1746066757.489450:0:12255:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2564096->3145727] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.489480:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.489489:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155ce00, rc 0) 00000100:00100000:1.0:1746066757.489531:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+49:729:x1830882983254016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 180us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.489536:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16022 00000100:00100000:3.0:1746066757.489760:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983253888 00000100:00100000:3.0:1746066757.489765:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983253888 00010000:00010000:3.0:1746066757.489784:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 49 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.489802:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983253760 00000100:00100000:3.0:1746066757.489804:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983253760 00010000:00010000:3.0:1746066757.489813:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 34 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.489826:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7217 00000100:00100000:3.0:1746066757.489831:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882983253888:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.489838:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.489851:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 49 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.489859:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 49 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.489873:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d400/0xf1867c21abfa73da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a29 expref: 49 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.489906:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.489927:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882983253888:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.489933:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7217 00000100:00100000:3.0:1746066757.489946:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7218 00000100:00100000:3.0:1746066757.489950:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983253760:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.489956:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.489962:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 34 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.489970:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 34 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.489980:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6bcc00/0xf1867c21abfa73cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a1b expref: 34 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.489987:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.489988:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.489992:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.489998:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.490013:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 47 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.490022:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 47 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.490031:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984463872:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066757.490066:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.495638:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984463872:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066757.495662:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.495719:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983253760:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5766us (6560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.495730:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7218 00000100:00100000:2.0:1746066757.496738:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.496803:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983254272 00000100:00100000:1.0:1746066757.496811:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983254272 00002000:00100000:1.0:1746066757.496850:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2564096->2568191) req@ffff880094305f80 x1830882983254272/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.496865:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830882983254272 ext(2564096->2568191) 00010000:00010000:1.0:1746066757.496874:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 48 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.496924:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 48 pid: 12255 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.496931:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094305f80 00000100:00100000:1.0:1746066757.496963:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 960 00000100:00100000:1.0:1746066757.496971:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983254272:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066757.497645:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983254272:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 673us (1102us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066757.497653:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 960 00002000:00100000:1.0:1746066757.497658:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2564096->2568191) req@ffff880094305f80 x1830882983254272/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.497666:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305f80 with x1830882983254272 ext(2564096->2568191) 00010000:00010000:1.0:1746066757.497671:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 48 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.497681:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 48 pid: 12255 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.497688:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094305f80 00000100:00100000:0.0:1746066757.511072:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.511129:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.511227:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983254656 00000100:00100000:2.0:1746066757.511238:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983254656 00000100:00100000:1.0:1746066757.511264:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983254528 00000100:00100000:1.0:1746066757.511273:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983254528 00000100:00100000:2.0:1746066757.511313:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16023 00000100:00100000:2.0:1746066757.511322:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+23:724:x1830882983254656:12345-192.168.204.16@tcp:101:multiop.0 00002000:00100000:1.0:1746066757.511322:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2564096->3145727) req@ffff880095ce2680 x1830882983254528/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.511333:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2680 with x1830882983254528 ext(2564096->3145727) 00010000:00010000:1.0:1746066757.511344:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 48 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.511348:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.511359:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 48 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.511365:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a3e expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066757.511365:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ce2680 00000100:00100000:1.0:1746066757.511385:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 961 00000100:00100000:1.0:1746066757.511392:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882983254528:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:2.0:1746066757.511397:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.511406:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 24 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.511412:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.511413:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.511417:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3186687] (req 3145728->3186687) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.511448:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 24 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.511458:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 24 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066757.511478:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.512072:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 13 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.512081:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 13 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.512088:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464128:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.512403:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f180 going to sleep for 11 seconds 00010000:00010000:1.0:1746066757.518013:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066757.518051:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464000:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.518758:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464128:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.518792:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->3186687] (req 3145728->3186687) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.518810:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6200, rc 0) 00000100:00100000:2.0:1746066757.518872:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+24:724:x1830882983254656:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 7549us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.518918:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16023 00000100:00100000:0.0:1746066757.521588:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.522326:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.522489:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983254912 00000100:00100000:2.0:1746066757.522498:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983254912 00010000:00010000:2.0:1746066757.522538:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 14 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.522581:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7219 00000100:00100000:2.0:1746066757.522590:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983254912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.522605:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.522627:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 14 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.522637:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 14 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.522659:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6bd000/0xf1867c21abfa73c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a14 expref: 14 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.522679:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.522721:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2014:x1830882983254912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 132us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.522728:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7219 00000100:00100000:1.0:1746066757.523162:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983254784 00000100:00100000:1.0:1746066757.523167:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983254784 00010000:00010000:1.0:1746066757.523184:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 24 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746066757.524280:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7220 00000100:00100000:1.0:1746066757.524288:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882983254784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.524298:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066757.524313:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 24 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.524322:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 24 pid: 12255 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.524340:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa73d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a22 expref: 24 pid: 12255 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.524361:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882983254528:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 12968us (13300us total) trans 17179874421 rc 0/0 00000100:00100000:0.0:1746066757.524371:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 961 00002000:00100000:0.0:1746066757.524380:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2564096->3145727) req@ffff880095ce2680 x1830882983254528/t17179874421(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.524389:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce2680 with x1830882983254528 ext(2564096->3145727) 00010000:00010000:0.0:1746066757.524395:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 50 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.524408:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 50 pid: 12255 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746066757.524414:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095ce2680 00010000:00010000:1.0:1746066757.524437:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.524439:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.524532:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.524541:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.524574:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 23 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.524586:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984464256:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066757.524672:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.526829:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984464256:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066757.526848:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066757.526904:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983254784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2617us (4579us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.526913:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7220 00000100:00100000:0.0:1746066757.526941:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.527288:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983255168 00000100:00100000:1.0:1746066757.527294:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983255168 00002000:00100000:1.0:1746066757.527326:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3182592->3186687) req@ffff880095ce0700 x1830882983255168/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.527341:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0700 with x1830882983255168 ext(3182592->3186687) 00002000:00010000:1.0:1746066757.527345:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce0700 00000100:00100000:1.0:1746066757.527360:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4299 00000100:00100000:1.0:1746066757.527366:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983255168:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066757.527844:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983255168:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 476us (903us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066757.527850:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4299 00002000:00100000:1.0:1746066757.527856:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3182592->3186687) req@ffff880095ce0700 x1830882983255168/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.527863:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce0700 with x1830882983255168 ext(3182592->3186687) 00002000:00010000:1.0:1746066757.527866:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce0700 00000100:00100000:0.0:1746066757.527909:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.527926:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983255296 00000100:00100000:1.0:1746066757.527929:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983255296 00010000:00010000:1.0:1746066757.527945:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 50 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.527990:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.528015:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7221 00000100:00100000:1.0:1746066757.528021:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983255296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.528030:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066757.528045:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 50 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.528100:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 50 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.528312:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa73e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2564096->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a30 expref: 50 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.528473:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.528476:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.528484:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.528493:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.528525:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.528536:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984464384:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066757.528604:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096e3a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.528633:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983255424 00000100:00100000:2.0:1746066757.528637:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983255424 00000100:00100000:2.0:1746066757.528661:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16024 00000100:00100000:2.0:1746066757.528666:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:726:x1830882983255424:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066757.528676:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.528687:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a45 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.528702:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.528708:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066757.528709:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066757.528712:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.528729:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 22 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.528739:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 22 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.528747:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464512:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.528782:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.531220:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984464384:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066757.531239:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.531265:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464512:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.531287:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [4030464->4194303] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.531295:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882983255296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3274us (3385us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066757.531302:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8800, rc 0) 00000100:00100000:0.0:1746066757.531305:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7221 00000100:00100000:3.0:1746066757.531323:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:726:x1830882983255424:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2656us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.531329:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16024 00000100:00100000:3.0:1746066757.533058:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.533109:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.533189:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983255552 00000100:00100000:1.0:1746066757.533197:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983255552 00000100:00100000:0.0:1746066757.533226:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983255808 00000100:00100000:0.0:1746066757.533229:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983255808 00002000:00100000:1.0:1746066757.533236:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3186687) req@ffff8800a4d00a80 x1830882983255552/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.533245:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800a4d02d80 x1830882983255808/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.533246:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d00a80 with x1830882983255552 ext(3145728->3186687) 00002000:00100000:0.0:1746066757.533251:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d02d80 with x1830882983255808 ext(2097152->3145727) 00010000:00010000:1.0:1746066757.533253:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 23 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746066757.533255:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d02d80 00010000:00010000:1.0:1746066757.533266:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 23 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.533273:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d00a80 00000100:00100000:0.0:1746066757.533336:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 962 00000100:00100000:1.0:1746066757.533340:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4300 00000100:00100000:0.0:1746066757.533347:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983255552:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066757.533403:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882983255808:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066757.537099:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983255552:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 3745us (4035us total) trans 21474841871 rc 0/0 00000100:00100000:0.0:1746066757.537113:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 962 00002000:00100000:0.0:1746066757.537125:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->3186687) req@ffff8800a4d00a80 x1830882983255552/t21474841871(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.537135:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d00a80 with x1830882983255552 ext(3145728->3186687) 00010000:00010000:0.0:1746066757.537145:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 25 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.537161:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 25 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:0.0:1746066757.537167:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4d00a80 00000100:00100000:1.0:1746066757.541029:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882983255808:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 7672us (7907us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066757.541042:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4300 00002000:00100000:1.0:1746066757.541053:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff8800a4d02d80 x1830882983255808/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.541063:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d02d80 with x1830882983255808 ext(2097152->3145727) 00002000:00010000:1.0:1746066757.541069:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d02d80 00000100:00100000:0.0:1746066757.542606:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.542844:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983255936 00000100:00100000:2.0:1746066757.542853:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983255936 00010000:00010000:2.0:1746066757.542914:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 25 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.542945:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7222 00000100:00100000:2.0:1746066757.542953:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983255936:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.542968:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.542984:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 25 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.542996:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 25 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.543016:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acda6200/0xf1867c21abfa73ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3186687) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a3e expref: 25 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.543046:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.543048:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.543055:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.543063:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.543092:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.543103:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984464640:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.543573:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.545039:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.545123:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983256064 00000100:00100000:3.0:1746066757.545134:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983256064 00000100:00100000:3.0:1746066757.545168:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16025 00000100:00100000:3.0:1746066757.545175:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:729:x1830882983256064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.545188:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.545202:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a4c expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.545222:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.545228:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.545229:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.545233:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 26 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.545254:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 13 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.545264:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 13 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.545273:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464768:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.545637:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.546032:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984464640:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.546046:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.546145:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983255936:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3191us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.546154:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7222 00000100:00100000:0.0:1746066757.546775:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.546910:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984464768:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.546925:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 25 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.546927:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983256320 00000100:00100000:1.0:1746066757.546932:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983256320 00010000:00010000:3.0:1746066757.546936:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05800, rc 0) 00002000:00100000:1.0:1746066757.546958:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4034559) req@ffff880095ce1f80 x1830882983256320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746066757.546966:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:729:x1830882983256064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1792us (1930us total) trans 0 rc 0/0 00002000:00100000:1.0:1746066757.546967:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1f80 with x1830882983256320 ext(4030464->4034559) 00000100:00100000:3.0:1746066757.546971:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16025 00010000:00010000:1.0:1746066757.546973:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.546983:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.546989:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1f80 00000100:00100000:1.0:1746066757.547002:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 963 00000100:00100000:1.0:1746066757.547008:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983256320:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066757.547096:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983256320:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 87us (321us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066757.547102:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 963 00002000:00100000:1.0:1746066757.547106:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4034559) req@ffff880095ce1f80 x1830882983256320/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.547113:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1f80 with x1830882983256320 ext(4030464->4034559) 00010000:00010000:1.0:1746066757.547118:0:29518:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.547125:0:29518:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.547130:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1f80 00000100:00100000:0.0:1746066757.550641:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.550679:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.550683:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983256704 00000100:00100000:3.0:1746066757.550688:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983256704 00000100:00100000:3.0:1746066757.550716:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16026 00000100:00100000:3.0:1746066757.550720:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+33:726:x1830882983256704:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066757.550732:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.550745:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a53 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.550747:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983256576 00000100:00100000:1.0:1746066757.550752:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983256576 00010000:00010000:3.0:1746066757.550772:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 48 pid: 12255 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066757.550774:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4194303) req@ffff880095ce1880 x1830882983256576/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746066757.550778:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.550779:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.550783:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->3764223] (req 3145728->3764223) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746066757.550783:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1880 with x1830882983256576 ext(4030464->4194303) 00010000:00010000:1.0:1746066757.550789:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.550801:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 14 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.550806:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 48 pid: 12255 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066757.550807:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1880 00010000:00010000:3.0:1746066757.550815:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 48 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.550824:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984464896:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.550831:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 964 00000100:00100000:1.0:1746066757.550838:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983256576:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066757.550975:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.552301:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984464896:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.552319:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->3764223] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 34 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.552330:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04a00, rc 0) 00000100:00100000:3.0:1746066757.552354:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+34:726:x1830882983256704:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1632us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.552360:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16026 00000100:00100000:1.0:1746066757.552839:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+16:2013:x1830882983256576:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 2000us (2157us total) trans 21474841872 rc 0/0 00000100:00100000:1.0:1746066757.552848:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 964 00002000:00100000:1.0:1746066757.552855:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4030464->4194303) req@ffff880095ce1880 x1830882983256576/t21474841872(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.552863:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce1880 with x1830882983256576 ext(4030464->4194303) 00010000:00010000:1.0:1746066757.552870:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 16 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.552906:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 16 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:1.0:1746066757.552912:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095ce1880 00000100:00100000:0.0:1746066757.553493:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.553560:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983256832 00000100:00100000:2.0:1746066757.553565:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983256832 00010000:00010000:2.0:1746066757.553587:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.553605:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7223 00000100:00100000:2.0:1746066757.553611:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882983256832:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.553621:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.553637:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.553645:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.553665:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155ce00/0xf1867c21abfa73e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a37 expref: 49 pid: 12255 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.553691:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.553693:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.553698:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.553706:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.553739:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.553750:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984465024:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.553801:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.554274:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.554319:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983256960 00000100:00100000:0.0:1746066757.554322:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983256960 00010000:00010000:0.0:1746066757.554336:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 16 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.554364:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7224 00000100:00100000:0.0:1746066757.554369:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983256960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.554376:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.554386:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 16 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.554394:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 16 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.554405:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa73f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4030464->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a45 expref: 16 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.554427:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.554429:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.554433:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.554439:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.554455:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.554477:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984465152:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066757.554519:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.555229:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984465024:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066757.555242:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.555271:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983256832:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1658us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.555278:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7223 00000100:00100000:0.0:1746066757.555439:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ce3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984465152:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066757.555448:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.555482:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983256960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1112us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.555488:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7224 00000100:00100000:0.0:1746066757.557169:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.557230:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983257216 00000100:00100000:1.0:1746066757.557238:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983257216 00002000:00100000:1.0:1746066757.557272:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095ce3100 x1830882983257216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.557280:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3100 with x1830882983257216 ext(3145728->4194303) 00002000:00010000:1.0:1746066757.557284:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce3100 00000100:00100000:1.0:1746066757.557311:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4301 00000100:00100000:1.0:1746066757.557317:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882983257216:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066757.562366:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.562432:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983257472 00000100:00100000:0.0:1746066757.562443:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983257472 00002000:00100000:0.0:1746066757.562500:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3760128->3764223) req@ffff880094305500 x1830882983257472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.562511:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830882983257472 ext(3760128->3764223) 00002000:00010000:0.0:1746066757.562517:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305500 00000100:00100000:0.0:1746066757.562554:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4302 00000100:00100000:0.0:1746066757.562562:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983257472:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066757.562721:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983257472:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 159us (360us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066757.562728:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4302 00002000:00100000:0.0:1746066757.562734:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7a:0x0] (3760128->3764223) req@ffff880094305500 x1830882983257472/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.562741:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094305500 with x1830882983257472 ext(3760128->3764223) 00002000:00010000:0.0:1746066757.562745:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094305500 00000100:00100000:1.0:1746066757.567187:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882983257216:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9862us (10017us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066757.567199:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4301 00002000:00100000:1.0:1746066757.567209:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880095ce3100 x1830882983257216/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.567218:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ce3100 with x1830882983257216 ext(3145728->4194303) 00002000:00010000:1.0:1746066757.567224:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095ce3100 00000100:00100000:0.0:1746066757.570688:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.570792:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983257600 00000100:00100000:3.0:1746066757.570799:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983257600 00000100:00100000:3.0:1746066757.571319:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16027 00000100:00100000:3.0:1746066757.571326:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:729:x1830882983257600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.571339:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.571352:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a5a expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.571376:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.571382:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.571383:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066757.571386:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 49 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.571408:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 33 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.571417:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 33 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.571426:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984465280:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.572686:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.574429:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984465280:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.574458:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 49 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.574487:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05e00, rc 0) 00000100:00100000:3.0:1746066757.575138:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:729:x1830882983257600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3805us (4449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.575147:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16027 00000100:00100000:1.0:1746066757.575311:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.575369:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983257728 00000100:00100000:2.0:1746066757.575376:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983257728 00002000:00100000:2.0:1746066757.575410:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3764223) req@ffff88009c7fdf80 x1830882983257728/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.575420:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fdf80 with x1830882983257728 ext(3145728->3764223) 00010000:00010000:2.0:1746066757.575426:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 34 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.575438:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 34 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746066757.575445:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fdf80 00000100:00100000:2.0:1746066757.575479:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 965 00000100:00100000:2.0:1746066757.575486:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+34:2015:x1830882983257728:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:2.0:1746066757.582015:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983257728:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6521us (6696us total) trans 17179874422 rc 0/0 00000100:00100000:2.0:1746066757.582026:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 965 00002000:00100000:2.0:1746066757.582036:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->3764223) req@ffff88009c7fdf80 x1830882983257728/t17179874422(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.582054:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fdf80 with x1830882983257728 ext(3145728->3764223) 00010000:00010000:2.0:1746066757.582063:0:20360:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 36 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.582075:0:20360:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 36 pid: 9590 timeout: 825 lvb_type: 0 00002000:00010000:2.0:1746066757.582080:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fdf80 00000100:00100000:0.0:1746066757.584080:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.584132:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983257856 00000100:00100000:2.0:1746066757.584139:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983257856 00010000:00010000:2.0:1746066757.584165:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 36 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.584197:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7225 00000100:00100000:2.0:1746066757.584202:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983257856:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.584212:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.584225:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 36 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.584238:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 36 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.584386:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d04a00/0xf1867c21abfa7404 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3764223) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a53 expref: 36 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.584477:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.584480:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.584486:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.584493:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.584524:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.584535:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984465408:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.584594:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.586560:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7230:1830882984465408:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.586577:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.586612:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+35:2016:x1830882983257856:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2409us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.586621:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7225 00000100:00100000:0.0:1746066757.589413:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.589640:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983258112 00000100:00100000:2.0:1746066757.589649:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983258112 00002000:00100000:2.0:1746066757.589684:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095ceca80 x1830882983258112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.589693:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceca80 with x1830882983258112 ext(3145728->4194303) 00002000:00010000:2.0:1746066757.589698:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ceca80 00000100:00100000:2.0:1746066757.589725:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4303 00000100:00100000:2.0:1746066757.589731:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882983258112:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066757.596737:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:2015:x1830882983258112:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 6997us (7321us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.596749:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4303 00002000:00100000:2.0:1746066757.596760:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880095ceca80 x1830882983258112/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.596769:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceca80 with x1830882983258112 ext(3145728->4194303) 00002000:00010000:2.0:1746066757.596774:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ceca80 00000100:00100000:0.0:1746066757.605332:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.605418:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983258368 00000100:00100000:2.0:1746066757.605426:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983258368 00002000:00100000:2.0:1746066757.605472:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095cec700 x1830882983258368/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.605480:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec700 with x1830882983258368 ext(4194304->5033983) 00002000:00010000:2.0:1746066757.605484:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cec700 00000100:00100000:2.0:1746066757.605501:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4304 00000100:00100000:2.0:1746066757.605507:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983258368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.611363:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983258368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5848us (6032us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066757.611375:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4304 00002000:00100000:2.0:1746066757.611385:0:20360:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095cec700 x1830882983258368/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.611394:0:20360:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cec700 with x1830882983258368 ext(4194304->5033983) 00002000:00010000:2.0:1746066757.611399:0:20360:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cec700 00000100:00100000:0.0:1746066757.626188:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.626325:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983258496 00000100:00100000:3.0:1746066757.626334:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983258496 00000100:00100000:3.0:1746066757.626390:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16296 00000100:00100000:3.0:1746066757.626398:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:734:x1830882983258496:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066757.626425:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.626443:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a61 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.626512:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626525:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626535:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626546:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626551:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626555:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626628:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626638:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 43 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.626644:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 60 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.626649:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.626679:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 60 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.626691:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 60 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.626702:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465536:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.626857:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 43 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.626864:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 43 pid: 7244 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.626871:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465664:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.626930:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.630577:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.630614:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.630668:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983258752 00000100:00100000:1.0:1746066757.630679:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983258752 00000100:00100000:1.0:1746066757.630720:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983259008 00000100:00100000:1.0:1746066757.630722:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983259008 00000100:00100000:3.0:1746066757.630738:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465536:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.630750:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465664:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.630761:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5946 00000100:00100000:1.0:1746066757.630769:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+61:30848:x1830882983258752:12345-192.168.204.16@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746066757.630772:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:3.0:1746066757.630815:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5947 00000100:00100000:3.0:1746066757.630824:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+44:30847:x1830882983259008:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066757.631085:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+62:30848:x1830882983258752:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 262us (463us total) trans 8589936629 rc 0/0 00000100:00100000:1.0:1746066757.631094:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5946 00000100:00100000:3.0:1746066757.631125:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+45:30847:x1830882983259008:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 301us (508us total) trans 8589936630 rc 0/0 00000100:00100000:3.0:1746066757.631132:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5947 00000100:00100000:0.0:1746066757.632648:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.632810:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983259136 00000100:00100000:2.0:1746066757.632816:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983259136 00010000:00010000:2.0:1746066757.632840:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 62 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.632865:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7226 00000100:00100000:2.0:1746066757.632870:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+62:2016:x1830882983259136:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.632880:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.632906:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 62 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.632915:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 62 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.632932:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a22e00/0xf1867c21abfa7316 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d196c expref: 62 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.633420:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.633512:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983259264 00000100:00100000:0.0:1746066757.633516:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983259264 00010000:00010000:0.0:1746066757.633528:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 45 pid: 7244 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.633544:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7227 00000100:00100000:0.0:1746066757.633548:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+45:2014:x1830882983259264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.633554:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.633557:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 45 pid: 7244 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.633564:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 45 pid: 7244 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.633574:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0153a00/0xf1867c21abfa7298 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d18fc expref: 45 pid: 7244 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.633600:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.633604:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.633612:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.633618:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066757.633964:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.633968:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.634006:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+44:2014:x1830882983259264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 456us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.634012:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7227 00010000:00010000:2.0:1746066757.634175:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.634199:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+61:2016:x1830882983259136:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1328us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.634207:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7226 00010000:00010000:3.0:1746066757.634273:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634280:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:3.0:1746066757.634318:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:3.0:1746066757.634320:0:13370:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066757.634331:0:13370:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634339:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634348:0:13370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634353:0:13370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634358:0:13370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634366:0:13370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066757.634369:0:13370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634374:0:13370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634381:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066757.634383:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066757.634385:0:13370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634389:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05200/0xf1867c21abfa7419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634397:0:13370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634402:0:13370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634406:0:13370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634409:0:13370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d05000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066757.634410:0:13370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634414:0:13370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634418:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880096476300) 00010000:00010000:3.0:1746066757.634420:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066757.634422:0:13370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634426:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05000/0xf1867c21abfa7420 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.634457:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.634474:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 16 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.634479:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.634481:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066757.634483:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04800, rc 0) 00000100:00100000:3.0:1746066757.634516:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:734:x1830882983258496:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 8119us (8338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.634522:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16296 00000100:00100000:0.0:1746066757.637515:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.637546:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.637569:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.637600:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.637618:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983259392 00000100:00100000:0.0:1746066757.637623:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983259392 00000100:00100000:0.0:1746066757.637651:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983259648 00000100:00100000:0.0:1746066757.637652:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983259648 00000100:00100000:0.0:1746066757.637663:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983259520 00000100:00100000:0.0:1746066757.637665:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983259520 00000100:00100000:0.0:1746066757.637673:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983259776 00000100:00100000:0.0:1746066757.637675:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983259776 00000100:00100000:0.0:1746066757.637685:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16028 00000100:00100000:0.0:1746066757.637691:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983259392:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066757.637705:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.637720:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a68 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.637742:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.637743:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.637751:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.637762:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.637775:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44c00, rc 0) 00000100:00100000:0.0:1746066757.637806:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983259392:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 114us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.637811:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16028 00000100:00100000:0.0:1746066757.637822:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16029 00000100:00100000:0.0:1746066757.637826:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983259648:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066757.637833:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.637840:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a76 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.637850:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.637851:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.637855:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.637862:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.637869:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44000, rc 0) 00000100:00100000:0.0:1746066757.637898:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983259648:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 55us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.637903:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16029 00000100:00100000:0.0:1746066757.637913:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16030 00000100:00100000:0.0:1746066757.637917:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983259520:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066757.637924:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.637930:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a6f expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.637939:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.637940:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.637944:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.637951:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.637957:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45e00, rc 0) 00000100:00100000:0.0:1746066757.637969:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983259520:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 52us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.637973:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16030 00000100:00100000:0.0:1746066757.637981:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16031 00000100:00100000:0.0:1746066757.637985:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983259776:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066757.637990:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.637995:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a7d expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.638003:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.638004:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.638007:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.638014:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 10 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.638021:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44a00, rc 0) 00000100:00100000:0.0:1746066757.638033:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983259776:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 48us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.638037:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16031 00000100:00100000:1.0:1746066757.641834:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.641924:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983260032 00000100:00100000:3.0:1746066757.641937:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983260032 00000100:00100000:3.0:1746066757.642010:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16297 00000100:00100000:3.0:1746066757.642017:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:734:x1830882983260032:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066757.642033:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.642050:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04000/0xf1867c21abfa744a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a84 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.642141:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.642152:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.642158:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.642183:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.642193:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 17 pid: 13370 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.642205:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465792:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.642303:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.645091:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.645183:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465792:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.645202:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:2.0:1746066757.645273:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983260160 00000100:00100000:2.0:1746066757.645279:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983260160 00010000:00010000:2.0:1746066757.645369:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 18 pid: 13370 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.645400:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7228 00000100:00100000:2.0:1746066757.645407:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983260160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.645418:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.645422:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 18 pid: 13370 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.645430:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 18 pid: 13370 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.645446:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7427 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a61 expref: 18 pid: 13370 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.645477:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.645481:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.645488:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.645493:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.645510:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066757.645534:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.645541:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:2.0:1746066757.645541:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983260160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 135us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.645547:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7228 00000004:00200000:3.0:1746066757.645560:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066757.645665:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04000/0xf1867c21abfa744a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.645692:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.645699:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.645702:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066757.645704:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04200, rc 0) 00000100:00100000:3.0:1746066757.645736:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:734:x1830882983260032:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3719us (3910us total) trans 8589936631 rc 0/0 00000100:00100000:3.0:1746066757.645742:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16297 00000100:00100000:0.0:1746066757.647666:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.647748:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983260288 00000100:00100000:3.0:1746066757.647754:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983260288 00000100:00100000:3.0:1746066757.647784:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16298 00000100:00100000:3.0:1746066757.647791:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:734:x1830882983260288:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066757.647810:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.647823:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04400/0xf1867c21abfa745f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a8b expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.647912:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.647924:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.647930:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.647954:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.647964:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 18 pid: 13370 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.647974:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465920:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.648048:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.650527:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984465920:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.650546:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:0.0:1746066757.651762:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.653374:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983260416 00000100:00100000:2.0:1746066757.653383:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983260416 00010000:00010000:2.0:1746066757.653414:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 19 pid: 13370 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.653438:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7229 00000100:00100000:2.0:1746066757.653444:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2016:x1830882983260416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.653455:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.653471:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 19 pid: 13370 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.653482:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 19 pid: 13370 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.653501:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04200/0xf1867c21abfa7451 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a84 expref: 19 pid: 13370 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.653529:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.653532:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.653540:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.653545:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.653561:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.653602:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983260416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 158us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.653608:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7229 00010000:00010000:3.0:1746066757.653674:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.653680:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:3.0:1746066757.653722:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:3.0:1746066757.653726:0:13370:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066757.653738:0:13370:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.653761:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04400/0xf1867c21abfa745f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a8b expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.653772:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a8b expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.653778:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.653780:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066757.653782:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d05a00, rc 0) 00000100:00100000:3.0:1746066757.653806:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:734:x1830882983260288:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 6015us (6144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.653811:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16298 00000100:00100000:0.0:1746066757.657189:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.657246:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983260672 00000100:00100000:3.0:1746066757.657253:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983260672 00000100:00100000:3.0:1746066757.657284:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16299 00000100:00100000:3.0:1746066757.657291:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:734:x1830882983260672:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066757.657304:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.657317:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04a00/0xf1867c21abfa746d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a92 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.657394:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7474 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.657406:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066757.657415:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:3.0:1746066757.657426:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00010000:00010000:3.0:1746066757.657508:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04a00/0xf1867c21abfa746d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a92 expref: 20 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.657519:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7474 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a92 expref: 19 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.657530:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.657532:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066757.657535:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d04800, rc 0) 00000100:00100000:3.0:1746066757.657582:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:734:x1830882983260672:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 290us (399us total) trans 8589936632 rc 0/0 00000100:00100000:3.0:1746066757.657587:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16299 00000100:00100000:0.0:1746066757.659827:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.660359:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.660385:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.660407:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.660422:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.660448:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.660510:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983260800 00000100:00100000:3.0:1746066757.660519:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983260800 00000100:00100000:0.0:1746066757.660520:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261056 00000100:00100000:0.0:1746066757.660530:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261056 00000100:00100000:3.0:1746066757.660554:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261312 00000100:00100000:3.0:1746066757.660557:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261312 00000100:00100000:0.0:1746066757.660567:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983260928 00000100:00100000:0.0:1746066757.660569:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983260928 00000100:00100000:3.0:1746066757.660573:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261184 00000100:00100000:3.0:1746066757.660575:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261184 00000100:00100000:0.0:1746066757.660581:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261440 00000100:00100000:0.0:1746066757.660583:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261440 00000100:00100000:3.0:1746066757.660592:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16032 00000100:00100000:3.0:1746066757.660606:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983260800:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066757.660643:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660658:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660665:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.660672:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 24 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.660678:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.660679:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.660682:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660708:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 24 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.660719:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 24 pid: 12233 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.660735:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984466048:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.660791:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16033 00010000:00010000:3.0:1746066757.660799:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 14 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066757.660799:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983261056:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066757.660807:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 14 pid: 20361 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.660815:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984466176:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.660833:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660838:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 14 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660845:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 14 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.660848:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.660853:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984466304:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.660860:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.660867:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066757.660868:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76000 going to sleep for 11 seconds 00010000:00010000:0.0:1746066757.660873:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.660875:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.660877:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.660912:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16034 00000100:00100000:3.0:1746066757.660919:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983261312:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066757.660929:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 34 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.660934:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660943:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660954:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.660959:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.660961:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.660963:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.660978:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.660986:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 14 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.660994:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984466560:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.661021:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.661029:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.661036:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984466688:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.661049:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.661065:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16035 00000100:00100000:3.0:1746066757.661071:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983260928:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066757.661089:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.661098:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 48 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.661104:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.661111:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.661116:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.661117:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.661119:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.661132:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 34 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.661615:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 34 pid: 20361 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.661629:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984466432:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.661681:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.661690:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.661698:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984466944:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.661723:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 48 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.661731:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 48 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.661738:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984467072:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.661752:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.661778:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16036 00000100:00100000:0.0:1746066757.661785:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983261184:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066757.661806:0:20361:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.661816:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.661823:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.661829:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.661835:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.661836:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.661838:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.661859:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.661867:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.661875:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984467200:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.661929:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 14 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.661937:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 14 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.661945:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984467328:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.661964:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.661971:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 24 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.661978:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984467456:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.661989:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460240 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.662005:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16037 00000100:00100000:0.0:1746066757.662010:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983261440:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:0.0:1746066757.662029:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.662038:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.662044:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.662049:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.662051:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.662052:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.662066:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.662073:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.662081:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984467584:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.662099:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.662106:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.662119:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984467712:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.662131:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009fc0a180 going to sleep for 11 seconds 00010000:00010000:3.0:1746066757.662668:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 34 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.662682:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984466816:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.663294:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 12 pid: 9592 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.663311:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.663319:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984467840:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.663349:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 48 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.663355:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 48 pid: 9592 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.663362:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984467968:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.663374:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066757.671436:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984466048:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.671436:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984466560:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.671448:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984466176:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.671455:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984466304:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.671484:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984467200:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.671490:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.671493:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984467328:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.671499:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984467456:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.671510:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce07800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984467584:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.671515:0:20361:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.671538:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984466432:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.671546:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984466944:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.671554:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce05880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984467072:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.671556:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984467712:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066757.671566:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.671572:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.671598:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.671611:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984466688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.671612:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066757.671622:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.671640:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.671665:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261696 00000100:00100000:2.0:1746066757.671670:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261696 00010000:00010000:2.0:1746066757.671695:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 25 pid: 12233 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066757.671712:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262080 00000100:00100000:2.0:1746066757.671714:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262080 00010000:00010000:2.0:1746066757.671721:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 26 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.671731:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261824 00000100:00100000:2.0:1746066757.671732:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261824 00010000:00010000:2.0:1746066757.671739:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 15 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066757.671757:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7230 00000100:00100000:2.0:1746066757.671763:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983261696:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.671773:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.671788:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 26 pid: 12233 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.671797:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 26 pid: 12233 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.671815:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7037 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d172e expref: 26 pid: 12233 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.671830:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.671858:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983261696:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.671864:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7230 00000100:00100000:2.0:1746066757.671876:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7231 00000100:00100000:2.0:1746066757.671879:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983262080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.671903:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.671910:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.671917:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.671927:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d05800/0xf1867c21abfa73fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a4c expref: 24 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.671935:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.671946:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983262080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.671951:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7231 00000100:00100000:2.0:1746066757.671959:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7232 00000100:00100000:2.0:1746066757.671962:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983261824:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.671967:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.671972:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 15 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.671979:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 15 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.671988:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44000/0xf1867c21abfa7435 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a76 expref: 15 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.671995:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.671996:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.671999:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672006:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672020:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.672031:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983261824:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 67us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.672035:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7232 00010000:00010000:2.0:1746066757.672048:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672054:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672070:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672076:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672082:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672087:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066757.672090:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672096:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672102:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.672107:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa7490 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.672134:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983261312:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 11216us (11749us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.672141:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16034 00000100:00100000:1.0:1746066757.672524:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.672549:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.672558:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261568 00000100:00100000:1.0:1746066757.672559:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262208 00000100:00100000:1.0:1746066757.672561:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262208 00000100:00100000:3.0:1746066757.672562:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261568 00010000:00010000:3.0:1746066757.672575:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 13 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.672575:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 49 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.672591:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7233 00000100:00100000:3.0:1746066757.672594:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7234 00000100:00100000:1.0:1746066757.672595:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882983262208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066757.672598:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983261568:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.672602:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.672603:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.672610:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 13 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.672612:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 49 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.672618:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 13 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.672619:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 49 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.672628:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098fadc00/0xf1867c21abfa70a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d176d expref: 13 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.672629:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094419600/0xf1867c21abfa737f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ce expref: 49 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.672639:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066757.672639:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066757.672656:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882983262208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 60us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.672661:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7233 00000100:00100000:3.0:1746066757.672663:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983261568:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.672668:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7234 00000100:00100000:1.0:1746066757.672683:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.672692:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262464 00000100:00100000:1.0:1746066757.672695:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262464 00010000:00010000:1.0:1746066757.672704:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 13 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:1.0:1746066757.672715:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7235 00000100:00100000:1.0:1746066757.672720:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983262464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.672725:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066757.672731:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 13 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.672738:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 13 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.672747:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44a00/0xf1867c21abfa7443 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a7d expref: 13 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:1.0:1746066757.672754:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066757.672765:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983262464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 46us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.672770:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7235 00000100:00100000:1.0:1746066757.672798:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.672811:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262720 00000100:00100000:0.0:1746066757.672814:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262720 00000100:00100000:1.0:1746066757.672818:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066757.672826:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.672837:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983261952 00000100:00100000:0.0:1746066757.672839:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983261952 00010000:00010000:0.0:1746066757.672846:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 15 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.672859:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.673076:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.673086:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262336 00000100:00100000:0.0:1746066757.673089:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262336 00010000:00010000:0.0:1746066757.673100:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.673104:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7236 00000100:00100000:3.0:1746066757.673110:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983262720:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066757.673111:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7237 00000100:00100000:0.0:1746066757.673115:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2013:x1830882983261952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.673116:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.673120:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.673124:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746066757.673126:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 15 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.673131:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746066757.673133:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 15 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.673139:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066757.673143:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097ce1400/0xf1867c21abfa6ff8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1712 expref: 15 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.673147:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44c00/0xf1867c21abfa742e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a68 expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.673155:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066757.673156:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.673157:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.673160:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.673167:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.673172:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983262720:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.673177:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7236 00000100:00100000:1.0:1746066757.673178:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066757.673181:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.673185:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262592 00000100:00100000:3.0:1746066757.673187:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262592 00010000:00010000:3.0:1746066757.673195:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00000100:00100000:0.0:1746066757.673197:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+14:2013:x1830882983261952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 81us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.673202:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7237 00000100:00100000:0.0:1746066757.673217:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262848 00000100:00100000:0.0:1746066757.673219:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262848 00010000:00010000:0.0:1746066757.673227:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.673669:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983262976 00000100:00100000:3.0:1746066757.673672:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983262976 00010000:00010000:3.0:1746066757.673683:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 35 pid: 20361 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.673692:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7238 00000100:00100000:3.0:1746066757.673696:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983262336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.673701:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.673707:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.673714:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.673729:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa743c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a6f expref: 12 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.673738:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.673797:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983262336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.673804:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7238 00000100:00100000:3.0:1746066757.673814:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7239 00000100:00100000:3.0:1746066757.673819:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882983262592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.673825:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.673831:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.673838:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.673848:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094418800/0xf1867c21abfa7386 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19d5 expref: 23 pid: 20361 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.673855:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.673869:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:2013:x1830882983262592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.673873:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7239 00000100:00100000:3.0:1746066757.673904:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7240 00000100:00100000:3.0:1746066757.673909:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+35:2014:x1830882983262976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.674054:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.674064:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 35 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.674072:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 35 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.674081:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c6e00/0xf1867c21abfa739b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19ea expref: 35 pid: 20361 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.674089:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.674090:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.674092:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674098:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674187:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066757.674220:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674227:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674239:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674244:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674250:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674255:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa44e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066757.674258:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674264:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674271:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.674276:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa44e00/0xf1867c21abfa7489 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.674324:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983262976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 415us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.674329:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7240 00010000:00010000:3.0:1746066757.674347:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674353:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674366:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674371:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674376:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674380:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f3200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066757.674382:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674386:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674393:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.674397:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f3200/0xf1867c21abfa7482 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.674489:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983261056:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 13691us (14136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.674496:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16033 00000100:00100000:3.0:1746066757.674540:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983260800:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 13942us (14720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.674612:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16032 00000100:00100000:3.0:1746066757.674640:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984466816:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.674667:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7241 00000100:00100000:0.0:1746066757.674674:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+48:2013:x1830882983262848:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.674681:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.674688:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.674696:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.674706:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d05e00/0xf1867c21abfa740b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a5a expref: 48 pid: 9590 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.674715:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.674716:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.674718:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.674723:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.674746:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.675038:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984467840:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.675047:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984467968:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.675063:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675275:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.675275:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882983262848:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 601us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.675281:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7241 00010000:00010000:1.0:1746066757.675282:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675293:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675304:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675309:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675314:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa0c800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066757.675316:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675322:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675330:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.675335:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0c800/0xf1867c21abfa74a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.675366:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983261440:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 13355us (14917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.675371:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16037 00000100:00100000:1.0:1746066757.675846:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.675898:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.675923:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983263232 00000100:00100000:0.0:1746066757.675928:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983263232 00010000:00010000:0.0:1746066757.675948:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 9 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.675966:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983263104 00000100:00100000:0.0:1746066757.675968:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983263104 00000100:00100000:1.0:1746066757.675971:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066757.675979:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.676407:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983263360 00000100:00100000:3.0:1746066757.676411:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7242 00000100:00100000:0.0:1746066757.676411:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983263360 00000100:00100000:3.0:1746066757.676418:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983263232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.676426:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.676426:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 47 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.676434:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 9 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:3.0:1746066757.676442:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 9 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:0.0:1746066757.676443:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7243 00000100:00100000:0.0:1746066757.676449:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+14:2016:x1830882983263104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.676453:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093507000/0xf1867c21abfa71f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1877 expref: 9 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746066757.676467:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.676472:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066757.676480:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 825 lvb_type: 1 00010000:00010000:0.0:1746066757.676489:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.676490:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983263232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 74us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.676495:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7242 00010000:00010000:0.0:1746066757.676502:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa47a00/0xf1867c21abfa73a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d19f1 expref: 14 pid: 11630 timeout: 825 lvb_type: 1 00000100:00100000:3.0:1746066757.676505:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7244 00000100:00100000:3.0:1746066757.676508:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983263360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.676512:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.676513:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.676514:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.676516:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.676518:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 47 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.676523:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.676525:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 47 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:3.0:1746066757.676534:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5728a00/0xf1867c21abfa70ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17a5 expref: 47 pid: 9592 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.676538:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066757.676539:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.676548:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+46:2016:x1830882983263360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 39us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.676552:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7244 00000100:00100000:0.0:1746066757.676563:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983263104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 113us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.676569:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7243 00010000:00010000:0.0:1746066757.676591:0:20361:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676597:0:20361:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676609:0:20361:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676615:0:20361:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676625:0:20361:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676629:0:20361:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097019a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066757.676631:0:20361:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676636:0:20361:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676645:0:20361:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.676650:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097019a00/0xf1867c21abfa749e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.676689:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983261184:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 14904us (16264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.676695:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16036 00000100:00100000:0.0:1746066757.681652:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.681830:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983263488 00000100:00100000:2.0:1746066757.681838:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983263488 00010000:00010000:2.0:1746066757.681868:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 34 pid: 9592 timeout: 825 lvb_type: 1 00000100:00100000:2.0:1746066757.681920:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7245 00000100:00100000:2.0:1746066757.681928:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+34:2016:x1830882983263488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.681940:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.681956:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 34 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.681968:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 34 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.681987:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093506600/0xf1867c21abfa714f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d17e4 expref: 34 pid: 9592 timeout: 825 lvb_type: 1 00010000:00010000:2.0:1746066757.682011:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.682013:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.682018:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.682025:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.682053:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.682094:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983263488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 167us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.682101:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7245 00010000:00010000:0.0:1746066757.682285:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682302:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682321:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682327:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682333:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682338:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b226cc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066757.682341:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682346:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682356:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.682361:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b226cc00/0xf1867c21abfa7497 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.682398:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2016:x1830882983260928:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 21327us (21989us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.682404:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16035 00000100:00100000:0.0:1746066757.684387:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.684498:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983263744 00000100:00100000:2.0:1746066757.684509:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983263744 00000100:00100000:2.0:1746066757.685004:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16300 00000100:00100000:2.0:1746066757.685012:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:734:x1830882983263744:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746066757.685074:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.685104:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d05a00/0xf1867c21abfa7466 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a8b expref: 19 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685121:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.685125:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066757.685155:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.685168:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 60 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685175:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 43 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685182:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 60 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685189:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 60 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685194:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 43 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685200:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 8/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.685238:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 43 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685251:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 43 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.685263:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468096:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.685781:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 60 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685796:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 60 pid: 7243 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.685809:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468224:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.685879:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 60 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685926:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 60 pid: 17253 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.685933:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.685975:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 43 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.685982:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 43 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.685993:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.686014:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 60 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.686020:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 60 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.686026:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468608:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.686040:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008e314780 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.691566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.691598:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.691616:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.691642:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983264128 00000100:00100000:0.0:1746066757.691646:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.691654:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983264128 00000100:00100000:0.0:1746066757.691667:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983263872 00000100:00100000:0.0:1746066757.691673:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983263872 00000100:00100000:1.0:1746066757.691681:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983264384 00000100:00100000:1.0:1746066757.691686:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983264384 00010000:00010000:0.0:1746066757.691701:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 44 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:1.0:1746066757.691702:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 62 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.691713:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5948 00000100:00100000:1.0:1746066757.691723:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983264256 00000100:00100000:1.0:1746066757.691726:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983264256 00000100:00100000:3.0:1746066757.691727:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+62:19150:x1830882983264128:12345-192.168.204.16@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746066757.691734:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 63 pid: 17253 timeout: 825 lvb_type: 0 00000100:00100000:3.0:1746066757.691964:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+64:19150:x1830882983264128:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 242us (404us total) trans 8589936633 rc 0/0 00000100:00100000:3.0:1746066757.691971:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5948 00000100:00100000:0.0:1746066757.692166:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7246 00000100:00100000:0.0:1746066757.692174:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+63:2016:x1830882983264384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.692185:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.692190:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 63 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.692200:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 63 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.692218:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.692222:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066757.692229:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.692259:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+63:2016:x1830882983264384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 87us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.692265:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7246 00000100:00100000:0.0:1746066757.692279:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7247 00000100:00100000:0.0:1746066757.692283:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+44:2014:x1830882983263872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.692291:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.692294:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 44 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.692301:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 44 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.692309:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.692312:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066757.692317:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.692329:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+44:2014:x1830882983263872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 45us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.692334:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7247 00000100:00100000:0.0:1746066757.692363:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7248 00000100:00100000:0.0:1746066757.692367:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+62:2016:x1830882983264256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.692373:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.692376:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 62 pid: 17253 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.692383:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 62 pid: 17253 timeout: 825 lvb_type: 0 00010000:00010000:0.0:1746066757.692392:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.692395:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066757.692403:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.692414:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+62:2016:x1830882983264256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 47us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.692420:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7248 00000100:00100000:0.0:1746066757.692476:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.692532:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983264512 00000100:00100000:2.0:1746066757.692536:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983264512 00010000:00010000:2.0:1746066757.692551:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 44 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.692565:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7249 00000100:00100000:2.0:1746066757.692570:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+44:2016:x1830882983264512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.692576:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.692579:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 44 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.692585:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 44 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.692594:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.692597:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.692602:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.692616:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+44:2016:x1830882983264512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 46us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.692621:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7249 00010000:00010000:2.0:1746066757.692655:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b19ec800/0xf1867c21abfa6dcf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15fa expref: 43 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.692665:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468096:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.692673:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468224:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.692680:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098fae600/0xf1867c21abfa697d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1392 expref: 61 pid: 17253 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.692688:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468352:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.692694:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf57200/0xf1867c21abfa6df2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1608 expref: 42 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.692701:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468480:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.692707:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30600/0xf1867c21abfa6dba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d15ec expref: 60 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.692713:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984468608:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.692731:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066757.694774:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.694863:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983264640 00000100:00100000:2.0:1746066757.694869:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983264640 00010000:00010000:2.0:1746066757.694920:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 60 pid: 7243 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.695129:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7250 00000100:00100000:2.0:1746066757.695136:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+60:2016:x1830882983264640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.695146:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.695152:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 60 pid: 7243 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.695161:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 60 pid: 7243 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.695178:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31a00/0xf1867c21abfa6d43 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d159f expref: 60 pid: 7243 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.695189:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.695193:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.695200:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.695206:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.695234:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066757.695265:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.695276:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066757.695277:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+59:2016:x1830882983264640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 142us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.695283:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7250 00000040:00080000:3.0:1746066757.695546:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].635, 88 off63592 00000004:00080000:3.0:1746066757.695553:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725906669293ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.695783:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].569, 88 off57872 00000004:00080000:3.0:1746066757.695790:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725906906380ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066757.695813:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].570, 88 off57960 00000004:00080000:3.0:1746066757.695816:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725906933008ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066757.695825:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].636, 88 off63680 00000004:00080000:3.0:1746066757.695828:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725906944311ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.695835:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].637, 88 off63768 00000004:00080000:3.0:1746066757.695837:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725906954178ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.696239:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].571, 88 off58048 00000004:00080000:3.0:1746066757.696244:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725907360515ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066757.696268:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].572, 88 off58136 00000004:00080000:3.0:1746066757.696272:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725907388468ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066757.696280:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].573, 88 off58224 00000004:00080000:3.0:1746066757.696283:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725907399228ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066757.696291:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].638, 88 off63856 00000004:00080000:3.0:1746066757.696294:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725907410381ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.696303:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].574, 88 off58312 00000004:00080000:3.0:1746066757.696305:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725907422134ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066757.696313:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].639, 88 off63944 00000004:00080000:3.0:1746066757.696316:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725907432421ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.696323:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].575, 88 off58400 00000004:00080000:3.0:1746066757.696326:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725907442391ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066757.696333:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].640, 88 off64032 00000004:00080000:3.0:1746066757.696335:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725907452301ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.696343:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].641, 88 off64120 00000004:00080000:3.0:1746066757.696346:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725907462398ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.696353:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].642, 88 off64208 00000004:00080000:3.0:1746066757.696356:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725907472538ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.696363:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].643, 88 off64296 00000004:00080000:3.0:1746066757.696365:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725907482261ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066757.696373:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].576, 88 off58488 00000004:00080000:3.0:1746066757.696375:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725907492100ns, next at 665959948938ns, rc = 0 00000001:00080000:3.0:1746066757.700304:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936634 is committed 00000004:00080000:3.0:1746066757.700318:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 566 committed 00000004:00080000:3.0:1746066757.700338:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 632 committed 00000004:00080000:3.0:1746066757.700354:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 631 committed 00000004:00080000:3.0:1746066757.700356:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 630 committed 00000004:00080000:3.0:1746066757.700357:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 629 committed 00000004:00080000:3.0:1746066757.700359:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 565 committed 00000004:00080000:3.0:1746066757.700361:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 628 committed 00000004:00080000:3.0:1746066757.700362:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 564 committed 00000004:00080000:3.0:1746066757.700364:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 627 committed 00000004:00080000:3.0:1746066757.700366:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 563 committed 00000004:00080000:3.0:1746066757.700368:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 562 committed 00000004:00080000:3.0:1746066757.700369:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 561 committed 00000004:00080000:3.0:1746066757.700371:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 626 committed 00000004:00080000:3.0:1746066757.700372:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 625 committed 00000004:00080000:3.0:1746066757.700373:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 560 committed 00000004:00080000:3.0:1746066757.700375:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 559 committed 00000004:00080000:3.0:1746066757.700376:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 624 committed 00000001:00080000:3.0:1746066757.700381:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936633 is committed 00000001:00080000:3.0:1746066757.700388:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936630 is committed 00000100:00100000:2.0:1746066757.701032:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984469120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.701062:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984468864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.701083:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.701260:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984468992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.701335:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.701336:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984469632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.701361:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066757.701363:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984469376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.701381:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066757.701410:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984468736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.701657:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984469120 00000100:00100000:2.0:1746066757.701665:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984468864 00000100:00100000:0.0:1746066757.701669:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984469120 00000100:00100000:2.0:1746066757.701672:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984468864 00000100:00100000:2.0:1746066757.701704:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984469632 00000100:00100000:2.0:1746066757.701707:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984469632 00000100:00100000:1.0:1746066757.701725:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984469376 00000100:00100000:1.0:1746066757.701728:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984469376 00000100:00100000:0.0:1746066757.701820:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16038 00000100:00100000:0.0:1746066757.701829:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3774:x1830882984468864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.701832:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16039 00000100:00100000:2.0:1746066757.701839:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3776:x1830882984469120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.701960:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16040 00000100:00100000:2.0:1746066757.701965:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882984469632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.702004:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3774:x1830882984468864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (669us total) trans 17179874423 rc 0/0 00000100:00100000:0.0:1746066757.702010:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16038 00000100:00100000:0.0:1746066757.702025:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16041 00000100:00100000:0.0:1746066757.702030:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3774:x1830882984469376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.702046:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3776:x1830882984469632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (683us total) trans 17179874425 rc 0/0 00000100:00100000:2.0:1746066757.702052:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16040 00000004:00080000:2.0:1746066757.702084:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094307b80/2, rc 0, transno 17179874425 00000100:00100000:2.0:1746066757.702089:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984469632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.702089:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3774:x1830882984469376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (706us total) trans 17179874426 rc 0/0 00000100:00100000:0.0:1746066757.702095:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16041 00002000:00010000:2.0:1746066757.702119:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066757.702121:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066757.702123:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:2.0:1746066757.702125:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066757.702127:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000100:00100000:2.0:1746066757.702146:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3776:x1830882984469120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 308us (1063us total) trans 17179874424 rc 0/0 00000100:00100000:2.0:1746066757.702151:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16039 00000100:00100000:0.0:1746066757.702185:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.702198:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984469504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.702213:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.702224:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984470016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702237:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.702246:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984470528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702253:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984468992 00000100:00100000:2.0:1746066757.702256:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984468992 00000100:00100000:0.0:1746066757.702258:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.702268:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984469504 00000100:00100000:0.0:1746066757.702269:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746066757.702270:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984469504 00000100:00100000:0.0:1746066757.702272:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984469888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702279:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984470016 00000100:00100000:2.0:1746066757.702280:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984470016 00000100:00100000:0.0:1746066757.702283:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.702289:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984470528 00000100:00100000:2.0:1746066757.702290:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984470528 00000100:00100000:0.0:1746066757.702292:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984470400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702295:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984469888 00000100:00100000:2.0:1746066757.702296:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984469888 00000100:00100000:0.0:1746066757.702302:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.702303:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16042 00000100:00100000:2.0:1746066757.702307:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3775:x1830882984468992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.702316:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984470400 00000100:00100000:0.0:1746066757.702319:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984470400 00000100:00100000:0.0:1746066757.702333:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16043 00000100:00100000:0.0:1746066757.702337:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3775:x1830882984469504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.702356:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3775:x1830882984468992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (170us total) trans 17179874427 rc 0/0 00000100:00100000:2.0:1746066757.702361:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16042 00000100:00100000:2.0:1746066757.702369:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16044 00000100:00100000:2.0:1746066757.702372:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3775:x1830882984470016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702397:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3775:x1830882984469504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (182us total) trans 17179874428 rc 0/0 00000100:00100000:0.0:1746066757.702402:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16043 00000100:00100000:0.0:1746066757.702412:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16045 00000100:00100000:0.0:1746066757.702416:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984470528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702433:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984470016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (194us total) trans 21474841873 rc 0/0 00000100:00100000:2.0:1746066757.702438:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16044 00000100:00100000:2.0:1746066757.702448:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16046 00000100:00100000:2.0:1746066757.702451:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984469888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066757.702478:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066757.702481:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066757.702483:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066757.702485:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:0.0:1746066757.702487:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:0.0:1746066757.702508:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984470528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (249us total) trans 21474841874 rc 0/0 00000100:00100000:0.0:1746066757.702513:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16045 00000100:00100000:2.0:1746066757.702517:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984469888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (231us total) trans 21474841875 rc 0/0 00000100:00100000:2.0:1746066757.702522:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16046 00000100:00100000:0.0:1746066757.702526:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16047 00000100:00100000:0.0:1746066757.702530:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3775:x1830882984470400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702540:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702557:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.702569:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702582:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984470400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (279us total) trans 21474841876 rc 0/0 00000100:00100000:2.0:1746066757.702584:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.702588:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16047 00000004:00080000:2.0:1746066757.702597:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094307480/2, rc 0, transno 17179874424 00000100:00100000:0.0:1746066757.702598:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984470144 00000100:00100000:2.0:1746066757.702600:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984469120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.702600:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984470144 00000100:00100000:2.0:1746066757.702606:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746066757.702610:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ce05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984469760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702610:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984470656 00000100:00100000:0.0:1746066757.702612:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984470656 00000100:00100000:0.0:1746066757.702620:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16048 00000100:00100000:2.0:1746066757.702623:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.702624:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882984470144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702630:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702640:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.702652:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984469760 00000100:00100000:2.0:1746066757.702654:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984469760 00002000:00010000:0.0:1746066757.702657:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:0.0:1746066757.702659:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.702661:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066757.702663:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00000100:00100000:2.0:1746066757.702664:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984470272 00002000:00010000:0.0:1746066757.702664:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:2.0:1746066757.702665:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984470272 00000100:00100000:2.0:1746066757.702671:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16049 00000100:00100000:2.0:1746066757.702675:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984470656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702686:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984470144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (128us total) trans 21474841877 rc 0/0 00000100:00100000:0.0:1746066757.702690:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16048 00000100:00100000:0.0:1746066757.702699:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16050 00000100:00100000:0.0:1746066757.702703:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3776:x1830882984469760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702714:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16051 00000100:00100000:0.0:1746066757.702718:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984470272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066757.702723:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:2.0:1746066757.702725:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066757.702727:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066757.702728:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066757.702730:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00002000:00010000:0.0:1746066757.702754:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066757.702756:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.702758:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066757.702760:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.702761:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:2.0:1746066757.702762:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882984470656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (177us total) trans 21474841878 rc 0/0 00000100:00100000:2.0:1746066757.702768:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16049 00000100:00100000:0.0:1746066757.702779:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984470272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (138us total) trans 21474841879 rc 0/0 00000100:00100000:0.0:1746066757.702783:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16051 00000004:00080000:2.0:1746066757.702793:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e1f80/2, rc 0, transno 21474841879 00000100:00100000:2.0:1746066757.702801:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470272:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066757.702810:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e2680/2, rc 0, transno 21474841877 00000100:00100000:2.0:1746066757.702813:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470144:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066757.702818:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e2d80/2, rc 0, transno 21474841878 00000100:00100000:2.0:1746066757.702821:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702837:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984469760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (213us total) trans 21474841880 rc 0/0 00000100:00100000:0.0:1746066757.702841:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16050 00000004:00080000:2.0:1746066757.702842:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce05f80/2, rc 0, transno 21474841880 00000100:00100000:2.0:1746066757.702845:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984469760:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702877:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:0.0:1746066757.702903:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce07b80/2, rc 0, transno 21474841875 00000100:00100000:2.0:1746066757.702904:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.702907:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984469888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.702916:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e3480/2, rc 0, transno 21474841876 00000100:00100000:0.0:1746066757.702919:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984470400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.702923:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.702939:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984470784 00000100:00100000:2.0:1746066757.702942:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984470784 00000100:00100000:2.0:1746066757.702955:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16052 00000100:00100000:2.0:1746066757.702958:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3776:x1830882984470784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.703007:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3776:x1830882984470784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (83us total) trans 21474841881 rc 0/0 00000100:00100000:2.0:1746066757.703012:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16052 00000004:00080000:2.0:1746066757.703029:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5c00/2, rc 0, transno 21474841881 00000100:00100000:2.0:1746066757.703032:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984470784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.703329:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066757.703347:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984469248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.703363:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066757.703381:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984468736 00000100:00100000:1.0:1746066757.703384:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984468736 00000100:00100000:1.0:1746066757.703396:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984469248 00000100:00100000:1.0:1746066757.703398:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984469248 00000100:00100000:1.0:1746066757.703409:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16053 00000100:00100000:1.0:1746066757.703413:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3777:x1830882984468736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.703484:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882984468736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (154us total) trans 17179874429 rc 0/0 00000100:00100000:1.0:1746066757.703489:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16053 00000100:00100000:1.0:1746066757.703500:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16054 00000100:00100000:1.0:1746066757.703503:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3777:x1830882984469248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066757.703538:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:1.0:1746066757.703540:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.703542:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066757.703544:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.703546:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:1.0:1746066757.703562:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3777:x1830882984469248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (198us total) trans 17179874430 rc 0/0 00000100:00100000:1.0:1746066757.703567:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16054 00000004:00080000:1.0:1746066757.703585:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094307800/2, rc 0, transno 17179874429 00000100:00100000:1.0:1746066757.703588:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094307800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984468736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066757.703594:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094306a00/2, rc 0, transno 17179874430 00000100:00100000:1.0:1746066757.703597:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984469248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066757.704791:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094305880/2, rc 0, transno 17179874423 00000100:00100000:3.0:1746066757.704800:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984468864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066757.704808:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094304700/2, rc 0, transno 17179874426 00000100:00100000:3.0:1746066757.704811:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984469376:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746066757.704858:0:7245:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ce04a80 reply state ffff880095897400 transno 8589936634 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.704876:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.704900:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.704903:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066757.704908:0:7245:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746066757.705002:0:7245:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066757.705018:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:734:x1830882983263744:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 20004us (20638us total) trans 8589936634 rc 0/0 00000100:00100000:3.0:1746066757.705024:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16300 00010000:00010000:1.0:1746066757.705137:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066757.705145:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066757.705151:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066757.705160:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066757.705164:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066757.705171:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066757.705181:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.705183:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066757.705185:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066757.705191:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c000/0xf1867c21abfa74ac lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00000004:00080000:0.0:1746066757.705765:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ce07800/2, rc 0, transno 21474841873 00000100:00100000:0.0:1746066757.705770:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ce07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984470016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.705778:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800966e1180/2, rc 0, transno 21474841874 00000100:00100000:0.0:1746066757.705780:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984470528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.705790:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094304a80/2, rc 0, transno 17179874427 00000100:00100000:0.0:1746066757.705792:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984468992:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066757.705799:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094304000/2, rc 0, transno 17179874428 00000100:00100000:0.0:1746066757.705801:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094304000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984469504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.707364:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.707529:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983264768 00000100:00100000:3.0:1746066757.707537:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983264768 00000100:00100000:3.0:1746066757.707591:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16301 00000100:00100000:3.0:1746066757.707599:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:734:x1830882983264768:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066757.707624:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.707641:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1a99 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.707696:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.707708:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.707733:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.707735:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066757.707738:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2c00, rc 0) 00000100:00100000:3.0:1746066757.708748:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:734:x1830882983264768:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1146us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.708756:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16301 00000100:00100000:1.0:1746066757.713871:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.713951:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983264896 00000100:00100000:3.0:1746066757.713963:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983264896 00000100:00100000:3.0:1746066757.714013:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16302 00000100:00100000:3.0:1746066757.714022:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:734:x1830882983264896:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066757.714043:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.714063:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3a00/0xf1867c21abfa74ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1aa0 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.714158:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa74c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.714172:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa74c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.714182:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa74c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066757.714210:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 16777217 00000004:00200000:3.0:1746066757.714214:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066757.714227:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa74c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.714250:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3a00/0xf1867c21abfa74ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa0 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.714288:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa74c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa0 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.714297:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.714299:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066757.714302:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f3e00, rc 0) 00000100:00100000:3.0:1746066757.714354:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:734:x1830882983264896:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 333us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.714360:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16302 00000100:00100000:0.0:1746066757.718374:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.718410:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.718437:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.718476:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.718491:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.718508:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265152 00000100:00100000:1.0:1746066757.718518:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265152 00000100:00100000:1.0:1746066757.718561:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265024 00000100:00100000:1.0:1746066757.718563:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265024 00000100:00100000:0.0:1746066757.718565:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.718575:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265280 00000100:00100000:1.0:1746066757.718576:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265280 00000100:00100000:1.0:1746066757.718585:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265536 00000100:00100000:1.0:1746066757.718587:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265536 00000100:00100000:1.0:1746066757.718596:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265408 00000100:00100000:1.0:1746066757.718598:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265408 00000100:00100000:1.0:1746066757.718606:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265664 00000100:00100000:1.0:1746066757.718608:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265664 00000100:00100000:1.0:1746066757.718619:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16055 00000100:00100000:1.0:1746066757.718626:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983265152:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:3.0:1746066757.718637:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16056 00000100:00100000:3.0:1746066757.718644:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983265024:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066757.718646:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.718651:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066757.718656:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16057 00010000:00010000:3.0:1746066757.718667:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1aa7 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.718667:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1aae expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.718673:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983265280:12345-192.168.204.16@tcp:101:lfs.0 00002000:00010000:3.0:1746066757.718690:0:12233:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd44, atime: 0x6812dd44, ctime: 0x6812dd44, blocks: 0x808 00002000:00010000:1.0:1746066757.718690:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd44, atime: 0x6812dd44, ctime: 0x6812dd44, blocks: 0x808 00010000:00010000:2.0:1746066757.718691:0:13363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.718707:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.718707:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.718710:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.718710:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.718713:0:13363:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ab5 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.718718:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.718718:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.718733:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 12 pid: 12233 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746066757.718733:0:13363:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd46, atime: 0x6812dd46, ctime: 0x6812dd45, blocks: 0x800 00010000:00010000:1.0:1746066757.718733:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.718742:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800960f2a00, rc 0) 00010000:00010000:1.0:1746066757.718742:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c000, rc 0) 00010000:00010000:2.0:1746066757.718751:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.718754:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.718762:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.718776:0:13363:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 11 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.718785:0:13363:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009629a200, rc 0) 00000100:00100000:1.0:1746066757.718790:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983265152:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 165us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.718797:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16055 00000100:00100000:0.0:1746066757.718812:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16058 00000100:00100000:1.0:1746066757.718815:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16059 00000100:00100000:0.0:1746066757.718818:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983265536:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:1.0:1746066757.718819:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983265408:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066757.718827:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983265280:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 160us (389us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066757.718829:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066757.718831:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16060 00000100:00100000:2.0:1746066757.718835:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16057 00000100:00100000:1.0:1746066757.718836:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983265664:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066757.718837:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ac3 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.718841:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746066757.718848:0:20361:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd46, atime: 0x6812dd46, ctime: 0x6812dd46, blocks: 0x1668 00010000:00010000:1.0:1746066757.718849:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1aca expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.718855:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.718857:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746066757.718858:0:12255:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd46, atime: 0x6812dd46, ctime: 0x6812dd46, blocks: 0x1000 00010000:00010000:0.0:1746066757.718861:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.718863:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.718865:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.718869:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.718869:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.718876:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa45e00, rc 0) 00010000:00010000:1.0:1746066757.718877:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.718915:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d800, rc 0) 00000100:00100000:0.0:1746066757.718916:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983265536:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.718921:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16058 00000100:00100000:1.0:1746066757.718928:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983265664:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.718932:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16060 00010000:00010000:0.0:1746066757.718936:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.718943:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1abc expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066757.718953:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd46, atime: 0x6812dd45, ctime: 0x6812dd46, blocks: 0x800 00010000:00010000:0.0:1746066757.718960:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.718961:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.718964:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.718973:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.718980:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa44c00, rc 0) 00000100:00100000:0.0:1746066757.718994:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983265408:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 175us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.718999:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16059 00000100:00100000:3.0:1746066757.719052:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983265024:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 408us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.719056:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16056 00000100:00100000:0.0:1746066757.722635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.722675:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.722705:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.722732:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.722747:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.722823:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.722849:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265792 00000100:00100000:0.0:1746066757.722858:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265792 00000100:00100000:0.0:1746066757.722929:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266048 00000100:00100000:0.0:1746066757.722931:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266048 00000100:00100000:0.0:1746066757.722945:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266304 00000100:00100000:0.0:1746066757.722947:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266304 00000100:00100000:0.0:1746066757.722955:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983265920 00000100:00100000:0.0:1746066757.722956:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983265920 00000100:00100000:0.0:1746066757.722963:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266176 00000100:00100000:0.0:1746066757.722966:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266176 00000100:00100000:0.0:1746066757.722973:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266432 00000100:00100000:0.0:1746066757.722975:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266432 00000100:00100000:0.0:1746066757.722984:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16061 00000100:00100000:0.0:1746066757.722991:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983265792:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.723097:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983265792:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 105us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.723103:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16061 00000100:00100000:0.0:1746066757.723117:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16062 00000100:00100000:0.0:1746066757.723122:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983266048:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.723171:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983266048:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 49us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.723177:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16062 00000100:00100000:0.0:1746066757.723192:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16063 00000100:00100000:0.0:1746066757.723196:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983266304:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.723224:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983266304:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.723228:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16063 00000100:00100000:0.0:1746066757.723235:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16064 00000100:00100000:0.0:1746066757.723239:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983265920:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.723265:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983265920:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.723270:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16064 00000100:00100000:0.0:1746066757.723278:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16065 00000100:00100000:0.0:1746066757.723282:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983266176:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.723309:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983266176:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 27us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.723314:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16065 00000100:00100000:0.0:1746066757.723323:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16066 00000100:00100000:0.0:1746066757.723327:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983266432:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.723545:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983266432:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 216us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.723551:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16066 00000100:00100000:0.0:1746066757.726069:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.726157:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266560 00000100:00100000:0.0:1746066757.726160:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.726166:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266560 00000100:00100000:0.0:1746066757.726190:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.726209:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266688 00000100:00100000:2.0:1746066757.726211:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266688 00000100:00100000:0.0:1746066757.726211:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.726225:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.727030:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.727139:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266944 00000100:00100000:1.0:1746066757.727139:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983266816 00000100:00100000:2.0:1746066757.727140:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983267072 00000100:00100000:3.0:1746066757.727144:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266944 00000100:00100000:2.0:1746066757.727144:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983267072 00000100:00100000:1.0:1746066757.727144:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983266816 00000100:00100000:2.0:1746066757.727171:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983267200 00000100:00100000:2.0:1746066757.727173:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983267200 00000100:00100000:1.0:1746066757.727192:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16067 00000100:00100000:2.0:1746066757.727198:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16068 00000100:00100000:1.0:1746066757.727199:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983266560:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066757.727203:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16069 00000100:00100000:2.0:1746066757.727204:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882983266688:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066757.727208:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983267072:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.727209:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16070 00000100:00100000:0.0:1746066757.727217:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983266944:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066757.727299:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983266944:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 83us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.727300:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983267072:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 91us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.727300:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983266560:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 101us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.727301:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2014:x1830882983266688:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 95us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.727305:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16070 00000100:00100000:1.0:1746066757.727308:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16067 00000100:00100000:3.0:1746066757.727311:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16069 00000100:00100000:2.0:1746066757.727314:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16068 00000100:00100000:1.0:1746066757.727320:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16071 00000100:00100000:3.0:1746066757.727323:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16072 00000100:00100000:1.0:1746066757.727324:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882983266816:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066757.727327:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882983267200:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066757.727352:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2014:x1830882983266816:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 27us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.727357:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16071 00000100:00100000:3.0:1746066757.728046:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2014:x1830882983267200:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 716us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.728052:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16072 00000100:00100000:0.0:1746066757.732447:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.732697:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983267456 00000100:00100000:2.0:1746066757.732708:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983267456 00000100:00100000:2.0:1746066757.732769:0:20360:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4305 00000100:00100000:2.0:1746066757.732777:0:20360:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983267456:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066757.732819:0:20360:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.732834:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.732835:0:20360:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.732841:0:20360:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.732854:0:20360:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.735527:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.735581:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.735607:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983267712 00000100:00100000:0.0:1746066757.735615:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983267712 00000100:00100000:0.0:1746066757.735664:0:29518:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983267968 00000100:00100000:0.0:1746066757.735666:0:29518:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983267968 00000100:00100000:0.0:1746066757.735699:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4306 00000100:00100000:0.0:1746066757.735707:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983267712:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:1.0:1746066757.735731:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4307 00000100:00100000:1.0:1746066757.735739:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983267968:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066757.735741:0:29518:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.735753:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.735755:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.735757:0:29518:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.735759:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.735760:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.735762:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.735762:0:29518:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.735773:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.735773:0:29518:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.740117:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.740156:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.740546:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983268224 00000100:00100000:3.0:1746066757.740556:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983268224 00000100:00100000:3.0:1746066757.740615:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983268480 00000100:00100000:3.0:1746066757.740617:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983268480 00000100:00100000:3.0:1746066757.740642:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4308 00000100:00100000:3.0:1746066757.740650:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983268224:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066757.740689:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.740704:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.740706:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.740711:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.740724:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.741185:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4309 00000100:00100000:2.0:1746066757.741201:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983268480:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066757.741237:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.741249:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.741250:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.741255:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.741267:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.743905:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.744694:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.744715:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066757.744818:0:20360:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.744831:0:20360:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.744839:0:20360:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.744846:0:20360:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098faf600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066757.744850:0:20360:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.744857:0:20360:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.744876:0:20360:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.744907:0:20360:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098faf600/0xf1867c21abfa74f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20360 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.744980:0:20360:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983267456:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 12202us (12543us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.744991:0:20360:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4305 00000100:00100000:2.0:1746066757.745017:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983268736 00000100:00100000:2.0:1746066757.745024:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983268736 00000100:00100000:2.0:1746066757.745063:0:20360:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983268992 00000100:00100000:2.0:1746066757.745065:0:20360:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983268992 00000100:00100000:2.0:1746066757.745083:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983269248 00000100:00100000:2.0:1746066757.745086:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983269248 00000100:00100000:2.0:1746066757.745100:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4310 00000100:00100000:2.0:1746066757.745106:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983268736:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066757.745137:0:9596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.745148:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.745150:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.745155:0:9596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.745165:0:9596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.745284:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4311 00000100:00100000:1.0:1746066757.745291:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983268992:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066757.745309:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.745317:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.745318:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.745322:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.745330:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.746087:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4312 00000100:00100000:0.0:1746066757.746096:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983269248:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:0.0:1746066757.746113:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.746120:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.746121:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.746124:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.746133:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.748972:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.748988:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.749000:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.749007:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012155cc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066757.749011:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.749018:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.749036:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.749041:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155cc00/0xf1867c21abfa7500 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.749770:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983267968:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 14026us (14182us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066757.749780:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4307 00010000:00010000:2.0:1746066757.756277:0:29518:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.756297:0:29518:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.756305:0:29518:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.756313:0:29518:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa45600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066757.756316:0:29518:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.756323:0:29518:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.756345:0:29518:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.756351:0:29518:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa45600/0xf1867c21abfa74f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.756451:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983267712:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20738us (20929us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.756474:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4306 00010000:00010000:3.0:1746066757.759017:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.759038:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.759046:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.759052:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009dbe3400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066757.759056:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.759064:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.759083:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.759089:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa750e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.759169:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094307100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983268480:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 17968us (19007us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066757.759180:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4309 00010000:00010000:3.0:1746066757.762055:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.762073:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.762081:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.762088:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800960f2200 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066757.762093:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.762106:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.762124:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.762131:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2200/0xf1867c21abfa7507 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.762216:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983268224:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 21561us (22104us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066757.762227:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4308 00010000:00010000:0.0:1746066757.765556:0:9596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.765574:0:9596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.765583:0:9596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.765591:0:9596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962f7000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066757.765596:0:9596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.765604:0:9596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.765623:0:9596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.765629:0:9596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962f7000/0xf1867c21abfa7515 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.765731:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983268736:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 20618us (21848us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066757.765741:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4310 00010000:00010000:2.0:1746066757.769327:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.769342:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.769349:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.769355:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5898a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066757.769359:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.769367:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.769383:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.769394:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898a00/0xf1867c21abfa751c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.769549:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983268992:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 24254us (24852us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.769559:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4311 00010000:00010000:0.0:1746066757.770035:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.770048:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.770055:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.770060:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b19ed600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066757.770063:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.770070:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.770087:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.770093:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7523 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.770150:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b40b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983269248:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 24054us (25431us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746066757.770159:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4312 00000100:00100000:0.0:1746066757.775034:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.775103:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983269504 00000100:00100000:2.0:1746066757.775109:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983269504 00000100:00100000:2.0:1746066757.775149:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16303 00000100:00100000:2.0:1746066757.775157:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:734:x1830882983269504:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:2.0:1746066757.775197:0:13370:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.775222:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f3e00/0xf1867c21abfa74c1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa0 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.775241:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.775245:0:13370:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066757.775281:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.775289:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.775295:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00010000:2.0:1746066757.775527:0:13370:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880096eca680 reply state ffff88006e276000 transno 8589936635 ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.775539:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066757.775544:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.775546:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746066757.775549:0:13370:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746066757.775613:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:734:x1830882983269504:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 456us (583us total) trans 8589936635 rc 0/0 00000100:00100000:2.0:1746066757.775618:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16303 00000100:00100000:0.0:1746066757.777731:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.777764:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.777793:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.777814:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983269760 00000100:00100000:2.0:1746066757.777815:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983269632 00000100:00100000:0.0:1746066757.777817:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.777820:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983269760 00000100:00100000:2.0:1746066757.777820:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983269632 00000100:00100000:0.0:1746066757.777833:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.777844:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983270016 00000100:00100000:2.0:1746066757.777846:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983270016 00000100:00100000:3.0:1746066757.777854:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983269888 00000100:00100000:3.0:1746066757.777855:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983269888 00000100:00100000:2.0:1746066757.777860:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983270272 00000100:00100000:2.0:1746066757.777862:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983270272 00000100:00100000:3.0:1746066757.777866:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16073 00000100:00100000:3.0:1746066757.777871:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983269632:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:2.0:1746066757.777876:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16074 00000100:00100000:2.0:1746066757.777880:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983269760:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746066757.777880:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16075 00000100:00100000:1.0:1746066757.777902:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983270016:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746066757.777956:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16076 00000100:00100000:3.0:1746066757.777962:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983269888:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066757.777970:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066757.777970:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066757.777973:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066756 -> 1746066758 00002000:00010000:1.0:1746066757.777973:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.777975:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066756 -> 1746066758 00002000:00010000:1.0:1746066757.777975:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066757 -> 1746066758 00002000:00010000:2.0:1746066757.777977:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066756 -> 1746066758 00002000:00010000:1.0:1746066757.777977:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.777979:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746066757.777979:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:3.0:1746066757.778006:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746066757.778007:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983269760:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 125us (279us total) trans 17179874431 rc 0/0 00002000:00010000:3.0:1746066757.778009:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.778011:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.778012:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066757 -> 1746066758 00000100:00100000:2.0:1746066757.778012:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16074 00002000:00010000:3.0:1746066757.778014:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066757.778026:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16077 00000100:00100000:2.0:1746066757.778030:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983270272:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066757.778064:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746066757.778066:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.778068:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.778069:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.778071:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:1.0:1746066757.778153:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983270016:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 250us (358us total) trans 21474841882 rc 0/0 00000100:00100000:3.0:1746066757.778157:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983269888:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 194us (338us total) trans 17179874432 rc 0/0 00000100:00100000:1.0:1746066757.778158:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16075 00000100:00100000:3.0:1746066757.778163:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16076 00002000:00010000:3.0:1746066757.778189:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746066757.778191:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066756 -> 1746066758 00002000:00010000:3.0:1746066757.778193:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066756 -> 1746066758 00002000:00010000:3.0:1746066757.778194:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066756 -> 1746066758 00002000:00010000:3.0:1746066757.778196:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746066757.778209:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983269632:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 338us (445us total) trans 21474841883 rc 0/0 00000100:00100000:3.0:1746066757.778214:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16073 00000100:00100000:0.0:1746066757.778229:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.778237:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983270144 00000100:00100000:3.0:1746066757.778239:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983270144 00000100:00100000:3.0:1746066757.778249:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16078 00000100:00100000:3.0:1746066757.778252:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983270144:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066757.778279:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:3.0:1746066757.778281:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.778282:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.778283:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.778284:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:3.0:1746066757.778295:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983270144:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 42us (67us total) trans 21474841884 rc 0/0 00000100:00100000:3.0:1746066757.778298:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16078 00000100:00100000:2.0:1746066757.778377:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fcf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983270272:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 345us (542us total) trans 17179874433 rc 0/0 00000100:00100000:2.0:1746066757.778382:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16077 00000100:00100000:0.0:1746066757.779804:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.779875:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983270528 00000100:00100000:1.0:1746066757.779880:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983270528 00000100:00100000:1.0:1746066757.780056:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5949 00000100:00100000:1.0:1746066757.780063:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:734:x1830882983270528:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:1.0:1746066757.780102:0:7246:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7474 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a92 expref: 11 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.780134:0:7246:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.780143:0:7246:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.780149:0:7246:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.780172:0:7246:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.780182:0:7246:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 11 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:1.0:1746066757.780192:0:7246:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830882984470912:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.780559:0:7246:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800965e6540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.781837:0:7246:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7246:1830882984470912:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.781837:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066757.781853:0:7246:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000100:00100000:2.0:1746066757.781968:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983270656 00000100:00100000:2.0:1746066757.781973:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983270656 00010000:00010000:2.0:1746066757.781993:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 12 pid: 7245 timeout: 825 lvb_type: 0 00000100:00100000:2.0:1746066757.782032:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7251 00000100:00100000:2.0:1746066757.782038:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983270656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.782047:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.782052:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 12 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.782061:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 12 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.782075:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800960f2c00/0xf1867c21abfa74b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a99 expref: 12 pid: 7245 timeout: 825 lvb_type: 0 00010000:00010000:2.0:1746066757.782086:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.782089:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746066757.782097:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746066757.782102:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7246 initiator: MDT0 00010000:00010000:2.0:1746066757.782114:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.782138:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983270656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.782144:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7251 00010000:00010000:1.0:1746066757.782287:0:7246:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.782294:0:7246:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000040:00080000:1.0:1746066757.782546:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].644, 88 off64384 00000004:00080000:1.0:1746066757.782551:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725993667701ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782585:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].577, 88 off58576 00000004:00080000:1.0:1746066757.782589:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725993705266ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066757.782615:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].578, 88 off58664 00000004:00080000:1.0:1746066757.782618:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725993734468ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066757.782816:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].645, 88 off64472 00000004:00080000:1.0:1746066757.782820:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725993937083ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782841:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].646, 88 off64560 00000004:00080000:1.0:1746066757.782844:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725993960820ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782853:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].579, 88 off58752 00000004:00080000:1.0:1746066757.782855:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725993971954ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066757.782876:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].580, 88 off58840 00000004:00080000:1.0:1746066757.782880:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725993996550ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066757.782907:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].581, 88 off58928 00000004:00080000:1.0:1746066757.782909:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725994025960ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066757.782920:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].647, 88 off64648 00000004:00080000:1.0:1746066757.782922:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725994039020ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782930:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].582, 88 off59016 00000004:00080000:1.0:1746066757.782933:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725994049706ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066757.782941:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].648, 88 off64736 00000004:00080000:1.0:1746066757.782943:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725994060173ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782956:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].583, 88 off59104 00000004:00080000:1.0:1746066757.782958:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725994074950ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066757.782965:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].649, 88 off64824 00000004:00080000:1.0:1746066757.782967:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725994084013ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782976:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].650, 88 off64912 00000004:00080000:1.0:1746066757.782978:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725994095105ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782987:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].651, 88 off65000 00000004:00080000:1.0:1746066757.782989:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725994105935ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.782998:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].652, 88 off65088 00000004:00080000:1.0:1746066757.783001:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 725994117470ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.783010:0:7246:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].584, 88 off59192 00000004:00080000:1.0:1746066757.783012:0:7246:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 725994129066ns, next at 665959948938ns, rc = 0 00000001:00080000:2.0:1746066757.785162:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936636 is committed 00000004:00080000:2.0:1746066757.785171:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 574 committed 00000004:00080000:2.0:1746066757.785183:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 641 committed 00000004:00080000:2.0:1746066757.785187:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 640 committed 00000004:00080000:2.0:1746066757.785188:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 639 committed 00000004:00080000:2.0:1746066757.785190:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 638 committed 00000004:00080000:2.0:1746066757.785191:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 573 committed 00000004:00080000:2.0:1746066757.785193:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 637 committed 00000004:00080000:2.0:1746066757.785194:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 572 committed 00000004:00080000:2.0:1746066757.785195:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 636 committed 00010000:00010000:1.0:1746066757.785195:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00000004:00080000:2.0:1746066757.785198:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 571 committed 00000004:00080000:2.0:1746066757.785199:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 570 committed 00000004:00080000:2.0:1746066757.785200:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 569 committed 00000004:00080000:2.0:1746066757.785201:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 635 committed 00000004:00080000:2.0:1746066757.785203:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 634 committed 00000004:00080000:2.0:1746066757.785204:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 568 committed 00010000:00010000:1.0:1746066757.785205:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00000004:00080000:2.0:1746066757.785206:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 567 committed 00000004:00080000:2.0:1746066757.785207:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 633 committed 00010000:00010000:1.0:1746066757.785211:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066757.785215:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009718d000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066757.785218:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066757.785223:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066757.785235:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.785238:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066757.785241:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066757.785246:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009718d000/0xf1867c21abfa752a lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00000100:00100000:2.0:1746066757.785250:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984471168:0@lo:2:osp-syn-1-0.0 00000004:00010000:1.0:1746066757.785282:0:7246:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880096ec9f80 reply state ffff8800941ab800 transno 8589936636 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7246 initiator: MDT0 00000100:00100000:2.0:1746066757.785292:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066757.785292:0:7246:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.785297:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000100:00100000:3.0:1746066757.785298:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984471424:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746066757.785299:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746066757.785301:0:7246:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746066757.785304:0:7246:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.785306:0:7246:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066757.785310:0:7246:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d04800/0xf1867c21abfa7474 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1a92 expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.785316:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984471552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.785320:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.785332:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066757.785336:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984471936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.785342:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984472064:0@lo:2:osp-syn-0-0.0 00010000:00080000:1.0:1746066757.785365:0:7246:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746066757.785373:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:734:x1830882983270528:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 5310us (5571us total) trans 8589936636 rc 0/0 00000100:00100000:0.0:1746066757.785408:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984471040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.785417:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5949 00010000:00010000:1.0:1746066757.785436:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.785441:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.785445:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.785453:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5898800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066757.785467:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.785472:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.785478:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.785480:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066757.785482:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00010000:00010000:1.0:1746066757.785485:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5898800/0xf1867c21abfa7531 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7246 initiator: MDT0 00000100:00100000:3.0:1746066757.785659:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.785669:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984471296:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.785679:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984472448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.785687:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066757.785701:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471168 00000100:00100000:3.0:1746066757.785706:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471168 00000100:00100000:3.0:1746066757.785726:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471424 00000100:00100000:3.0:1746066757.785728:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471424 00000100:00100000:3.0:1746066757.785750:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471552 00000100:00100000:3.0:1746066757.785752:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471552 00000100:00100000:3.0:1746066757.785761:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471936 00000100:00100000:3.0:1746066757.785763:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471936 00000100:00100000:3.0:1746066757.785770:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471296 00000100:00100000:3.0:1746066757.785772:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471296 00000100:00100000:3.0:1746066757.785788:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16079 00000100:00100000:2.0:1746066757.785792:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984471808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.785795:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3774:x1830882984471168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.785802:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.785825:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.785832:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984471680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.785836:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984472320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.785842:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471040 00000100:00100000:1.0:1746066757.785846:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471040 00000100:00100000:0.0:1746066757.785855:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066757.785856:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471808 00000100:00100000:1.0:1746066757.785857:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471808 00000100:00100000:1.0:1746066757.785863:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984471680 00000100:00100000:1.0:1746066757.785865:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984471680 00000100:00100000:2.0:1746066757.785869:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16080 00000100:00100000:0.0:1746066757.785873:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984472192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.785875:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3777:x1830882984471424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.785879:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16081 00002000:00010000:3.0:1746066757.785898:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066757.785901:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00000100:00100000:1.0:1746066757.785902:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984471552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066757.785904:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.785906:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.785907:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066757.785908:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.785918:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984472704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.785929:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3774:x1830882984471168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (636us total) trans 17179874434 rc 0/0 00000100:00100000:0.0:1746066757.785933:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066757.785934:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16079 00002000:00010000:1.0:1746066757.785940:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066757.785942:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:1.0:1746066757.785944:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00000100:00100000:3.0:1746066757.785945:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472192 00002000:00010000:1.0:1746066757.785946:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00000100:00100000:3.0:1746066757.785947:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472192 00002000:00010000:1.0:1746066757.785948:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00002000:00010000:2.0:1746066757.785951:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066757.785953:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00000100:00100000:3.0:1746066757.785955:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472704 00002000:00010000:2.0:1746066757.785955:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00000100:00100000:3.0:1746066757.785957:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472704 00002000:00010000:2.0:1746066757.785957:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.785959:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746066757.785961:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16082 00000100:00100000:1.0:1746066757.785965:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3774:x1830882984471552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (633us total) trans 17179874435 rc 0/0 00000100:00100000:3.0:1746066757.785968:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16083 00000100:00100000:0.0:1746066757.785969:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3777:x1830882984471936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.785972:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3776:x1830882984471296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.785973:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16081 00000100:00100000:2.0:1746066757.785978:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3777:x1830882984471424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (657us total) trans 21474841885 rc 0/0 00000100:00100000:1.0:1746066757.785982:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16084 00000100:00100000:2.0:1746066757.785985:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16080 00000100:00100000:1.0:1746066757.785985:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984471040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.785996:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16085 00000100:00100000:2.0:1746066757.786000:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3776:x1830882984471808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066757.786007:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066757.786009:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.786011:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.786012:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.786014:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746066757.786015:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066757.786017:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:1.0:1746066757.786018:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:1.0:1746066757.786020:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:1.0:1746066757.786022:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746066757.786030:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3776:x1830882984471296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (343us total) trans 17179874436 rc 0/0 00002000:00010000:2.0:1746066757.786032:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00000100:00100000:3.0:1746066757.786035:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16083 00002000:00010000:2.0:1746066757.786035:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.786036:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.786038:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00000100:00100000:1.0:1746066757.786039:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882984471040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (240us total) trans 21474841886 rc 0/0 00002000:00010000:2.0:1746066757.786040:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:1.0:1746066757.786044:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16084 00000100:00100000:3.0:1746066757.786046:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16086 00000100:00100000:3.0:1746066757.786050:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3775:x1830882984471680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.786051:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16087 00000100:00100000:1.0:1746066757.786054:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3775:x1830882984472192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.786055:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882984471808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (230us total) trans 21474841887 rc 0/0 00000100:00100000:2.0:1746066757.786060:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16085 00002000:00010000:0.0:1746066757.786061:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:0.0:1746066757.786064:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.786066:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066757.786068:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00000100:00100000:2.0:1746066757.786069:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16088 00002000:00010000:0.0:1746066757.786070:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:2.0:1746066757.786073:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3775:x1830882984472704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.786090:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.786096:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3777:x1830882984471936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (437us total) trans 17179874437 rc 0/0 00000100:00100000:0.0:1746066757.786102:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16082 00000100:00100000:1.0:1746066757.786106:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3775:x1830882984472192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (197us total) trans 17179874438 rc 0/0 00000100:00100000:3.0:1746066757.786108:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984472960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.786111:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16087 00000100:00100000:2.0:1746066757.786113:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3775:x1830882984472704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (179us total) trans 21474841888 rc 0/0 00000100:00100000:2.0:1746066757.786118:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16088 00000100:00100000:0.0:1746066757.786118:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472448 00000100:00100000:3.0:1746066757.786123:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.786123:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472448 00000100:00100000:2.0:1746066757.786129:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472960 00000100:00100000:2.0:1746066757.786132:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472960 00002000:00010000:1.0:1746066757.786136:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066757.786138:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.786140:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:1.0:1746066757.786142:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.786143:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00000004:00080000:3.0:1746066757.786145:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8000/2, rc 0, transno 21474841885 00000100:00100000:0.0:1746066757.786146:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16089 00000100:00100000:2.0:1746066757.786150:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16090 00000100:00100000:3.0:1746066757.786152:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984471424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.786152:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3777:x1830882984472448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.786154:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3777:x1830882984472960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.786158:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3775:x1830882984471680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (302us total) trans 17179874439 rc 0/0 00000004:00080000:3.0:1746066757.786161:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d00380/2, rc 0, transno 17179874437 00000100:00100000:3.0:1746066757.786170:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984471936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.786170:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16086 00002000:00010000:2.0:1746066757.786188:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00002000:00010000:2.0:1746066757.786190:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066757.786191:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066757.786193:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066757.786194:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:2.0:1746066757.786232:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3777:x1830882984472960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (108us total) trans 21474841889 rc 0/0 00000100:00100000:0.0:1746066757.786232:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3777:x1830882984472448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (140us total) trans 17179874440 rc 0/0 00000100:00100000:0.0:1746066757.786237:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16089 00000100:00100000:2.0:1746066757.786241:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16090 00000100:00100000:2.0:1746066757.786256:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066757.786269:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8380/2, rc 0, transno 21474841886 00000100:00100000:2.0:1746066757.786270:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984472832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.786274:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984471040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.786285:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d03800/2, rc 0, transno 17179874439 00000100:00100000:2.0:1746066757.786288:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.786288:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984471680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066757.786299:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d01880/2, rc 0, transno 17179874438 00000100:00100000:0.0:1746066757.786301:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984472192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066757.786309:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec8e00/2, rc 0, transno 21474841888 00000100:00100000:0.0:1746066757.786311:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984472704:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746066757.786326:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d00000/2, rc 0, transno 17179874436 00000100:00100000:2.0:1746066757.786331:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984471296:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066757.786340:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecaa00/2, rc 0, transno 21474841887 00000100:00100000:2.0:1746066757.786342:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984471808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.786342:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746066757.786347:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984473088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.786355:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472320 00000100:00100000:2.0:1746066757.786358:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472320 00000100:00100000:0.0:1746066757.786365:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066757.786372:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472832 00000100:00100000:2.0:1746066757.786374:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472832 00000100:00100000:2.0:1746066757.786382:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984473088 00000100:00100000:2.0:1746066757.786383:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984473088 00000100:00100000:1.0:1746066757.786393:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16091 00000100:00100000:1.0:1746066757.786400:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984472320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.786402:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16092 00000100:00100000:2.0:1746066757.786406:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984472832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.786410:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16093 00000100:00100000:0.0:1746066757.786417:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984473088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066757.786439:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:1.0:1746066757.786442:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.786443:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746066757.786445:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066757.786445:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:2.0:1746066757.786446:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066757.786447:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066757.786447:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00002000:00010000:2.0:1746066757.786448:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:2.0:1746066757.786449:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000004:00080000:3.0:1746066757.786470:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e211f80/2, rc 0, transno 21474841889 00000100:00100000:3.0:1746066757.786474:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984472960:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066757.786483:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d01180/2, rc 0, transno 17179874440 00000100:00100000:1.0:1746066757.786485:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882984472320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (228us total) trans 21474841890 rc 0/0 00000100:00100000:3.0:1746066757.786486:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984472448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.786486:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882984472832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (197us total) trans 21474841891 rc 0/0 00000100:00100000:1.0:1746066757.786490:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16091 00000100:00100000:2.0:1746066757.786493:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16092 00000100:00100000:2.0:1746066757.786509:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746066757.786509:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecbb80/2, rc 0, transno 21474841890 00000100:00100000:1.0:1746066757.786512:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984472320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066757.786519:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ec9180/2, rc 0, transno 21474841891 00000100:00100000:1.0:1746066757.786522:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ec9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984472832:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.786525:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984473088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (158us total) trans 21474841892 rc 0/0 00000100:00100000:0.0:1746066757.786530:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16093 00000100:00100000:1.0:1746066757.786533:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472064 00000100:00100000:2.0:1746066757.786534:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984472576:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.786536:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472064 00000100:00100000:2.0:1746066757.786550:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066757.786552:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16094 00000004:00080000:0.0:1746066757.786552:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88006e210000/2, rc 0, transno 21474841892 00000100:00100000:3.0:1746066757.786556:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984472576 00000100:00100000:1.0:1746066757.786556:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882984472064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.786556:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88006e210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984473088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.786558:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984472576 00000004:00080000:2.0:1746066757.786567:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d03100/2, rc 0, transno 17179874434 00000100:00100000:3.0:1746066757.786570:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16095 00000100:00100000:2.0:1746066757.786570:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984471168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.786574:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+52:3774:x1830882984472576:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066757.786579:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d00700/2, rc 0, transno 17179874435 00000100:00100000:2.0:1746066757.786582:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984471552:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746066757.786594:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00002000:00010000:1.0:1746066757.786596:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.786598:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066757.786600:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.786602:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:1.0:1746066757.786635:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094305180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984472064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (122us total) trans 21474841893 rc 0/0 00000100:00100000:1.0:1746066757.786642:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16094 00000004:00080000:2.0:1746066757.786643:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096ecb100/2, rc 0, transno 21474841893 00000100:00100000:2.0:1746066757.786647:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984472064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.786904:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3774:x1830882984472576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 306us (330us total) trans 17179874441 rc 0/0 00000004:00080000:2.0:1746066757.786908:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d00e00/2, rc 0, transno 17179874441 00000100:00100000:3.0:1746066757.786909:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16095 00000100:00100000:2.0:1746066757.786911:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984472576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.788043:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.788142:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983270784 00000100:00100000:2.0:1746066757.788148:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983270784 00000100:00100000:2.0:1746066757.788190:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16304 00000100:00100000:2.0:1746066757.788197:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:734:x1830882983270784:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066757.788211:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.788223:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ad1 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.788262:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.788274:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.788286:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.788288:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066757.788291:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfc00, rc 0) 00000100:00100000:2.0:1746066757.788337:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:734:x1830882983270784:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.788341:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16304 00000100:00100000:0.0:1746066757.790242:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.790347:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983271040 00000100:00100000:1.0:1746066757.790356:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983271040 00000100:00100000:1.0:1746066757.790637:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5950 00000100:00100000:1.0:1746066757.790646:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:734:x1830882983271040:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066757.790949:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:734:x1830882983271040:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 304us (711us total) trans 8589936637 rc 0/0 00000100:00100000:1.0:1746066757.790956:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5950 00000100:00100000:0.0:1746066757.803957:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.804062:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983271296 00000100:00100000:3.0:1746066757.804071:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983271296 00000100:00100000:3.0:1746066757.804120:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16305 00000100:00100000:3.0:1746066757.804126:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:745:x1830882983271296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.804151:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.804167:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226d200/0xf1867c21abfa753f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ad8 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.804237:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804247:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804257:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804269:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804274:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804279:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804385:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804393:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804398:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066757.804406:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066757.804491:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804497:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804501:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804506:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804511:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b226cc00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066757.804515:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804521:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804531:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066757.804533:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066757.804537:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804541:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226cc00/0xf1867c21abfa7546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804576:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804580:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804584:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804587:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a5ce00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066757.804589:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804593:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.804674:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34e400) 00010000:00010000:3.0:1746066757.804676:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066757.804678:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.805046:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098a5ce00/0xf1867c21abfa754d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.805940:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b226d200/0xf1867c21abfa753f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.805955:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.805961:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.805963:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066757.805967:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009414dc00, rc 0) 00000100:00100000:3.0:1746066757.806027:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:745:x1830882983271296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1900us (2077us total) trans 8589936638 rc 0/0 00000100:00100000:3.0:1746066757.806036:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16305 00000100:00100000:1.0:1746066757.806210:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.806378:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983271552 00000100:00100000:3.0:1746066757.806384:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983271552 00000100:00100000:3.0:1746066757.806419:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16306 00000100:00100000:3.0:1746066757.806425:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+26:742:x1830882983271552:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066757.806444:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.806454:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1adf expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.806514:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806521:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806532:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806542:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806547:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806551:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806621:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806629:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806634:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066757.806641:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066757.806689:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806694:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806698:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806704:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806709:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066757.806712:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806718:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806725:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066757.806727:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066757.806730:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806734:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806741:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806745:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806749:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806753:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066757.806755:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806760:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806765:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012e34ee00) 00010000:00010000:3.0:1746066757.806767:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066757.806769:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806776:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9c00/0xf1867c21abfa7570 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.806800:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8600/0xf1867c21abfa7562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.806808:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.806814:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.806815:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066757.806817:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9600, rc 0) 00000100:00100000:3.0:1746066757.806858:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:742:x1830882983271552:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 433us (744us total) trans 8589936639 rc 0/0 00000100:00100000:3.0:1746066757.806863:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16306 00000100:00100000:2.0:1746066757.809588:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.809664:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.809726:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983271808 00000100:00100000:0.0:1746066757.809738:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983271808 00000100:00100000:3.0:1746066757.809741:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983272064 00000100:00100000:3.0:1746066757.809746:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983272064 00000100:00100000:0.0:1746066757.809788:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5951 00000100:00100000:0.0:1746066757.809796:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:745:x1830882983271808:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066757.809801:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16307 00000100:00100000:3.0:1746066757.809927:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:746:x1830882983272064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.809940:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.809958:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfa7585 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ae6 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.810038:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa758c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066757.810044:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:745:x1830882983271808:12345-192.168.204.16@tcp:35:cat.0 Request processed in 249us (466us total) trans 8589936640 rc 0/0 00010000:00010000:3.0:1746066757.810051:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa758c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066757.810051:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5951 00010000:00010000:3.0:1746066757.810064:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa758c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066757.810074:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066757.810127:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9e00/0xf1867c21abfa7585 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ae6 expref: 31 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.810140:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa758c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ae6 expref: 30 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.810148:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.810150:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746066757.810153:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8e00, rc 0) 00000100:00100000:3.0:1746066757.810186:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:746:x1830882983272064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 379us (521us total) trans 8589936641 rc 0/0 00000100:00100000:3.0:1746066757.810191:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16307 00000100:00100000:1.0:1746066757.813623:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.813652:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983272192 00000100:00100000:3.0:1746066757.813663:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983272192 00000100:00100000:3.0:1746066757.813724:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16096 00000100:00100000:3.0:1746066757.813733:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+22:746:x1830882983272192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.813750:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.813768:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1aed expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.813794:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.813795:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.813804:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.813824:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.813834:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8200, rc 0) 00000100:00100000:3.0:1746066757.813932:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+23:746:x1830882983272192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 198us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.813939:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16096 00000100:00100000:0.0:1746066757.814145:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.814368:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.814434:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983272320 00000100:00100000:3.0:1746066757.814438:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983272320 00000100:00100000:3.0:1746066757.814509:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16097 00000100:00100000:3.0:1746066757.814515:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+13:745:x1830882983272320:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.814523:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.814530:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1af4 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.814540:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.814541:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.814545:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.814553:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 14 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.814559:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8c00, rc 0) 00000100:00100000:3.0:1746066757.814580:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+14:745:x1830882983272320:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.814588:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16097 00000100:00100000:2.0:1746066757.814700:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983272576 00000100:00100000:2.0:1746066757.814705:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983272576 00000100:00100000:2.0:1746066757.814730:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16308 00000100:00100000:2.0:1746066757.814735:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:741:x1830882983272576:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066757.814749:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.814760:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa75a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1afb expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.814853:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.814866:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.814872:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.814879:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.814929:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.814940:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 29 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.814951:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473216:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.815023:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.815444:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 12 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.815454:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473344:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.815974:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.818667:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.819207:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983272832 00000100:00100000:2.0:1746066757.819218:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983272832 00002000:00100000:2.0:1746066757.819262:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88006e211880 x1830882983272832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.819271:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211880 with x1830882983272832 ext(0->1048575) 00002000:00010000:2.0:1746066757.819276:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211880 00000100:00100000:2.0:1746066757.819299:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4313 00000100:00100000:2.0:1746066757.819307:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882983272832:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.820433:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473344:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.821653:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.821671:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473216:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.821692:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:0.0:1746066757.821704:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983272960 00000100:00100000:0.0:1746066757.821714:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983272960 00010000:00010000:0.0:1746066757.821751:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 13 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746066757.821797:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7252 00000100:00100000:0.0:1746066757.821804:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:2015:x1830882983272960:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.821818:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.821824:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 13 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.821834:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 13 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.821857:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7554 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad8 expref: 13 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.821906:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.821911:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066757.822244:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066757.822252:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.822308:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983272960:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 503us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.822319:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7252 00000100:00100000:0.0:1746066757.823522:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.823568:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.823636:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983273088 00000100:00100000:3.0:1746066757.823638:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983273216 00000100:00100000:2.0:1746066757.823641:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983273088 00000100:00100000:3.0:1746066757.823647:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983273216 00010000:00010000:2.0:1746066757.823662:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 30 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.823680:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7253 00000100:00100000:3.0:1746066757.823685:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16309 00000100:00100000:2.0:1746066757.823686:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983273088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066757.823692:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+12:745:x1830882983273216:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.823695:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.823699:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 30 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066757.823707:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.823709:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 30 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.823725:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7577 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1adf expref: 30 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066757.823727:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b02 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.823740:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.823744:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.823751:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.823756:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.823771:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 13 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.824201:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.824252:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983273088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 564us (731us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066757.824259:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066757.824260:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7253 00010000:00010000:0.0:1746066757.824265:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:0.0:1746066757.824279:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066757.824553:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 14 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.824572:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.824575:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066757.824578:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2ca00, rc 0) 00000100:00100000:3.0:1746066757.824610:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ce04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+14:745:x1830882983273216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 918us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.824616:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16309 00010000:00010000:0.0:1746066757.824642:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfa00/0xf1867c21abfa75a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 14 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.824655:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 13 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.824660:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.824661:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746066757.824663:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf000, rc 0) 00000100:00100000:0.0:1746066757.824878:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:741:x1830882983272576:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 9946us (10314us total) trans 8589936642 rc 0/0 00000100:00100000:0.0:1746066757.825023:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16308 00000100:00100000:2.0:1746066757.825313:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006e211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+23:2013:x1830882983272832:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6005us (6651us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.825322:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4313 00002000:00100000:2.0:1746066757.825328:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88006e211880 x1830882983272832/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.825336:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88006e211880 with x1830882983272832 ext(0->1048575) 00002000:00010000:2.0:1746066757.825340:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88006e211880 00000100:00100000:0.0:1746066757.828785:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.828856:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983273344 00000100:00100000:1.0:1746066757.828862:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983273344 00000100:00100000:1.0:1746066757.829285:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16098 00000100:00100000:1.0:1746066757.829293:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+46:746:x1830882983273344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.829307:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.829321:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b09 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.829340:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.829341:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.829347:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 47 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.829360:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 47 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.829368:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098faf400, rc 0) 00000100:00100000:1.0:1746066757.829412:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:746:x1830882983273344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 120us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.829419:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16098 00000100:00100000:0.0:1746066757.829759:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.829849:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983273600 00000100:00100000:2.0:1746066757.829854:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983273600 00002000:00100000:2.0:1746066757.829879:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4ed4a80 x1830882983273600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.829905:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed4a80 with x1830882983273600 ext(0->1048575) 00002000:00010000:2.0:1746066757.829909:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed4a80 00000100:00100000:2.0:1746066757.829932:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4314 00000100:00100000:2.0:1746066757.829937:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983273600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066757.836005:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.836489:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983273856 00000100:00100000:2.0:1746066757.836499:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983273856 00002000:00100000:2.0:1746066757.836536:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a4ed6d80 x1830882983273856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.836545:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed6d80 with x1830882983273856 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.836549:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ed6d80 00000100:00100000:2.0:1746066757.836577:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4315 00000100:00100000:2.0:1746066757.836584:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882983273856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.837449:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2014:x1830882983273600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7510us (7689us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.837465:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4314 00002000:00100000:2.0:1746066757.837471:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4ed4a80 x1830882983273600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.837477:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed4a80 with x1830882983273600 ext(0->1048575) 00002000:00010000:2.0:1746066757.837480:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4ed4a80 00000100:00100000:0.0:1746066757.846062:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.846675:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983274112 00000100:00100000:2.0:1746066757.846682:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983274112 00000100:00100000:2.0:1746066757.846735:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16310 00000100:00100000:2.0:1746066757.846742:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+29:742:x1830882983274112:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066757.846760:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.846763:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746066757.846785:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8e00/0xf1867c21abfa758c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ae6 expref: 29 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.846808:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066757.846812:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066757.846822:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa75cb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b10 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.846863:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.846873:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.846879:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 12 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.846902:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.846924:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 12 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.846935:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 12 pid: 13370 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.846953:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473472:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.847354:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 8 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.847362:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 8 pid: 13370 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.847369:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473600:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.847385:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.847635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.847810:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882983273856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11225us (11815us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066757.847818:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4315 00002000:00100000:3.0:1746066757.847826:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800a4ed6d80 x1830882983273856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.847840:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4ed6d80 with x1830882983273856 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.847844:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4ed6d80 00000100:00100000:2.0:1746066757.847844:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983274240 00000100:00100000:2.0:1746066757.847848:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983274240 00000100:00100000:2.0:1746066757.847871:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16099 00000100:00100000:2.0:1746066757.847876:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+33:745:x1830882983274240:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.847905:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.847916:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b17 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.847931:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.847932:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.847938:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.847949:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.847958:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acda6200, rc 0) 00000100:00100000:2.0:1746066757.847974:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+34:745:x1830882983274240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.847979:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16099 00000100:00100000:2.0:1746066757.851573:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.851596:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473472:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.851607:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984473600:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.851613:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066757.851625:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066757.851669:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983274496 00000100:00100000:1.0:1746066757.851675:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983274496 00000100:00100000:3.0:1746066757.851676:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983274368 00000100:00100000:3.0:1746066757.851680:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983274368 00010000:00010000:3.0:1746066757.851698:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 13 pid: 13370 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066757.851698:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 9 pid: 13370 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066757.851721:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7254 00000100:00100000:3.0:1746066757.851727:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+13:2016:x1830882983274368:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746066757.851728:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7255 00000100:00100000:1.0:1746066757.851733:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983274496:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066757.851738:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066757.851740:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066757.851743:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 13 pid: 13370 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066757.851745:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 9 pid: 13370 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066757.851751:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 13 pid: 13370 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066757.851760:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 9 pid: 13370 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066757.851780:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2ca00/0xf1867c21abfa75b6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b02 expref: 13 pid: 13370 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066757.851852:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7538 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ad1 expref: 9 pid: 13370 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066757.851862:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066757.851866:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.851874:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066757.851880:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066757.851952:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.851956:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066757.851980:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.852010:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:2016:x1830882983274368:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 283us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.852016:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7254 00000100:00100000:1.0:1746066757.852058:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8427c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983274496:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 323us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.852064:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7255 00010000:00010000:0.0:1746066757.852064:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066757.852070:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:02000000:0.0:1746066757.852110:0:7245:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:0.0:1746066757.852310:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].653, 88 off65176 00000004:00080000:0.0:1746066757.852315:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726063431906ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066757.852353:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].585, 88 off59280 00000004:00080000:0.0:1746066757.852356:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726063473215ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066757.852378:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].586, 88 off59368 00000004:00080000:0.0:1746066757.852380:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726063497106ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066757.852388:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].654, 88 off65264 00000004:00080000:0.0:1746066757.852391:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726063507678ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066757.852398:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].655, 88 off65352 00000004:00080000:0.0:1746066757.852400:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726063517166ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066757.852407:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].587, 88 off59456 00000004:00080000:0.0:1746066757.852409:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726063525648ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066757.852414:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].588, 88 off59544 00000004:00080000:0.0:1746066757.852416:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726063533236ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066757.852422:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].589, 88 off59632 00000004:00080000:0.0:1746066757.852424:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726063540736ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066757.852431:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].656, 88 off65440 00000004:00080000:0.0:1746066757.852433:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726063549724ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066757.852440:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].590, 88 off59720 00000004:00080000:0.0:1746066757.852442:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726063559195ns, next at 665959948938ns, rc = 0 00000040:00080000:0.0:1746066757.853814:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].658, 88 off65624 00000004:00080000:0.0:1746066757.853823:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726064939454ns, next at 665943319442ns, rc = 0 00000040:00080000:0.0:1746066757.853843:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].591, 88 off59808 00000004:00080000:0.0:1746066757.853846:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726064962748ns, next at 665959948938ns, rc = 0 00000100:00100000:0.0:1746066757.853966:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.853989:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983274624 00000040:00080000:1.0:1746066757.854009:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].659, 88 off65712 00000004:00080000:1.0:1746066757.854016:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726065132096ns, next at 665943319442ns, rc = 0 00000100:00100000:0.0:1746066757.854021:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000040:00080000:1.0:1746066757.854044:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].660, 88 off65800 00000004:00080000:1.0:1746066757.854048:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726065164906ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.854056:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].661, 88 off65888 00000004:00080000:1.0:1746066757.854059:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726065175633ns, next at 665943319442ns, rc = 0 00000100:00100000:2.0:1746066757.854064:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983274752 00000100:00100000:2.0:1746066757.854069:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983274752 00000040:00080000:1.0:1746066757.854071:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].662, 88 off65976 00000100:00100000:3.0:1746066757.854072:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983274624 00000004:00080000:1.0:1746066757.854073:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 726065189988ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066757.854082:0:7245:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].592, 88 off59896 00000004:00080000:1.0:1746066757.854084:0:7245:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 726065201220ns, next at 665959948938ns, rc = 0 00000100:00100000:2.0:1746066757.854103:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16100 00000100:00100000:0.0:1746066757.854108:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16311 00000100:00100000:2.0:1746066757.854109:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:746:x1830882983274752:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066757.854115:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:745:x1830882983274624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.854122:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.854127:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.854135:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b25 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.854135:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b1e expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.854150:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.854151:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.854157:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 48 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.854166:0:10125:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066757.854168:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 48 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.854172:0:10125:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.854177:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfe00, rc 0) 00010000:00010000:0.0:1746066757.854183:0:10125:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7245 initiator: MDT0 00010000:00010000:0.0:1746066757.854191:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.854199:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.854201:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746066757.854204:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+48:746:x1830882983274752:12345-192.168.204.16@tcp:101:cat.0 Request processed in 94us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1746066757.854204:0:10125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 13 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.854209:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16100 00010000:00010000:0.0:1746066757.854209:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097ce0c00, rc 0) 00000100:00100000:0.0:1746066757.854226:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:745:x1830882983274624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 112us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.854230:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16311 00000001:00080000:3.0:1746066757.856431:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936643 is committed 00000004:00080000:3.0:1746066757.856440:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 582 committed 00000004:00080000:3.0:1746066757.856467:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 650 committed 00000004:00080000:3.0:1746066757.856481:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 649 committed 00000004:00080000:3.0:1746066757.856483:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 648 committed 00000004:00080000:3.0:1746066757.856485:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 647 committed 00000004:00080000:3.0:1746066757.856486:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 581 committed 00000004:00080000:3.0:1746066757.856488:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 646 committed 00000004:00080000:3.0:1746066757.856489:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 580 committed 00000004:00080000:3.0:1746066757.856490:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 645 committed 00000004:00080000:3.0:1746066757.856491:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 579 committed 00000004:00080000:3.0:1746066757.856492:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 578 committed 00000004:00080000:3.0:1746066757.856494:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 577 committed 00000004:00080000:3.0:1746066757.856495:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 644 committed 00000004:00080000:3.0:1746066757.856496:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 643 committed 00000004:00080000:3.0:1746066757.856498:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 576 committed 00000004:00080000:3.0:1746066757.856499:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 575 committed 00000004:00080000:3.0:1746066757.856501:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 642 committed 00000001:00080000:3.0:1746066757.856505:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936642 is committed 00000001:00080000:3.0:1746066757.856514:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936637 is committed 00000100:00100000:0.0:1746066757.856827:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984473728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.856875:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.856917:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.856933:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.856955:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066757.856959:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.856974:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.856984:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.856998:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.857068:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.857086:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.857098:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984475264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.857111:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.857122:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746066757.857125:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984475136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.857138:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.857147:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984475648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.857160:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.857179:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984473728 00000100:00100000:0.0:1746066757.857184:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984473728 00000100:00100000:0.0:1746066757.857209:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984474240 00000100:00100000:0.0:1746066757.857211:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984474240 00000100:00100000:0.0:1746066757.857220:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984474112 00000100:00100000:0.0:1746066757.857222:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984474112 00000100:00100000:0.0:1746066757.857229:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984474624 00000100:00100000:0.0:1746066757.857231:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984474624 00000100:00100000:0.0:1746066757.857236:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984474752 00000100:00100000:0.0:1746066757.857238:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984474752 00000100:00100000:1.0:1746066757.857244:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984473856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.857244:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984475264 00000100:00100000:0.0:1746066757.857246:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984475264 00000100:00100000:0.0:1746066757.857251:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984475136 00000100:00100000:0.0:1746066757.857253:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984475136 00000100:00100000:0.0:1746066757.857258:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984475648 00000100:00100000:0.0:1746066757.857259:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984475648 00000100:00100000:0.0:1746066757.857267:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16101 00000100:00100000:1.0:1746066757.857269:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.857272:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3775:x1830882984473728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.857281:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984474368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.857292:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066757.857299:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984474880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.857311:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066757.857317:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984475392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.857326:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984473984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.857328:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066757.857349:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066757.857360:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984474496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.857378:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066757.857380:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746066757.857383:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00000100:00100000:3.0:1746066757.857385:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984475008:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066757.857385:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.857387:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.857389:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746066757.857399:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066757.857408:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984475520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066757.857415:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3775:x1830882984473728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (539us total) trans 21474841894 rc 0/0 00000100:00100000:3.0:1746066757.857419:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066757.857422:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16101 00000100:00100000:0.0:1746066757.857431:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984473856 00000100:00100000:0.0:1746066757.857434:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984473856 00000100:00100000:3.0:1746066757.857437:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984474368 00000100:00100000:3.0:1746066757.857440:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984474368 00000100:00100000:0.0:1746066757.857441:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984474880 00000100:00100000:0.0:1746066757.857443:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984474880 00000100:00100000:0.0:1746066757.857448:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984475392 00000100:00100000:0.0:1746066757.857450:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984475392 00000100:00100000:0.0:1746066757.857470:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16102 00000100:00100000:3.0:1746066757.857471:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984473984 00000100:00100000:3.0:1746066757.857473:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984473984 00000100:00100000:0.0:1746066757.857474:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3775:x1830882984474240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.857481:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984474496 00000100:00100000:3.0:1746066757.857482:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984474496 00000100:00100000:3.0:1746066757.857487:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984475008 00000100:00100000:3.0:1746066757.857489:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984475008 00000100:00100000:3.0:1746066757.857494:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984475520 00000100:00100000:3.0:1746066757.857496:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984475520 00000100:00100000:3.0:1746066757.857503:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16103 00000100:00100000:3.0:1746066757.857507:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3775:x1830882984474112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066757.857514:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb size from disk: 3227648 -> 3227648 00002000:00010000:0.0:1746066757.857516:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.857518:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066757.857519:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.857521:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9c:0x0] updating lvb blocks from disk: 160 -> 160 00000100:00100000:1.0:1746066757.857528:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16104 00000100:00100000:1.0:1746066757.857535:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3775:x1830882984474624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066757.857539:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3775:x1830882984474240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (605us total) trans 21474841895 rc 0/0 00000100:00100000:0.0:1746066757.857544:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16102 00002000:00010000:3.0:1746066757.857552:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 2965504 -> 2965504 00000100:00100000:0.0:1746066757.857553:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16105 00002000:00010000:3.0:1746066757.857555:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066757.857556:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746066757.857557:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3775:x1830882984474752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746066757.857558:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066757.857560:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 3440 -> 3440 00000100:00100000:3.0:1746066757.857579:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3775:x1830882984474112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (604us total) trans 21474841896 rc 0/0 00000100:00100000:3.0:1746066757.857584:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16103 00000100:00100000:3.0:1746066757.857595:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16106 00000100:00100000:3.0:1746066757.857599:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882984475264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066757.857607:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066757.857609:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.857611:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.857613:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.857615:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746066757.857631:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+62:3775:x1830882984474752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (545us total) trans 17179874442 rc 0/0 00000100:00100000:0.0:1746066757.857636:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16105 00002000:00010000:3.0:1746066757.857640:0:9590:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 3117056 -> 3117056 00002000:00010000:3.0:1746066757.857642:0:9590:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066757.857644:0:9590:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746066757.857644:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16107 00002000:00010000:3.0:1746066757.857645:0:9590:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:3.0:1746066757.857647:0:9590:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 3072 -> 3072 00000100:00100000:0.0:1746066757.857648:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882984475136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.857665:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882984475264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (552us total) trans 17179874443 rc 0/0 00000100:00100000:3.0:1746066757.857670:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16106 00000100:00100000:3.0:1746066757.857680:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16108 00002000:00010000:0.0:1746066757.857682:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746066757.857684:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882984475648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066757.857684:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.857686:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746066699 -> 1746066699 00002000:00010000:0.0:1746066757.857688:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:0.0:1746066757.857689:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 3144 -> 3144 00002000:00010000:1.0:1746066757.857705:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb size from disk: 7421952 -> 7421952 00000100:00100000:0.0:1746066757.857705:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882984475136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (565us total) trans 17179874444 rc 0/0 00002000:00010000:1.0:1746066757.857708:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb mtime from disk: 1746066704 -> 1746066704 00000100:00100000:0.0:1746066757.857709:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16107 00002000:00010000:1.0:1746066757.857710:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746066757.857711:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb ctime from disk: 1746066704 -> 1746066704 00002000:00010000:1.0:1746066757.857713:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9e:0x0] updating lvb blocks from disk: 4912 -> 4912 00000100:00100000:0.0:1746066757.857718:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16109 00000100:00100000:0.0:1746066757.857722:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882984473856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.857834:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3775:x1830882984475648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (672us total) trans 17179874445 rc 0/0 00000100:00100000:1.0:1746066757.857834:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3775:x1830882984474624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 298us (834us total) trans 21474841897 rc 0/0 00000100:00100000:1.0:1746066757.857839:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16104 00000100:00100000:3.0:1746066757.857843:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16108 00000100:00100000:2.0:1746066757.857852:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16110 00000100:00100000:1.0:1746066757.857856:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16111 00000100:00100000:3.0:1746066757.857859:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16112 00000100:00100000:2.0:1746066757.857859:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882984474880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.857861:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3776:x1830882984474368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.857863:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3776:x1830882984475392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.857923:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16113 00002000:00010000:2.0:1746066757.857924:0:12233:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746066757.857927:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882984473984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746066757.857927:0:12233:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.857928:0:12233:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.857930:0:12233:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:2.0:1746066757.857932:0:12233:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066757.857937:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3776:x1830882984474368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (643us total) trans 21474841899 rc 0/0 00000100:00100000:1.0:1746066757.857942:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16111 00000100:00100000:1.0:1746066757.857953:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16114 00000100:00100000:1.0:1746066757.857957:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3777:x1830882984474496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746066757.857966:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:3.0:1746066757.857969:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.857970:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.857972:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:3.0:1746066757.857973:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00002000:00010000:1.0:1746066757.857987:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746066757.857989:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066757.857990:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746066757.858063:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066757.858066:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.858067:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.858068:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.858070:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066757.858109:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3776:x1830882984474880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (797us total) trans 17179874446 rc 0/0 00000100:00100000:0.0:1746066757.858110:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3776:x1830882984473856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 388us (842us total) trans 21474841898 rc 0/0 00000100:00100000:3.0:1746066757.858112:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3777:x1830882984473984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 184us (761us total) trans 21474841900 rc 0/0 00000100:00100000:0.0:1746066757.858115:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16109 00002000:00010000:1.0:1746066757.858141:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746066711 -> 1746066711 00002000:00010000:1.0:1746066757.858143:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 6416 -> 6416 00000100:00100000:2.0:1746066757.858178:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16110 00000100:00100000:3.0:1746066757.858182:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16113 00000100:00100000:0.0:1746066757.858185:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16115 00000100:00100000:2.0:1746066757.858188:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16116 00000100:00100000:0.0:1746066757.858190:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3777:x1830882984475008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.858192:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3777:x1830882984475520:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746066757.858221:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5880/2, rc 0, transno 21474841900 00000100:00100000:1.0:1746066757.858223:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3777:x1830882984474496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (843us total) trans 21474841901 rc 0/0 00000100:00100000:3.0:1746066757.858229:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984473984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.858229:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16114 00000004:00080000:3.0:1746066757.858237:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7480/2, rc 0, transno 21474841901 00000004:00080000:0.0:1746066757.858238:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e6bb80/2, rc 0, transno 17179874444 00000100:00100000:3.0:1746066757.858240:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984474496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066757.858240:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+63:3777:x1830882984475520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (820us total) trans 17179874448 rc 0/0 00000100:00100000:0.0:1746066757.858242:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984475136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.858245:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16116 00000004:00080000:3.0:1746066757.858247:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e69880/2, rc 0, transno 17179874448 00000100:00100000:3.0:1746066757.858249:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984475520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066757.858249:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e68000/2, rc 0, transno 17179874445 00000100:00100000:0.0:1746066757.858252:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984475648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066757.858257:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a6d80/2, rc 0, transno 21474841898 00000004:00080000:0.0:1746066757.858258:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094306680/2, rc 0, transno 17179874442 00000100:00100000:0.0:1746066757.858260:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.858261:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984473856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.858266:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e69180/2, rc 0, transno 17179874443 00000004:00080000:1.0:1746066757.858269:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a4a80/2, rc 0, transno 21474841899 00000100:00100000:0.0:1746066757.858269:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984475264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066757.858272:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984474368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.858276:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5f80/2, rc 0, transno 21474841896 00000100:00100000:2.0:1746066757.858278:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:3776:x1830882984475392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 414us (949us total) trans 17179874447 rc 0/0 00000004:00080000:1.0:1746066757.858278:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e6b800/2, rc 0, transno 17179874446 00000100:00100000:0.0:1746066757.858278:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.858281:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984474880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066757.858282:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16112 00000004:00080000:0.0:1746066757.858284:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7b80/2, rc 0, transno 21474841897 00000100:00100000:3.0:1746066757.858286:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746066757.858286:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066757.858287:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e69500/2, rc 0, transno 17179874447 00000100:00100000:1.0:1746066757.858289:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984475392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746066757.858292:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984475776:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.858292:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7100/2, rc 0, transno 21474841894 00000100:00100000:0.0:1746066757.858294:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984473728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066757.858299:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7800/2, rc 0, transno 21474841895 00000100:00100000:0.0:1746066757.858301:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984474240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066757.858308:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066757.858319:0:1893:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066757.858321:0:1893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.858323:0:1893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.858324:0:1893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066758 -> 1746066758 00002000:00010000:0.0:1746066757.858326:0:1893:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:3.0:1746066757.858327:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984475776 00010000:00010000:1.0:1746066757.858327:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b10 expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.858329:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984475776 00010000:00010000:1.0:1746066757.858337:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.858340:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1746066757.858344:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3777:x1830882984475008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 154us (944us total) trans 17179874449 rc 0/0 00010000:00010000:1.0:1746066757.858345:0:7245:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.858348:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16115 00000100:00100000:3.0:1746066757.858351:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16117 00010000:00010000:1.0:1746066757.858354:0:7245:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.858356:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3774:x1830882984475776:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746066757.858360:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.858385:0:7245:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 9 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.858394:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984475904:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066757.858397:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.858411:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983274880 00000100:00100000:0.0:1746066757.858414:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983274880 00000100:00100000:3.0:1746066757.858429:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3774:x1830882984475776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (119us total) trans 21474841902 rc 0/0 00000100:00100000:3.0:1746066757.858434:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16117 00000100:00100000:0.0:1746066757.858434:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16312 00000100:00100000:1.0:1746066757.858436:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.858439:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:746:x1830882983274880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066757.858448:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1746066757.858453:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096e68a80/2, rc 0, transno 17179874449 00000100:00100000:3.0:1746066757.858466:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096e68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984475008:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746066757.858471:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33e00/0xf1867c21abfa75ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b2c expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.858507:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33e00/0xf1867c21abfa75ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b2c expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.858517:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33e00/0xf1867c21abfa75ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b2c expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.858529:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066757.858532:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746066757.858534:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33e00, rc 0) 00000100:00100000:0.0:1746066757.858561:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:746:x1830882983274880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 122us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.858566:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16312 00000004:00080000:2.0:1746066757.858602:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cedf80/2, rc 0, transno 21474841902 00000100:00100000:2.0:1746066757.858606:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984475776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066757.859394:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984475904:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066757.859413:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa75cb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b10 expref: 29 pid: 7245 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746066757.859436:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b10 expref: 28 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.859450:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecea00, rc 0) 00000100:00100000:1.0:1746066757.859494:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:742:x1830882983274112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12752us (13438us total) trans 8589936643 rc 0/0 00000100:00100000:1.0:1746066757.859502:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16310 00000100:00100000:0.0:1746066757.859723:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.859870:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983275008 00000100:00100000:1.0:1746066757.859874:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983275008 00000100:00100000:1.0:1746066757.859917:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5952 00000100:00100000:1.0:1746066757.859923:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:745:x1830882983275008:12345-192.168.204.16@tcp:49:cat.0 00000100:00100000:1.0:1746066757.859979:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:745:x1830882983275008:12345-192.168.204.16@tcp:49:cat.0 Request processed in 55us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.859984:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5952 00000100:00100000:0.0:1746066757.860263:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.860354:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983275136 00000100:00100000:1.0:1746066757.860358:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983275136 00000100:00100000:1.0:1746066757.860377:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16313 00000100:00100000:1.0:1746066757.860381:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:741:x1830882983275136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066757.860388:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.860396:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa75f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b33 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.860420:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa75f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b33 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.860428:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa75f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b33 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.860437:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.860440:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066757.860442:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009414dc00, rc 0) 00000100:00100000:1.0:1746066757.860917:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+11:741:x1830882983275136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 533us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.860923:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16313 00000100:00100000:2.0:1746066757.864237:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.864283:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983275264 00000100:00100000:2.0:1746066757.864285:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.864291:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983275264 00000100:00100000:1.0:1746066757.864327:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 785 00000100:00100000:1.0:1746066757.864334:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983275264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.864344:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066757.864362:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009414dc00/0xf1867c21abfa75f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b33 expref: 11 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.864388:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066757.864392:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066757.864420:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983275264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.864425:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 785 00000100:00100000:3.0:1746066757.864445:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983275392 00000100:00100000:3.0:1746066757.864449:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983275392 00000100:00100000:3.0:1746066757.864483:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16118 00000100:00100000:3.0:1746066757.864488:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:741:x1830882983275392:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066757.864500:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.864511:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b3a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.864601:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.864614:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.864622:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.864629:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.864631:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.864633:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [761856->1048575] (req 761856->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.864662:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.864673:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 22 pid: 20361 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066757.864686:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984476032:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.865154:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.865276:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983275648 00000100:00100000:2.0:1746066757.865281:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983275648 00002000:00100000:2.0:1746066757.865304:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096e69f80 x1830882983275648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.865313:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69f80 with x1830882983275648 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.865317:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e69f80 00000100:00100000:2.0:1746066757.865329:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4316 00010000:00010000:3.0:1746066757.865359:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 15 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.865367:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 15 pid: 20361 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066757.865376:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984476160:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066757.865513:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066757.865520:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 14 pid: 12233 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746066757.865528:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984476288:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066757.865545:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.865592:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983275648:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066757.867755:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.867874:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984476032:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.868014:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983275904 00000100:00100000:1.0:1746066757.868021:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983275904 00002000:00100000:1.0:1746066757.868049:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096e6b480 x1830882983275904/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.868057:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6b480 with x1830882983275904 ext(1048576->2097151) 00002000:00010000:1.0:1746066757.868061:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e6b480 00000100:00100000:1.0:1746066757.868134:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4317 00000100:00100000:1.0:1746066757.868140:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983275904:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066757.873283:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.873667:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983276032 00000100:00100000:2.0:1746066757.873674:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983276032 00010000:00010000:2.0:1746066757.873701:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 23 pid: 20361 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.873796:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7256 00000100:00100000:2.0:1746066757.873804:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983276032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.873815:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.873831:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 23 pid: 20361 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.873841:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 23 pid: 20361 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.873859:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa759a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aed expref: 23 pid: 20361 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.873906:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.874471:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983276032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 666us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.874478:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7256 00000100:00100000:2.0:1746066757.874796:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+48:2015:x1830882983275648:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9207us (9643us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066757.874806:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4316 00002000:00100000:2.0:1746066757.874813:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096e69f80 x1830882983275648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.874821:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e69f80 with x1830882983275648 ext(1048576->2097151) 00002000:00010000:2.0:1746066757.874824:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e69f80 00000100:00100000:3.0:1746066757.876214:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984476160:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.876772:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.876879:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983276160 00000100:00100000:2.0:1746066757.876897:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983276160 00010000:00010000:2.0:1746066757.876919:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 16 pid: 20361 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.876948:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7257 00000100:00100000:2.0:1746066757.876953:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983276160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.876962:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.876974:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 16 pid: 20361 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.876982:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 16 pid: 20361 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.876997:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa75a1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1af4 expref: 16 pid: 20361 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.877008:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.877028:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882983276160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.877036:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7257 00000100:00100000:2.0:1746066757.877716:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ced880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984476288:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.877741:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [761856->1048575] (req 761856->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 14 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.877750:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d800, rc 0) 00000100:00100000:2.0:1746066757.877775:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:741:x1830882983275392:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13287us (13490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.877781:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16118 00000100:00100000:1.0:1746066757.878135:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+34:2014:x1830882983275904:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 9993us (10386us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066757.878142:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4317 00002000:00100000:1.0:1746066757.878150:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096e6b480 x1830882983275904/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.878158:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096e6b480 with x1830882983275904 ext(1048576->2097151) 00002000:00010000:1.0:1746066757.878161:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096e6b480 00000100:00100000:0.0:1746066757.878170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.878193:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983276288 00000100:00100000:1.0:1746066757.878196:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983276288 00010000:00010000:1.0:1746066757.878208:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 15 pid: 12233 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746066757.878233:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7258 00000100:00100000:1.0:1746066757.878549:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983276288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.878557:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066757.878567:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 15 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066757.878575:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 15 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066757.878589:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800960f2a00/0xf1867c21abfa74c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aa7 expref: 15 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066757.878681:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.878683:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.878689:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.878695:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.878720:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 13 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.878729:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984476416:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066757.879063:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.879254:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.879292:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983276416 00000100:00100000:2.0:1746066757.879295:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983276416 00000100:00100000:2.0:1746066757.879311:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16119 00000100:00100000:2.0:1746066757.879316:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+22:746:x1830882983276416:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.879326:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.879334:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b41 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.879346:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.879347:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.879351:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.879358:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 23 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.879365:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a600, rc 0) 00000100:00100000:2.0:1746066757.879381:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+23:746:x1830882983276416:12345-192.168.204.16@tcp:101:cat.0 Request processed in 65us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.879385:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16119 00000100:00100000:0.0:1746066757.880160:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.880230:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984476416:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.880264:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983276544 00000100:00100000:2.0:1746066757.880268:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983276544 00010000:00010000:1.0:1746066757.880392:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066757.880428:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983276288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1879us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.880435:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7258 00000100:00100000:2.0:1746066757.880491:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16120 00000100:00100000:2.0:1746066757.880497:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+48:742:x1830882983276544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066757.880505:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.880519:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b48 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.880535:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.880542:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 49 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.880547:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.880548:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.880551:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1413120->1966079] (req 1413120->1966079) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 49 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.880569:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 49 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.880578:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 49 pid: 12233 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.880596:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984476544:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.880863:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 12 pid: 13363 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.880871:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 12 pid: 13363 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066757.880879:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984476672:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.881157:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.883603:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984476544:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.883615:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984476672:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.883648:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1413120->1966079] (req 1413120->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 49 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.883665:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a000, rc 0) 00000100:00100000:2.0:1746066757.883704:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+49:742:x1830882983276544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3207us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.883711:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16120 00000100:00100000:0.0:1746066757.884035:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.884072:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.884090:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983276928 00000100:00100000:1.0:1746066757.884099:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983276928 00002000:00100000:1.0:1746066757.884135:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (761856->765951) req@ffff8800a03d5c00 x1830882983276928/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.884144:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882983276928 ext(761856->765951) 00002000:00010000:1.0:1746066757.884148:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:2.0:1746066757.884161:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983276800 00000100:00100000:2.0:1746066757.884166:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983276800 00000100:00100000:1.0:1746066757.884179:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4318 00000100:00100000:1.0:1746066757.884186:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983276928:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:2.0:1746066757.884187:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 13 pid: 13363 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066757.884234:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7259 00000100:00100000:2.0:1746066757.884241:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983276800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.884253:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.884271:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 13 pid: 13363 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746066757.884280:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 13 pid: 13363 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746066757.884291:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+14:2015:x1830882983276928:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 105us (257us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066757.884296:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4318 00002000:00100000:1.0:1746066757.884301:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (761856->765951) req@ffff8800a03d5c00 x1830882983276928/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746066757.884302:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009629a200/0xf1867c21abfa74d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ab5 expref: 13 pid: 13363 timeout: 826 lvb_type: 1 00002000:00100000:1.0:1746066757.884312:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5c00 with x1830882983276928 ext(761856->765951) 00010000:00010000:2.0:1746066757.884314:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746066757.884315:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5c00 00000100:00100000:2.0:1746066757.884336:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983276800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.884342:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7259 00000100:00100000:0.0:1746066757.884987:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.885003:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983277056 00000100:00100000:2.0:1746066757.885007:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983277056 00010000:00010000:2.0:1746066757.885021:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 49 pid: 12233 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.885046:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7260 00000100:00100000:2.0:1746066757.885052:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882983277056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.885059:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.885068:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 49 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.885081:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 49 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.885094:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa75e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b25 expref: 49 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.885105:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.885107:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.885113:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.885121:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.885149:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 48 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.885165:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984476800:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.885236:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.890056:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.890163:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983277312 00000100:00100000:2.0:1746066757.890171:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983277312 00000100:00100000:2.0:1746066757.890211:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16121 00000100:00100000:2.0:1746066757.890219:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+34:741:x1830882983277312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066757.890234:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066757.890245:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984476800:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.890248:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b56 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.890262:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066757.890309:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882983277056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5256us (5321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.890318:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7260 00010000:00010000:2.0:1746066757.890333:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.890342:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.890348:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 47 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.890357:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.890358:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.890361:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1220607] (req 1048576->1220607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.890384:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 47 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.890394:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 47 pid: 12233 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.890404:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984476928:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.890476:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 35 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.890484:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 35 pid: 12233 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.890492:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984477056:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066757.890680:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.890688:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 11 pid: 9591 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066757.890696:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984477184:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.890724:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.892860:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.892938:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983277824 00000100:00100000:3.0:1746066757.892946:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983277824 00002000:00100000:3.0:1746066757.892985:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a03d5500 x1830882983277824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.892994:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5500 with x1830882983277824 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.892998:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5500 00000100:00100000:3.0:1746066757.893017:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4319 00000100:00100000:3.0:1746066757.893024:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983277824:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066757.893831:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.894133:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984476928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.894145:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984477056:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066757.894155:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984477184:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.894165:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.894186:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066757.894192:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1220607] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 35 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.894217:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.894238:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983277952 00000100:00100000:0.0:1746066757.894241:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983277184 00000100:00100000:1.0:1746066757.894242:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983277952 00000100:00100000:0.0:1746066757.894246:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983277184 00010000:00010000:1.0:1746066757.894263:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 48 pid: 12233 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066757.894293:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983278080 00000100:00100000:1.0:1746066757.894296:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983278080 00010000:00010000:1.0:1746066757.894305:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 12 pid: 9591 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746066757.894320:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7261 00000100:00100000:1.0:1746066757.894326:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+48:2016:x1830882983277952:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.894334:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.894432:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576be00, rc 0) 00010000:00010000:1.0:1746066757.894440:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 48 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066757.894450:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 48 pid: 12233 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.894469:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16122 00000100:00100000:0.0:1746066757.894472:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7262 00000100:00100000:2.0:1746066757.894477:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+36:745:x1830882983277184:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066757.894480:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2016:x1830882983278080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066757.894481:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098faf400/0xf1867c21abfa75c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b09 expref: 48 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.894487:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.894493:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066757.894497:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066757.894498:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b4f expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.894508:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 12 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:0.0:1746066757.894518:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 12 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746066757.894521:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.894528:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066757.894529:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746066757.894529:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2016:x1830882983277952:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 202us (341us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066757.894533:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 37 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.894536:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7261 00010000:00010000:0.0:1746066757.894536:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155c000/0xf1867c21abfa74cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aae expref: 12 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746066757.894553:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 46 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.894554:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066757.894581:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983278080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 103us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.894588:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7262 00000100:00100000:0.0:1746066757.894615:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983277696 00000100:00100000:0.0:1746066757.894618:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983277696 00002000:00100000:0.0:1746066757.894639:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1413120->1417215) req@ffff88009c7fea00 x1830882983277696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.894648:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fea00 with x1830882983277696 ext(1413120->1417215) 00010000:00010000:0.0:1746066757.894653:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.894659:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.894662:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746066757.894668:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fea00 00000100:00100000:2.0:1746066757.894669:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984477312:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066757.894692:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 966 00000100:00100000:0.0:1746066757.894697:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882983277696:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066757.894714:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.894732:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+37:741:x1830882983277312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 4514us (4683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.894738:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16121 00000100:00100000:0.0:1746066757.894789:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882983277696:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 90us (959us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066757.894794:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 966 00002000:00100000:0.0:1746066757.894799:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1413120->1417215) req@ffff88009c7fea00 x1830882983277696/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.894806:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fea00 with x1830882983277696 ext(1413120->1417215) 00010000:00010000:0.0:1746066757.894810:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.894818:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746066757.894823:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fea00 00000100:00100000:0.0:1746066757.895973:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.896058:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983278208 00000100:00100000:2.0:1746066757.896062:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983278208 00010000:00010000:2.0:1746066757.896083:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 37 pid: 12233 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066757.896101:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7263 00000100:00100000:2.0:1746066757.896107:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+37:2015:x1830882983278208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066757.896115:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066757.896126:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 37 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.896134:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 37 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.896150:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acda6200/0xf1867c21abfa75d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b17 expref: 37 pid: 12233 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.896162:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.896164:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066757.896170:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.896178:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066757.896206:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.896216:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984477440:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066757.896279:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.900714:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984477440:192.168.204.16@tcp:105: 00010000:00010000:0.0:1746066757.900740:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.900768:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.900793:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983278208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4684us (4820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.900805:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7263 00000100:00100000:3.0:1746066757.900928:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984477312:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066757.900977:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983278464 00000100:00100000:1.0:1746066757.900982:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983278464 00002000:00100000:1.0:1746066757.901014:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1216512->1220607) req@ffff8800958a4e00 x1830882983278464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.901023:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4e00 with x1830882983278464 ext(1216512->1220607) 00002000:00010000:1.0:1746066757.901028:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4e00 00000100:00100000:1.0:1746066757.901051:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4320 00000100:00100000:1.0:1746066757.901058:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+36:2016:x1830882983278464:12345-192.168.204.16@tcp:3:multiop.0 00010000:00010000:3.0:1746066757.901120:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 36 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066757.901134:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2de00, rc 0) 00000100:00100000:3.0:1746066757.901306:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+36:745:x1830882983277184:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6829us (7142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066757.901313:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16122 00000100:00100000:3.0:1746066757.901414:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983277824:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8390us (8562us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066757.901420:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4319 00002000:00100000:3.0:1746066757.901427:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a03d5500 x1830882983277824/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.901433:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d5500 with x1830882983277824 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.901437:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d5500 00000100:00100000:1.0:1746066757.901519:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+35:2016:x1830882983278464:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 460us (757us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066757.901526:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4320 00002000:00100000:1.0:1746066757.901532:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1216512->1220607) req@ffff8800958a4e00 x1830882983278464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.901540:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4e00 with x1830882983278464 ext(1216512->1220607) 00002000:00010000:1.0:1746066757.901543:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4e00 00000100:00100000:0.0:1746066757.904170:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.904262:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983278720 00000100:00100000:1.0:1746066757.904271:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983278720 00002000:00100000:1.0:1746066757.904301:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1961984->1966079) req@ffff8800a03d4a80 x1830882983278720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.904312:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882983278720 ext(1961984->1966079) 00010000:00010000:1.0:1746066757.904319:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066757.904329:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746066757.904333:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d4a80 00000100:00100000:1.0:1746066757.904873:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 967 00000100:00100000:1.0:1746066757.904968:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882983278720:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066757.905102:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+47:2014:x1830882983278720:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 221us (941us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066757.905109:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 967 00002000:00100000:1.0:1746066757.905114:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1961984->1966079) req@ffff8800a03d4a80 x1830882983278720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/4536 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.905121:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4a80 with x1830882983278720 ext(1961984->1966079) 00010000:00010000:1.0:1746066757.905126:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066757.905135:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 47 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746066757.905141:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d4a80 00000100:00100000:0.0:1746066757.907235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.907265:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.907293:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.907751:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983278848 00000100:00100000:3.0:1746066757.907759:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983278848 00000100:00100000:1.0:1746066757.907759:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983278976 00000100:00100000:1.0:1746066757.907764:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983278976 00000100:00100000:3.0:1746066757.907795:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983279104 00000100:00100000:3.0:1746066757.907797:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983279104 00000100:00100000:1.0:1746066757.907805:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16123 00000100:00100000:1.0:1746066757.907813:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882983278848:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066757.907816:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.907818:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16124 00000100:00100000:3.0:1746066757.907823:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+47:2013:x1830882983278976:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.907826:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.907831:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.907842:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c184a00/0xf1867c21abfa761f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b64 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.907845:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983279232 00000100:00100000:1.0:1746066757.907848:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983279232 00000100:00100000:0.0:1746066757.907866:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16125 00000100:00100000:0.0:1746066757.907878:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882983279104:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066757.907910:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984477568:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066757.907918:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.907931:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b6b expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.907937:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16126 00000100:00100000:1.0:1746066757.907943:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+49:2013:x1830882983279232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.907949:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066757.907951:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.907953:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.907957:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b72 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.907963:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066757.907967:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746066757.907968:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.907970:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.907978:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 50 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.907978:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 25 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.907989:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32200, rc 0) 00010000:00010000:1.0:1746066757.907991:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 50 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.907999:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece000, rc 0) 00000100:00100000:1.0:1746066757.908021:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983279232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.908021:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882983279104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 146us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.908027:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16125 00000100:00100000:1.0:1746066757.908034:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16126 00010000:00010000:1.0:1746066757.908054:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa7634 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b5d expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.908080:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984477696:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066757.908101:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.909612:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.909687:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983279744 00000100:00100000:0.0:1746066757.909687:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.909696:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983279744 00000100:00100000:3.0:1746066757.909733:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5953 00000100:00100000:3.0:1746066757.909740:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:742:x1830882983279744:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066757.909744:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983279616 00000100:00100000:2.0:1746066757.909749:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983279616 00002000:00100000:2.0:1746066757.909771:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1413120->1966079) req@ffff8800a03d6300 x1830882983279616/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.909780:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6300 with x1830882983279616 ext(1413120->1966079) 00010000:00010000:2.0:1746066757.909787:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 50 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066757.909799:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 50 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066757.909806:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d6300 00000100:00100000:2.0:1746066757.909820:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 968 00000100:00100000:2.0:1746066757.909825:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2014:x1830882983279616:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066757.909920:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:742:x1830882983279744:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 179us (312us total) trans 8589936644 rc 0/0 00000100:00100000:3.0:1746066757.909926:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5953 00000100:00100000:1.0:1746066757.910589:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984477696:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066757.910612:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa7634 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b5d expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.910623:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfe00/0xf1867c21abfa7634 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b5d expref: 25 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066757.910624:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984477568:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066757.910636:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfe00, rc 0) 00010000:00010000:3.0:1746066757.910651:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c184a00/0xf1867c21abfa761f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b64 expref: 51 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066757.910661:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882983278848:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2849us (3432us total) trans 0 rc 301/301 00010000:00010000:3.0:1746066757.910663:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c184a00/0xf1867c21abfa761f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b64 expref: 51 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066757.910667:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16123 00010000:00010000:3.0:1746066757.910678:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c184a00, rc 0) 00000100:00100000:3.0:1746066757.910710:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983278976:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2885us (3443us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066757.910717:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16124 00000100:00100000:3.0:1746066757.918865:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2014:x1830882983279616:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 9031us (9169us total) trans 17179874450 rc 0/0 00000100:00100000:3.0:1746066757.918876:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 968 00002000:00100000:3.0:1746066757.918918:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1413120->1966079) req@ffff8800a03d6300 x1830882983279616/t17179874450(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/448 e 0 to 0 dl 1746066768 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.918926:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6300 with x1830882983279616 ext(1413120->1966079) 00010000:00010000:3.0:1746066757.918936:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 50 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066757.918949:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 50 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746066757.918956:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a03d6300 00000100:00100000:0.0:1746066757.920146:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.920244:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983280000 00000100:00100000:3.0:1746066757.920253:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983280000 00002000:00100000:3.0:1746066757.920296:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800a03d4700 x1830882983280000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.920306:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882983280000 ext(2097152->4194303) 00002000:00010000:3.0:1746066757.920311:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:0.0:1746066757.920584:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.921141:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983280256 00000100:00100000:3.0:1746066757.921145:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983280256 00002000:00100000:3.0:1746066757.921165:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a03d6d80 x1830882983280256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.921173:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882983280256 ext(2097152->4194303) 00002000:00010000:3.0:1746066757.921177:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6d80 00000100:00100000:1.0:1746066757.921199:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4321 00000100:00100000:3.0:1746066757.921282:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4322 00000100:00100000:3.0:1746066757.921290:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2014:x1830882983280256:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066757.921307:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983280000:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066757.922008:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.922027:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983280384 00000100:00100000:0.0:1746066757.922031:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983280384 00010000:00010000:0.0:1746066757.922053:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 52 pid: 3528 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746066757.922073:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7264 00000100:00100000:0.0:1746066757.922078:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882983280384:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066757.922088:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066757.922330:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 52 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.922343:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 52 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.922609:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa760a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1966079) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b48 expref: 52 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066757.922639:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.922641:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066757.922648:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 34 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.922656:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 34 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066757.922688:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 34 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.922703:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984477824:192.168.204.16@tcp:105: 00000100:00100000:0.0:1746066757.922773:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066757.928001:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984477824:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066757.928033:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066757.928132:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882983280384:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6042us (6114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066757.928143:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7264 00000100:00100000:0.0:1746066757.932500:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.933552:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983280640 00000100:00100000:3.0:1746066757.933563:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983280640 00002000:00100000:3.0:1746066757.933612:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012faf1f80 x1830882983280640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.933621:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1f80 with x1830882983280640 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.933626:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1f80 00000100:00100000:3.0:1746066757.934374:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4323 00000100:00100000:3.0:1746066757.934384:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882983280640:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066757.937800:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983280000:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16583us (17653us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066757.937811:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4321 00002000:00100000:1.0:1746066757.937821:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800a03d4700 x1830882983280000/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066757.937830:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d4700 with x1830882983280000 ext(2097152->4194303) 00002000:00010000:1.0:1746066757.937836:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a03d4700 00000100:00100000:3.0:1746066757.951416:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+49:2014:x1830882983280256:12345-192.168.204.16@tcp:3:cat.0 Request processed in 30113us (30818us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066757.951430:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4322 00002000:00100000:3.0:1746066757.951444:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a03d6d80 x1830882983280256/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.951462:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a03d6d80 with x1830882983280256 ext(2097152->4194303) 00002000:00010000:3.0:1746066757.951469:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a03d6d80 00000100:00100000:3.0:1746066757.953279:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882983280640:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 18891us (20785us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066757.953290:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4323 00002000:00100000:3.0:1746066757.953299:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012faf1f80 x1830882983280640/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.953307:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1f80 with x1830882983280640 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.953313:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf1f80 00000100:00100000:0.0:1746066757.956529:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.956777:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983280768 00000100:00100000:0.0:1746066757.956777:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.956787:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983280768 00000100:00100000:0.0:1746066757.956804:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.956844:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.956932:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983280896 00000100:00100000:1.0:1746066757.956934:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983281152 00000100:00100000:1.0:1746066757.956939:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983281152 00000100:00100000:2.0:1746066757.956945:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983280896 00000100:00100000:3.0:1746066757.956946:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983281024 00000100:00100000:3.0:1746066757.956950:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983281024 00000100:00100000:1.0:1746066757.956967:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16127 00000100:00100000:1.0:1746066757.956976:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+14:745:x1830882983280768:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.956998:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.957016:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b79 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.957043:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.957045:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.957053:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.957067:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 15 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.957077:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800964b1e00, rc 0) 00000100:00100000:3.0:1746066757.957097:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16128 00000100:00100000:3.0:1746066757.957104:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882983281152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.957113:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.957124:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b8e expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.957125:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:745:x1830882983280768:12345-192.168.204.16@tcp:101:cat.0 Request processed in 152us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.957132:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16127 00010000:00010000:3.0:1746066757.957138:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.957139:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066757.957145:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 51 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066757.957152:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16129 00000100:00100000:1.0:1746066757.957157:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882983281024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066757.957159:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 51 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.957162:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066757.957167:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c185800, rc 0) 00010000:00010000:1.0:1746066757.957170:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfa7649 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b87 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066757.957184:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882983281152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 81us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066757.957185:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16130 00000100:00100000:3.0:1746066757.957189:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16128 00000100:00100000:0.0:1746066757.957193:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983280896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066757.957201:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746066757.957206:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984477952:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066757.957209:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36200/0xf1867c21abfa7650 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b80 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066757.957234:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984478080:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066757.957283:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.957286:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.959481:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984477952:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066757.959514:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfa7649 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b87 expref: 51 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.959529:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f800/0xf1867c21abfa7649 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b87 expref: 51 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.959552:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00000100:00100000:1.0:1746066757.959590:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882983281024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2431us (2744us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066757.959597:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16129 00000100:00100000:2.0:1746066757.959608:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984478080:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066757.959627:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36200/0xf1867c21abfa7650 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b80 expref: 25 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.959636:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36200/0xf1867c21abfa7650 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b80 expref: 25 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.959652:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36200, rc 0) 00000100:00100000:2.0:1746066757.959671:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983280896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2479us (2894us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066757.959676:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16130 00000100:00100000:0.0:1746066757.961911:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066757.962091:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983281408 00000100:00100000:3.0:1746066757.962099:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983281408 00002000:00100000:3.0:1746066757.962144:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012faf1880 x1830882983281408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.962154:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1880 with x1830882983281408 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.962159:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf1880 00000100:00100000:3.0:1746066757.962183:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4324 00000100:00100000:3.0:1746066757.962190:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983281408:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066757.963751:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.963810:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983281664 00000100:00100000:0.0:1746066757.963818:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983281664 00002000:00100000:0.0:1746066757.963850:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958a4380 x1830882983281664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066757.963859:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4380 with x1830882983281664 ext(4194304->5033983) 00002000:00010000:0.0:1746066757.963863:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4380 00000100:00100000:0.0:1746066757.963911:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4325 00000100:00100000:0.0:1746066757.963919:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983281664:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066757.970628:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983281408:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 8424us (8739us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066757.970640:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4324 00002000:00100000:3.0:1746066757.970653:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012faf1880 x1830882983281408/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066757.970661:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf1880 with x1830882983281408 ext(1048576->2097151) 00002000:00010000:3.0:1746066757.970668:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf1880 00000100:00100000:2.0:1746066757.973584:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983281664:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9656us (9830us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066757.973596:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4325 00002000:00100000:2.0:1746066757.973607:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800958a4380 x1830882983281664/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.973616:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4380 with x1830882983281664 ext(4194304->5033983) 00002000:00010000:2.0:1746066757.973622:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958a4380 00000100:00100000:1.0:1746066757.977365:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.977403:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.977428:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.977472:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983281792 00000100:00100000:1.0:1746066757.977482:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983281792 00000100:00100000:1.0:1746066757.977533:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983282048 00000100:00100000:1.0:1746066757.977535:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983282048 00000100:00100000:1.0:1746066757.977546:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983281920 00000100:00100000:1.0:1746066757.977548:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983281920 00000100:00100000:1.0:1746066757.977561:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16131 00000100:00100000:1.0:1746066757.977569:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882983281792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.977589:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.977606:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa7657 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b9c expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.977659:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984478208:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066757.977739:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.977782:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.977852:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983282176 00000100:00100000:1.0:1746066757.977856:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983282176 00000100:00100000:1.0:1746066757.977875:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16132 00000100:00100000:1.0:1746066757.977880:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983282048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.977911:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.977923:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa765e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1baa expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066757.977949:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984478336:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066757.977984:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.977998:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16133 00000100:00100000:1.0:1746066757.978003:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+15:2015:x1830882983281920:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.978010:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.978017:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1b95 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.978029:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.978031:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.978040:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.978054:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.978065:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575be00, rc 0) 00000100:00100000:1.0:1746066757.978085:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983281920:12345-192.168.204.16@tcp:101:cat.0 Request processed in 82us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.978091:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16133 00000100:00100000:1.0:1746066757.978108:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16134 00000100:00100000:1.0:1746066757.978113:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882983282176:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066757.978119:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.978124:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ba3 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.978136:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.978137:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066757.978142:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.978150:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 36 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.978157:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575b600, rc 0) 00000100:00100000:1.0:1746066757.978170:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983282176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 57us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066757.978175:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16134 00000100:00100000:1.0:1746066757.980274:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984478208:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066757.980285:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984478336:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066757.980307:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa7657 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b9c expref: 25 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.980312:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa765e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1baa expref: 51 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.980320:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096e0bc00/0xf1867c21abfa7657 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b9c expref: 25 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.980324:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa765e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1baa expref: 51 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066757.980574:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cf7800, rc 0) 00000100:00100000:2.0:1746066757.980633:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983282048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2751us (3228us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066757.980641:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16132 00010000:00010000:1.0:1746066757.980711:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096e0bc00, rc 0) 00000100:00100000:1.0:1746066757.980733:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882983281792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3165us (3379us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066757.980739:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16131 00000100:00100000:0.0:1746066757.982653:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.982827:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.982920:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983282304 00000100:00100000:2.0:1746066757.982924:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983282432 00000100:00100000:1.0:1746066757.982929:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983282304 00000100:00100000:2.0:1746066757.982935:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983282432 00000100:00100000:1.0:1746066757.982970:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16135 00000100:00100000:1.0:1746066757.982977:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983282304:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066757.982989:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16136 00000100:00100000:2.0:1746066757.982998:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+50:2014:x1830882983282432:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066757.983012:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066757.983031:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7673 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bb8 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066757.983062:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066757.983075:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa767a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bb1 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066757.983079:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984478464:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066757.983112:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984478592:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066757.983165:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066757.983218:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066757.986769:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066757.986799:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066757.987033:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983282688 00000100:00100000:2.0:1746066757.987046:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983282688 00000100:00100000:3.0:1746066757.987056:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983282944 00000100:00100000:3.0:1746066757.987063:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983282944 00002000:00100000:3.0:1746066757.987092:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012faf3b80 x1830882983282944/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066757.987094:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012faf0700 x1830882983282688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/0 e 0 to 0 dl 1746066768 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746066757.987101:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746066758 -> 1746066759 00002000:00100000:3.0:1746066757.987102:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3b80 with x1830882983282944 ext(2097152->4194303) 00002000:00100000:2.0:1746066757.987104:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0700 with x1830882983282688 ext(2097152->4194303) 00002000:00010000:3.0:1746066757.987107:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf3b80 00002000:00010000:2.0:1746066757.987109:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf0700 00000100:00100000:1.0:1746066757.987117:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984478464:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066757.987126:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4326 00000100:00100000:3.0:1746066757.987131:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983282944:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066757.987137:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4327 00000100:00100000:2.0:1746066757.987144:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983282688:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066757.987145:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7673 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bb8 expref: 51 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.987154:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7673 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bb8 expref: 51 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066757.987169:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496600, rc 0) 00000100:00100000:1.0:1746066757.987204:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+50:2014:x1830882983282432:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4209us (4378us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066757.987209:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16136 00002000:00010000:0.0:1746066757.987670:0:9591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746066758 -> 1746066759 00000100:00100000:0.0:1746066757.987681:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984478592:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066757.987700:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa767a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bb1 expref: 25 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.987709:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575a200/0xf1867c21abfa767a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bb1 expref: 25 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066757.987725:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009575a200, rc 0) 00000100:00100000:0.0:1746066757.987748:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983282304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4772us (5102us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066757.987754:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16135 00000100:00100000:0.0:1746066757.996338:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066757.997066:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983283200 00000100:00100000:1.0:1746066757.997074:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983283200 00000100:00100000:1.0:1746066757.997375:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5954 00000100:00100000:1.0:1746066757.997383:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:746:x1830882983283200:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066757.997579:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:746:x1830882983283200:12345-192.168.204.16@tcp:35:cat.0 Request processed in 196us (1247us total) trans 8589936645 rc 0/0 00000100:00100000:1.0:1746066757.997585:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5954 00000100:00100000:2.0:1746066758.002238:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983282688:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15086us (15468us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066758.002247:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4327 00002000:00100000:2.0:1746066758.002257:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012faf0700 x1830882983282688/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.002265:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0700 with x1830882983282688 ext(2097152->4194303) 00002000:00010000:2.0:1746066758.002270:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf0700 00000100:00100000:3.0:1746066758.011027:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983282944:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23886us (24218us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066758.011038:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4326 00002000:00100000:3.0:1746066758.011049:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff88012faf3b80 x1830882983282944/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:163/0 lens 488/440 e 0 to 0 dl 1746066768 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.011057:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3b80 with x1830882983282944 ext(2097152->4194303) 00002000:00010000:3.0:1746066758.011062:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012faf3b80 00000100:00100000:0.0:1746066758.024070:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.024244:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983283456 00000100:00100000:3.0:1746066758.024251:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983283456 00002000:00100000:3.0:1746066758.024285:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf0e00 x1830882983283456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.024292:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0e00 with x1830882983283456 ext(4194304->5033983) 00002000:00010000:3.0:1746066758.024295:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf0e00 00000100:00100000:3.0:1746066758.024493:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4328 00000100:00100000:3.0:1746066758.024500:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983283456:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.026721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.026821:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983283712 00000100:00100000:1.0:1746066758.026828:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983283712 00000100:00100000:1.0:1746066758.026878:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16314 00000100:00100000:1.0:1746066758.026905:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+30:753:x1830882983283712:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.026999:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1746066758.027002:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746066758.027015:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa7681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bbf expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.027076:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027086:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027094:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027105:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027109:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027113:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027198:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfa7696 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027206:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfa7696 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027212:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfa7696 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066758.027218:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066758.027271:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027277:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027281:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027285:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027290:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5728a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.027292:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027298:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027306:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066758.027308:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.027311:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027319:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728a00/0xf1867c21abfa7688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027345:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027350:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027355:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027359:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5728e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.027362:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027365:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027371:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20700) 00010000:00010000:1.0:1746066758.027372:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.027374:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027378:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa768f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.027406:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa7681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bbf expref: 33 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.027415:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfa7696 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bbf expref: 32 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.027424:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.027426:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066758.027428:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728c00, rc 0) 00000100:00100000:1.0:1746066758.027486:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+32:753:x1830882983283712:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 582us (770us total) trans 8589936646 rc 0/0 00000100:00100000:1.0:1746066758.027492:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16314 00000100:00100000:3.0:1746066758.028561:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983283456:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4058us (4495us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066758.028569:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4328 00002000:00100000:3.0:1746066758.028576:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012faf0e00 x1830882983283456/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.028585:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf0e00 with x1830882983283456 ext(4194304->5033983) 00002000:00010000:3.0:1746066758.028589:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf0e00 00000100:00100000:0.0:1746066758.034786:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.035735:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983283968 00000100:00100000:1.0:1746066758.035743:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983283968 00000100:00100000:1.0:1746066758.035805:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16315 00000100:00100000:1.0:1746066758.035812:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:754:x1830882983283968:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.035834:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.035849:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa76a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bc6 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746066758.035850:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746066758.035925:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.035937:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.035947:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.035959:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.035965:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.035974:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036052:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa76b9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036061:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa76b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036066:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa76b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:1.0:1746066758.036074:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066758.036131:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036137:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036142:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036148:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036154:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5729e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.036157:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036163:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036172:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066758.036175:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.036179:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036184:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729e00/0xf1867c21abfa76ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036205:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036210:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036215:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036219:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5729a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.036222:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036226:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036233:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20a00) 00010000:00010000:1.0:1746066758.036235:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.036237:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036242:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729a00/0xf1867c21abfa76b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.036270:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa76a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bc6 expref: 13 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.036281:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa76b9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bc6 expref: 12 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.036287:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.036290:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066758.036292:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5728e00, rc 0) 00000100:00100000:1.0:1746066758.036344:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+12:754:x1830882983283968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 532us (1564us total) trans 8589936647 rc 0/0 00000100:00100000:1.0:1746066758.036350:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16315 00000100:00100000:0.0:1746066758.037982:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.038320:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983284224 00000100:00100000:3.0:1746066758.038325:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983284224 00000100:00100000:3.0:1746066758.038369:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5955 00000100:00100000:3.0:1746066758.038376:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+12:754:x1830882983284224:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066758.039120:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:754:x1830882983284224:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 742us (1140us total) trans 8589936648 rc 0/0 00000100:00100000:3.0:1746066758.039128:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5955 00000100:00100000:3.0:1746066758.060261:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746066758.060280:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984478720:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1746066758.060336:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066758.060435:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984478720 00000100:00100000:2.0:1746066758.060445:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984478720 00000100:00100000:2.0:1746066758.060495:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1746066758.060502:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984478720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746066758.060526:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 311296 granted 1083603392 pending 2289664 free 3906408448 avail 3674886144 00000100:00100000:2.0:1746066758.060560:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984478720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.060566:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00080000:2.0:1746066758.060789:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746066758.063301:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984478720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746066758.065580:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.065613:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983284352 00000100:00100000:0.0:1746066758.065621:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983284352 00000100:00100000:0.0:1746066758.065666:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16137 00000100:00100000:0.0:1746066758.065674:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:753:x1830882983284352:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066758.065694:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066758.065713:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bcd expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.065744:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.065752:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 35 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.065758:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 51 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.065764:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066758.065767:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066758.065769:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2289664->2809855] (req 2289664->2809855) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.065802:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 51 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.065813:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 51 pid: 9591 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746066758.065826:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984478848:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066758.065954:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 35 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.065967:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 35 pid: 12233 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746066758.065975:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984478976:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066758.065999:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.066007:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 10 pid: 12255 timeout: 826 lvb_type: 1 00000100:00100000:0.0:1746066758.066014:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984479104:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066758.066029:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.067681:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984478848:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.067693:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984478976:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.067700:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984479104:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.067726:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2289664->2809855] (req 2289664->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.067743:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71a00, rc 0) 00000100:00100000:2.0:1746066758.067789:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+51:753:x1830882983284352:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2115us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.067797:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16137 00000100:00100000:0.0:1746066758.069801:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.069840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.069902:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983284608 00000100:00100000:2.0:1746066758.069912:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983284608 00000100:00100000:0.0:1746066758.069945:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066758.069964:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 11 pid: 12255 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066758.069989:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983284480 00000100:00100000:2.0:1746066758.069992:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983284480 00010000:00010000:2.0:1746066758.070002:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 36 pid: 12233 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066758.070013:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983284736 00000100:00100000:2.0:1746066758.070015:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983284736 00010000:00010000:2.0:1746066758.070024:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 51 pid: 9591 timeout: 826 lvb_type: 1 00000100:00080000:3.0:1746066758.070035:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066758.070088:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7265 00000100:00100000:2.0:1746066758.070096:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7266 00000100:00100000:1.0:1746066758.070099:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2016:x1830882983284608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066758.070103:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983284480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066758.070110:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7267 00010000:00010000:2.0:1746066758.070114:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.070114:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066758.070126:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+51:2013:x1830882983284736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.070133:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 36 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.070134:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 11 pid: 12255 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746066758.070142:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.070144:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 36 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.070152:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 11 pid: 12255 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746066758.070175:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009575b600/0xf1867c21abfa766c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ba3 expref: 36 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746066758.070178:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 51 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.070182:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155d800/0xf1867c21abfa74e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1aca expref: 11 pid: 12255 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746066758.070192:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 51 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:2.0:1746066758.070203:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066758.070216:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ece000/0xf1867c21abfa762d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b72 expref: 51 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.070216:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.070218:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.070226:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 50 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.070234:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 50 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.070240:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+35:2015:x1830882983284480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 137us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.070246:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7266 00010000:00010000:3.0:1746066758.070248:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066758.070271:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 50 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.070283:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984479232:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066758.070289:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983284736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 170us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.070296:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7267 00000100:00100000:1.0:1746066758.070335:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.073196:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.073242:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984479232:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.073261:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066758.073462:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983284992 00000100:00100000:3.0:1746066758.073467:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983284992 00002000:00100000:3.0:1746066758.073507:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2289664->2293759) req@ffff8800958a4700 x1830882983284992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.073518:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882983284992 ext(2289664->2293759) 00002000:00010000:3.0:1746066758.073523:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4700 00000100:00100000:3.0:1746066758.073545:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4329 00000100:00100000:3.0:1746066758.073553:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882983284992:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066758.074053:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2016:x1830882983284608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3955us (4258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.074062:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7265 00000100:00100000:3.0:1746066758.074146:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882983284992:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 593us (955us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066758.074152:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4329 00002000:00100000:3.0:1746066758.074158:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2289664->2293759) req@ffff8800958a4700 x1830882983284992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.074165:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958a4700 with x1830882983284992 ext(2289664->2293759) 00002000:00010000:3.0:1746066758.074168:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800958a4700 00000100:00100000:0.0:1746066758.080228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.080358:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983285248 00000100:00100000:3.0:1746066758.080367:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983285248 00002000:00100000:3.0:1746066758.080421:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2805760->2809855) req@ffff88009d8c8380 x1830882983285248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.080432:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8380 with x1830882983285248 ext(2805760->2809855) 00002000:00010000:3.0:1746066758.080438:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c8380 00000100:00100000:3.0:1746066758.080483:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4330 00000100:00100000:3.0:1746066758.080490:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983285248:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066758.080646:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983285248:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 155us (429us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066758.080652:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4330 00002000:00100000:3.0:1746066758.080658:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2805760->2809855) req@ffff88009d8c8380 x1830882983285248/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.080664:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8380 with x1830882983285248 ext(2805760->2809855) 00002000:00010000:3.0:1746066758.080667:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d8c8380 00000100:00100000:0.0:1746066758.089564:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.089957:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983285504 00000100:00100000:3.0:1746066758.089969:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983285504 00000100:00100000:3.0:1746066758.090107:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5956 00000100:00100000:3.0:1746066758.090116:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+32:753:x1830882983285504:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066758.091008:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:753:x1830882983285504:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 892us (1454us total) trans 8589936649 rc 0/0 00000100:00100000:3.0:1746066758.091016:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5956 00000100:00100000:0.0:1746066758.129011:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.129790:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.129816:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983285888 00000100:00100000:0.0:1746066758.129824:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983285888 00000100:00100000:0.0:1746066758.129874:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16316 00000100:00100000:0.0:1746066758.129907:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+33:759:x1830882983285888:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.129956:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.129980:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728000/0xf1867c21abfa76ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bdb expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.130009:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983285632 00000100:00100000:2.0:1746066758.130014:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983285632 00000100:00100000:2.0:1746066758.130039:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16138 00000100:00100000:2.0:1746066758.130044:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+16:754:x1830882983285632:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066758.130056:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.130061:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.130072:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bd4 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.130074:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130084:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130097:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.130098:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.130102:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.130105:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.130111:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.130113:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 23 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.130118:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.130120:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.130123:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2224128->2981887] (req 2224128->2981887) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.130151:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 23 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.130163:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 23 pid: 1893 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066758.130175:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984479360:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.130206:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa76ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130214:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa76ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130220:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa76ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.130262:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 17 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.130271:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 17 pid: 12233 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066758.130279:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984479488:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.130305:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 13 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.130313:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 13 pid: 20361 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066758.130320:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984479616:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.130340:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00000004:00200000:1.0:1746066758.130668:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066758.130743:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130749:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130755:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130760:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130766:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5728600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.130769:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130775:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130786:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066758.130789:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.130792:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130797:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728600/0xf1867c21abfa76d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130831:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130837:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130841:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130844:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5728800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.130847:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130851:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130857:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20000) 00010000:00010000:1.0:1746066758.130858:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.130860:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.130865:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728800/0xf1867c21abfa76e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.131071:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728000/0xf1867c21abfa76ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bdb expref: 36 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.131088:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa76ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bdb expref: 35 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.131093:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.131095:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066758.131098:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5729c00, rc 0) 00000100:00100000:1.0:1746066758.131149:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:759:x1830882983285888:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1266us (1359us total) trans 8589936650 rc 0/0 00000100:00100000:1.0:1746066758.131156:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16316 00000100:00100000:2.0:1746066758.133116:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984479360:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.133130:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984479488:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.133138:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984479616:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.133175:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2224128->2981887] (req 2224128->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066758.133265:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066758.133350:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497400, rc 0) 00000100:00100000:1.0:1746066758.133351:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286016 00000100:00100000:1.0:1746066758.133358:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286016 00000100:00100000:1.0:1746066758.133393:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16139 00000100:00100000:1.0:1746066758.133401:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983286016:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.133415:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066758.133526:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+17:754:x1830882983285632:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3479us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.133536:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16138 00010000:00010000:1.0:1746066758.133598:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa76f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1be2 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.133645:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984479744:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066758.133711:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.134715:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.134753:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.134783:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286144 00000100:00100000:2.0:1746066758.134788:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286144 00000100:00100000:2.0:1746066758.134812:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16140 00000100:00100000:1.0:1746066758.134813:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286272 00000100:00100000:1.0:1746066758.134817:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286272 00000100:00100000:2.0:1746066758.134819:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983286144:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.134828:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.134838:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfa76ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1be9 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.134852:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 14 pid: 20361 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746066758.134872:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7268 00000100:00100000:2.0:1746066758.134876:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984479872:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066758.134878:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983286272:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.134906:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.134926:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 14 pid: 20361 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.134935:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 14 pid: 20361 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066758.134936:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746066758.134954:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa45e00/0xf1867c21abfa74dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ac3 expref: 14 pid: 20361 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.134965:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.134982:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882983286272:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.134988:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7268 00000100:00080000:3.0:1746066758.135005:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746066758.135480:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.135501:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.135615:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286528 00000100:00100000:2.0:1746066758.135618:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286528 00000100:00100000:2.0:1746066758.135648:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16141 00000100:00100000:2.0:1746066758.135653:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983286528:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.135661:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.135669:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa7706 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bf0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.135682:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.135688:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa7706 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf0 expref: 27 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.135696:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098496e00/0xf1867c21abfa7706 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf0 expref: 27 pid: 11630 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066758.135700:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286400 00000100:00100000:1.0:1746066758.135704:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286400 00010000:00010000:2.0:1746066758.135712:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496e00, rc 0) 00000100:00100000:1.0:1746066758.135726:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 786 00000100:00100000:2.0:1746066758.135729:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983286528:12345-192.168.204.16@tcp:101:cat.0 Request processed in 76us (227us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066758.135731:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983286400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066758.135734:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16141 00010000:00010000:1.0:1746066758.135739:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.135752:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5729c00/0xf1867c21abfa76ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bdb expref: 35 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.135762:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.135766:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.135780:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:2014:x1830882983286400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 49us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.135789:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 786 00000100:00100000:2.0:1746066758.135824:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984479744:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066758.135840:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa76f8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1be2 expref: 25 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.135849:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66400/0xf1867c21abfa76f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1be2 expref: 25 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.136183:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66400, rc 0) 00000100:00100000:0.0:1746066758.136206:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984479872:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066758.136221:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfa76ff lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1be9 expref: 51 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.136229:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497a00/0xf1867c21abfa76ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1be9 expref: 51 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066758.136249:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983286016:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2848us (2986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066758.136255:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16139 00010000:00010000:0.0:1746066758.136282:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497a00, rc 0) 00000100:00100000:0.0:1746066758.136301:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:2013:x1830882983286144:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1483us (1587us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066758.136307:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16140 00000100:00100000:0.0:1746066758.137878:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.137939:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.137963:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286784 00000100:00100000:2.0:1746066758.137967:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286656 00000100:00100000:1.0:1746066758.137969:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286784 00000100:00100000:2.0:1746066758.137971:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286656 00010000:00010000:2.0:1746066758.137992:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 17 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.137992:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 24 pid: 1893 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746066758.138027:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7269 00000100:00100000:1.0:1746066758.138034:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983286784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.138045:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.138063:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 24 pid: 1893 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.138072:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 24 pid: 1893 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.138092:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7626 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b6b expref: 24 pid: 1893 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.138106:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.138136:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+23:2016:x1830882983286784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.138141:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7269 00000100:00100000:1.0:1746066758.138153:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7270 00000100:00100000:1.0:1746066758.138158:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983286656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.138165:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.138172:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 17 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.138181:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 17 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.138191:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009575be00/0xf1867c21abfa7665 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b95 expref: 17 pid: 12233 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.138201:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.138203:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.138210:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.138218:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.138248:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 16 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.138260:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984480000:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.138322:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.138680:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.138753:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983286912 00000100:00100000:1.0:1746066758.138757:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983286912 00000100:00100000:1.0:1746066758.138778:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16142 00000100:00100000:1.0:1746066758.138825:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+23:759:x1830882983286912:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.138839:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.138850:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bf7 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.139008:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 16 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.139015:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.139017:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.139020:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.139038:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 16 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.139049:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 16 pid: 11630 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.139057:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984480128:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.139381:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800988540c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.142238:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.142253:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984480128:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.142282:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 24 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066758.142284:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066758.142300:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f66e00, rc 0) 00000100:00100000:2.0:1746066758.142347:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:759:x1830882983286912:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3521us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.142356:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16142 00000100:00100000:1.0:1746066758.142568:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984480000:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.142579:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.142603:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2015:x1830882983286656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4444us (4664us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.142611:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7270 00000100:00100000:1.0:1746066758.142648:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983287296 00000100:00100000:1.0:1746066758.142654:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983287296 00002000:00100000:1.0:1746066758.142687:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2224128->2228223) req@ffff88009d8caa00 x1830882983287296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.142701:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8caa00 with x1830882983287296 ext(2224128->2228223) 00002000:00010000:1.0:1746066758.142706:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8caa00 00000100:00100000:1.0:1746066758.142731:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983287168 00000100:00100000:1.0:1746066758.142734:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983287168 00002000:00100000:1.0:1746066758.142745:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (761856->1048575) req@ffff88009d8c8000 x1830882983287168/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.142751:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8000 with x1830882983287168 ext(761856->1048575) 00010000:00010000:1.0:1746066758.142757:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 17 pid: 11630 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.142767:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 17 pid: 11630 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746066758.142774:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d8c8000 00000100:00100000:1.0:1746066758.142793:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 969 00000100:00100000:1.0:1746066758.142803:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983287168:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066758.142825:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4331 00000100:00100000:3.0:1746066758.142834:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983287296:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066758.142985:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983287296:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 149us (754us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066758.142991:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4331 00002000:00100000:3.0:1746066758.142997:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2224128->2228223) req@ffff88009d8caa00 x1830882983287296/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.143003:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8caa00 with x1830882983287296 ext(2224128->2228223) 00002000:00010000:3.0:1746066758.143006:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8caa00 00000100:00100000:0.0:1746066758.148146:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983287168:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 5331us (5848us total) trans 21474841903 rc 0/0 00000100:00100000:0.0:1746066758.148159:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 969 00002000:00100000:0.0:1746066758.148170:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (761856->1048575) req@ffff88009d8c8000 x1830882983287168/t21474841903(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.148180:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c8000 with x1830882983287168 ext(761856->1048575) 00010000:00010000:0.0:1746066758.148191:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 18 pid: 11630 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066758.148205:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 18 pid: 11630 timeout: 826 lvb_type: 0 00002000:00010000:0.0:1746066758.148212:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d8c8000 00000100:00100000:0.0:1746066758.151731:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.151787:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.151876:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983287424 00000100:00100000:1.0:1746066758.151956:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983287424 00010000:00010000:1.0:1746066758.151998:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 18 pid: 11630 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.152040:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7271 00000100:00100000:1.0:1746066758.152049:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983287424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.152065:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066758.152085:0:8395:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066758 -> 1746066759 00010000:00010000:1.0:1746066758.152092:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 18 pid: 11630 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.152104:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 18 pid: 11630 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.152128:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129d2d800/0xf1867c21abfa75fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 761856->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b3a expref: 18 pid: 11630 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.152143:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.152144:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.152152:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 23 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.152160:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 23 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.152193:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 23 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.152205:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984480256:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.152283:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.152345:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983287680 00000100:00100000:2.0:1746066758.152349:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983287680 00002000:00100000:2.0:1746066758.152383:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2977792->2981887) req@ffff88009d8c9500 x1830882983287680/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.152392:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9500 with x1830882983287680 ext(2977792->2981887) 00002000:00010000:2.0:1746066758.152396:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9500 00000100:00100000:2.0:1746066758.152420:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4332 00000100:00100000:2.0:1746066758.152426:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983287680:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066758.153421:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983287680:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 992us (1631us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066758.153428:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4332 00002000:00100000:2.0:1746066758.153435:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2977792->2981887) req@ffff88009d8c9500 x1830882983287680/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.153457:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d8c9500 with x1830882983287680 ext(2977792->2981887) 00002000:00010000:2.0:1746066758.153461:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d8c9500 00000100:00100000:1.0:1746066758.156934:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984480256:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.156956:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.157006:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:2016:x1830882983287424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4957us (5285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.157020:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7271 00000100:00100000:0.0:1746066758.158369:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.158485:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983287936 00000100:00100000:2.0:1746066758.158492:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983287936 00002000:00100000:2.0:1746066758.158534:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098fbea00 x1830882983287936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.158544:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882983287936 ext(0->1048575) 00002000:00010000:2.0:1746066758.158549:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:2.0:1746066758.158578:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4333 00000100:00100000:2.0:1746066758.158587:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882983287936:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.165020:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882983287936:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6420us (6641us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066758.165033:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4333 00002000:00100000:2.0:1746066758.165046:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880098fbea00 x1830882983287936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.165055:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbea00 with x1830882983287936 ext(0->1048575) 00002000:00010000:2.0:1746066758.165061:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbea00 00000100:00100000:0.0:1746066758.165566:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.165623:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983288192 00000100:00100000:1.0:1746066758.165631:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983288192 00000100:00100000:1.0:1746066758.165683:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16317 00000100:00100000:1.0:1746066758.165691:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+13:763:x1830882983288192:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.165713:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.165731:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa7714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1bfe expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.165802:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165814:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165823:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165837:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165842:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165846:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165974:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992400/0xf1867c21abfa7729 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165983:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992400/0xf1867c21abfa7729 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.165989:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992400/0xf1867c21abfa7729 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066758.165997:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066758.166066:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166072:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166078:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166565:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166573:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5992800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.166577:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166584:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166595:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066758.166597:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.166602:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166607:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992800/0xf1867c21abfa771b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166630:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166640:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166644:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166648:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5993000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.166651:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166655:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166661:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20200) 00010000:00010000:1.0:1746066758.166662:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.166664:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166669:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993000/0xf1867c21abfa7722 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.166708:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993c00/0xf1867c21abfa7714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bfe expref: 16 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.166718:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992400/0xf1867c21abfa7729 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bfe expref: 15 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.166725:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.166727:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066758.166729:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992400, rc 0) 00000100:00100000:1.0:1746066758.166761:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:763:x1830882983288192:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1071us (1197us total) trans 8589936651 rc 0/0 00000100:00100000:1.0:1746066758.166768:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16317 00000100:00100000:2.0:1746066758.169583:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.169645:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983288448 00000100:00100000:3.0:1746066758.169655:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983288448 00000100:00100000:2.0:1746066758.169660:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.169706:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5957 00000100:00100000:3.0:1746066758.169714:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:763:x1830882983288448:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066758.169740:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983288576 00000100:00100000:1.0:1746066758.169840:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983288576 00000100:00100000:1.0:1746066758.169924:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 787 00000100:00100000:1.0:1746066758.169931:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+16:2016:x1830882983288576:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.169942:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.169965:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992400/0xf1867c21abfa7729 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bfe expref: 16 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.169990:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.169995:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.170035:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:2016:x1830882983288576:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 105us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.170042:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 787 00000100:00100000:0.0:1746066758.170409:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.170533:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:763:x1830882983288448:12345-192.168.204.16@tcp:35:cat.0 Request processed in 819us (960us total) trans 8589936652 rc 0/0 00000100:00100000:3.0:1746066758.170539:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5957 00000100:00100000:3.0:1746066758.170596:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983288704 00000100:00100000:3.0:1746066758.170600:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983288704 00000100:00100000:3.0:1746066758.170619:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16143 00000100:00100000:3.0:1746066758.170624:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+50:759:x1830882983288704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.170634:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.170647:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c05 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.170669:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.170676:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.170677:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.170680:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 51 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.170705:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.170717:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 34 pid: 3528 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.170728:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984480384:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066758.170932:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.171917:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984480384:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.171938:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 51 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.172128:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984ba800, rc 0) 00000100:00100000:3.0:1746066758.172165:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+51:759:x1830882983288704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1539us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.172171:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16143 00000100:00100000:0.0:1746066758.172546:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.172574:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.172605:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.172638:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.172689:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983288832 00000100:00100000:3.0:1746066758.172693:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983288832 00000100:00100000:3.0:1746066758.172715:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983288960 00000100:00100000:3.0:1746066758.172717:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983288960 00000100:00100000:3.0:1746066758.172726:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983289216 00000100:00100000:3.0:1746066758.172727:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983289216 00000100:00100000:3.0:1746066758.172738:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16144 00000100:00100000:3.0:1746066758.172742:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+17:2015:x1830882983288832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.172755:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.172768:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c0c expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.172782:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.172784:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.172792:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 18 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.172803:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 18 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.172810:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984bac00, rc 0) 00000100:00100000:3.0:1746066758.172825:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983288832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 83us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.172831:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16144 00000100:00100000:3.0:1746066758.172838:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16145 00000100:00100000:3.0:1746066758.172842:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+36:2015:x1830882983288960:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.172847:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.172852:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa7745 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c13 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.172877:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984480512:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066758.172930:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.172944:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16146 00000100:00100000:3.0:1746066758.172948:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+37:2016:x1830882983289216:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.172953:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.172958:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa774c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c1a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.172977:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984480640:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066758.172992:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.173064:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983289088 00000100:00100000:2.0:1746066758.173068:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983289088 00002000:00100000:2.0:1746066758.173092:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1220607) req@ffff880098fbfb80 x1830882983289088/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.173102:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbfb80 with x1830882983289088 ext(1048576->1220607) 00010000:00010000:2.0:1746066758.173109:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 39 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.173120:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 39 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066758.173126:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbfb80 00000100:00100000:2.0:1746066758.173138:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 970 00000100:00100000:2.0:1746066758.173142:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+39:2016:x1830882983289088:12345-192.168.204.16@tcp:4:multiop.0 00002000:00010000:2.0:1746066758.176224:0:1893:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066758 -> 1746066759 00002000:00010000:3.0:1746066758.176225:0:12237:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746066758 -> 1746066759 00002000:00010000:3.0:1746066758.176232:0:12237:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746066758 -> 1746066759 00002000:00010000:2.0:1746066758.176232:0:1893:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066758 -> 1746066759 00002000:00010000:2.0:1746066758.176234:0:1893:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066758 -> 1746066759 00000100:00100000:3.0:1746066758.176250:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984480512:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066758.176250:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984480640:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.176280:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa7745 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c13 expref: 40 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.176280:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa774c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c1a expref: 40 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.176292:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984baa00/0xf1867c21abfa7745 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c13 expref: 40 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.176292:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096deb400/0xf1867c21abfa774c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c1a expref: 40 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.176302:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984baa00, rc 0) 00010000:00010000:2.0:1746066758.176305:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096deb400, rc 0) 00000100:00100000:3.0:1746066758.176619:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+38:2015:x1830882983288960:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3772us (4041us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.176628:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16145 00000100:00100000:2.0:1746066758.177085:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+37:2016:x1830882983289216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3911us (4222us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066758.177094:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16146 00000100:00100000:2.0:1746066758.179220:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+37:2016:x1830882983289088:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 6069us (6606us total) trans 17179874451 rc 0/0 00000100:00100000:2.0:1746066758.179233:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 970 00002000:00100000:2.0:1746066758.179245:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1220607) req@ffff880098fbfb80 x1830882983289088/t17179874451(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.179254:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbfb80 with x1830882983289088 ext(1048576->1220607) 00010000:00010000:2.0:1746066758.179266:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 37 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.179280:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 37 pid: 3528 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066758.179287:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fbfb80 00000100:00100000:0.0:1746066758.181559:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.181678:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983289344 00000100:00100000:1.0:1746066758.181688:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983289344 00010000:00010000:1.0:1746066758.181727:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 37 pid: 3528 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.182125:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7272 00000100:00100000:1.0:1746066758.182133:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+37:2014:x1830882983289344:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.182147:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.182167:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 37 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.182179:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 37 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.182204:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576be00/0xf1867c21abfa7611 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b56 expref: 37 pid: 3528 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.182628:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.182631:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.182639:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 50 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.182649:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 50 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.182685:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 50 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.182697:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984480768:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.183084:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.183328:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.183367:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983289600 00000100:00100000:3.0:1746066758.183373:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983289600 00002000:00100000:3.0:1746066758.183411:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d02680 x1830882983289600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.183419:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d02680 with x1830882983289600 ext(0->1048575) 00002000:00010000:3.0:1746066758.183424:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d02680 00000100:00100000:3.0:1746066758.183458:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4334 00000100:00100000:3.0:1746066758.183464:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983289600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066758.188871:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984480768:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.188998:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.189058:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801373f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+36:2014:x1830882983289344:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6923us (7507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.189070:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7272 00000100:00100000:3.0:1746066758.189810:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983289600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6344us (6480us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066758.190127:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4334 00002000:00100000:3.0:1746066758.190141:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800a4d02680 x1830882983289600/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.190151:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d02680 with x1830882983289600 ext(0->1048575) 00002000:00010000:3.0:1746066758.190156:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d02680 00000100:00100000:0.0:1746066758.190793:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.190826:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.190904:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983289984 00000100:00100000:1.0:1746066758.190912:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983289984 00002000:00100000:1.0:1746066758.190950:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098fbf100 x1830882983289984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.190964:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882983289984 ext(1048576->2097151) 00002000:00010000:1.0:1746066758.190968:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf100 00000100:00100000:1.0:1746066758.190983:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983289856 00000100:00100000:1.0:1746066758.190985:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983289856 00002000:00100000:1.0:1746066758.190995:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880098fbe300 x1830882983289856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.191001:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882983289856 ext(1048576->2097151) 00002000:00010000:1.0:1746066758.191004:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbe300 00000100:00100000:1.0:1746066758.191014:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4335 00000100:00100000:1.0:1746066758.191020:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+52:2016:x1830882983289984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.191517:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4336 00000100:00100000:0.0:1746066758.191524:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882983289856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.199749:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.200151:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+53:2016:x1830882983289984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9128us (9357us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066758.200163:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4335 00002000:00100000:1.0:1746066758.200176:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098fbf100 x1830882983289984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.200185:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf100 with x1830882983289984 ext(1048576->2097151) 00002000:00010000:1.0:1746066758.200192:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbf100 00000100:00100000:2.0:1746066758.200193:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983290240 00000100:00100000:2.0:1746066758.200201:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983290240 00000100:00100000:2.0:1746066758.200294:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16147 00000100:00100000:2.0:1746066758.200302:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+36:763:x1830882983290240:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.200319:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.200336:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c21 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.200360:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.200362:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.200369:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.200383:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 37 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.200393:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497e00, rc 0) 00000100:00100000:2.0:1746066758.200412:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+37:763:x1830882983290240:12345-192.168.204.16@tcp:101:cat.0 Request processed in 112us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.200416:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16147 00000100:00100000:2.0:1746066758.204561:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+51:2016:x1830882983289856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13024us (13721us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066758.204574:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4336 00002000:00100000:2.0:1746066758.204586:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880098fbe300 x1830882983289856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.204596:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbe300 with x1830882983289856 ext(1048576->2097151) 00002000:00010000:2.0:1746066758.204603:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbe300 00000100:00100000:0.0:1746066758.206505:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.206572:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983290496 00000100:00100000:2.0:1746066758.206582:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983290496 00002000:00100000:2.0:1746066758.206621:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880098fbce00 x1830882983290496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.206631:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbce00 with x1830882983290496 ext(1048576->2097151) 00002000:00010000:2.0:1746066758.206636:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbce00 00000100:00100000:2.0:1746066758.206659:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4337 00000100:00100000:2.0:1746066758.206665:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+37:2014:x1830882983290496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.216308:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+37:2014:x1830882983290496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9629us (9795us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066758.216323:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4337 00002000:00100000:2.0:1746066758.216336:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880098fbce00 x1830882983290496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.216347:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbce00 with x1830882983290496 ext(1048576->2097151) 00002000:00010000:2.0:1746066758.216354:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbce00 00000100:00100000:0.0:1746066758.219065:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.219272:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983290624 00000100:00100000:3.0:1746066758.219283:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983290624 00000100:00100000:3.0:1746066758.219346:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16148 00000100:00100000:3.0:1746066758.219355:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+24:759:x1830882983290624:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.219383:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.219402:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c28 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.219434:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.219441:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.219443:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.219446:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 25 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.219491:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 17 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.219503:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 17 pid: 9591 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.219516:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984480896:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066758.219621:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.224196:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984480896:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.224230:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 25 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.224251:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326d200, rc 0) 00000100:00100000:3.0:1746066758.224302:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+25:759:x1830882983290624:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4948us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.224312:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16148 00000100:00100000:0.0:1746066758.226729:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.227553:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983290752 00000100:00100000:3.0:1746066758.227564:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983290752 00002000:00100000:3.0:1746066758.227608:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2224128->2981887) req@ffff880098fbc700 x1830882983290752/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.227619:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc700 with x1830882983290752 ext(2224128->2981887) 00010000:00010000:3.0:1746066758.227629:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 18 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.227643:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 18 pid: 9591 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746066758.227651:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbc700 00000100:00100000:3.0:1746066758.227681:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 971 00000100:00100000:3.0:1746066758.227688:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+18:2015:x1830882983290752:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066758.228063:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.228257:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983290880 00000100:00100000:3.0:1746066758.228261:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983290880 00000100:00100000:3.0:1746066758.228291:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16149 00000100:00100000:3.0:1746066758.228297:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:763:x1830882983290880:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.228307:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.228325:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c2f expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.228348:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.228353:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.228369:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.228378:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009326c400, rc 0) 00000100:00100000:3.0:1746066758.228403:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:763:x1830882983290880:12345-192.168.204.16@tcp:101:cat.0 Request processed in 105us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.228409:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16149 00000100:00100000:3.0:1746066758.238259:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983290752:12345-192.168.204.16@tcp:4:cat.0 Request processed in 10556us (11526us total) trans 21474841904 rc 0/0 00000100:00100000:3.0:1746066758.238273:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 971 00002000:00100000:3.0:1746066758.238286:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2224128->2981887) req@ffff880098fbc700 x1830882983290752/t21474841904(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.238296:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc700 with x1830882983290752 ext(2224128->2981887) 00010000:00010000:3.0:1746066758.238307:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 21 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.238323:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 21 pid: 9591 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746066758.238340:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fbc700 00000100:00100000:0.0:1746066758.242336:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.242726:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983291008 00000100:00100000:1.0:1746066758.242737:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983291008 00010000:00010000:1.0:1746066758.242779:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 21 pid: 9591 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.242820:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7273 00000100:00100000:1.0:1746066758.242828:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882983291008:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.242843:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746066758.242861:0:8395:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066758 -> 1746066759 00002000:00010000:1.0:1746066758.242864:0:8395:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066758 -> 1746066759 00010000:00010000:1.0:1746066758.242869:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 21 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.242920:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 21 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.242950:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa76dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2224128->2981887) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bd4 expref: 21 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.242968:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.242971:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.242979:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 24 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.242986:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 24 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.242994:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.242996:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.242999:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.243005:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.243040:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.243052:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984481024:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.243161:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 24 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.243169:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984481152:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.243188:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854180 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.247096:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984481024:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.247107:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984481152:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.247124:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.247179:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882983291008:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4351us (4852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.247187:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7273 00000100:00100000:0.0:1746066758.248417:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.248520:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983291264 00000100:00100000:3.0:1746066758.248529:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983291264 00002000:00100000:3.0:1746066758.248574:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098fbc000 x1830882983291264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.248588:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc000 with x1830882983291264 ext(2097152->3145727) 00002000:00010000:3.0:1746066758.248593:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbc000 00000100:00100000:3.0:1746066758.248624:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4338 00000100:00100000:3.0:1746066758.248632:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983291264:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.253265:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.253306:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.253342:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983291648 00000100:00100000:1.0:1746066758.253352:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983291648 00000100:00100000:3.0:1746066758.253359:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983291776 00000100:00100000:3.0:1746066758.253364:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983291776 00002000:00100000:3.0:1746066758.253394:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d81180 x1830882983291776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 504/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.253394:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880098fbed80 x1830882983291648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.253404:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830882983291776 ext(2097152->4194303) 00002000:00100000:1.0:1746066758.253404:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbed80 with x1830882983291648 ext(2097152->4194303) 00002000:00010000:3.0:1746066758.253409:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d81180 00002000:00010000:1.0:1746066758.253409:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbed80 00000100:00100000:3.0:1746066758.253444:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4339 00000100:00100000:1.0:1746066758.253465:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4340 00000100:00100000:3.0:1746066758.253466:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882983291776:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066758.253471:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983291648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.253987:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983291264:12345-192.168.204.16@tcp:3:cat.0 Request processed in 5354us (5575us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066758.253995:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4338 00002000:00100000:2.0:1746066758.254001:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->3145727) req@ffff880098fbc000 x1830882983291264/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.254008:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbc000 with x1830882983291264 ext(2097152->3145727) 00002000:00010000:2.0:1746066758.254012:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbc000 00000100:00100000:0.0:1746066758.261646:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.261713:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983291904 00000100:00100000:2.0:1746066758.261722:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983291904 00000100:00100000:2.0:1746066758.261772:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16150 00000100:00100000:2.0:1746066758.261778:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+37:763:x1830882983291904:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.261796:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.261810:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c36 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.261835:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.261841:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066758.261842:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066758.261845:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 38 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.261856:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+51:2015:x1830882983291776:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8390us (8547us total) trans 0 rc 1576960/1576960 00000100:00100000:3.0:1746066758.261866:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4339 00010000:00010000:2.0:1746066758.261867:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066758.261875:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d81180 x1830882983291776/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 504/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1576960/1576960 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746066758.261875:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 826 lvb_type: 0 00002000:00100000:3.0:1746066758.261908:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81180 with x1830882983291776 ext(2097152->4194303) 00000100:00100000:2.0:1746066758.261912:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984481280:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.261915:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.261926:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746066758.261936:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81180 00000100:00100000:2.0:1746066758.261959:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.269262:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984481280:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.269286:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 38 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.269302:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496600, rc 0) 00000100:00100000:2.0:1746066758.269355:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+38:763:x1830882983291904:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7576us (7719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.269363:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16150 00000100:00100000:0.0:1746066758.269546:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.269623:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983292032 00000100:00100000:3.0:1746066758.269633:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983292032 00002000:00100000:3.0:1746066758.269677:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (2289664->2809855) req@ffff8800a5d81f80 x1830882983292032/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.269687:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882983292032 ext(2289664->2809855) 00010000:00010000:3.0:1746066758.269696:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.269710:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 51 pid: 9591 timeout: 826 lvb_type: 0 00002000:00010000:3.0:1746066758.269718:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81f80 00000100:00100000:3.0:1746066758.269755:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 972 00000100:00100000:3.0:1746066758.269763:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+51:2013:x1830882983292032:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066758.269925:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983291648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16452us (16669us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066758.269934:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4340 00002000:00100000:1.0:1746066758.269941:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880098fbed80 x1830882983291648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.269950:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbed80 with x1830882983291648 ext(2097152->4194303) 00002000:00010000:1.0:1746066758.269955:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbed80 00000100:00100000:2.0:1746066758.276541:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+53:2013:x1830882983292032:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6764us (6986us total) trans 17179874452 rc 0/0 00000100:00100000:2.0:1746066758.276555:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 972 00002000:00100000:2.0:1746066758.276570:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (2289664->2809855) req@ffff8800a5d81f80 x1830882983292032/t17179874452(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.276580:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d81f80 with x1830882983292032 ext(2289664->2809855) 00010000:00010000:2.0:1746066758.276591:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 53 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.276608:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 53 pid: 9591 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066758.276615:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5d81f80 00000001:00080000:0.0:1746066758.277998:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874452 is committed 00000001:00080000:0.0:1746066758.278010:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874451 is committed 00000001:00080000:0.0:1746066758.278019:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874449 is committed 00000001:00080000:0.0:1746066758.278044:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874433 is committed 00000100:00100000:0.0:1746066758.278467:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.278572:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983292160 00000100:00100000:2.0:1746066758.278580:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983292160 00000100:00100000:2.0:1746066758.278633:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16151 00000100:00100000:2.0:1746066758.278640:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+27:759:x1830882983292160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.278656:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.278672:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c3d expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.278705:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066758.278710:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.278720:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.278730:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496e00, rc 0) 00000100:00100000:2.0:1746066758.278782:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:759:x1830882983292160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 142us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.278788:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16151 00000100:00100000:0.0:1746066758.284983:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.285079:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983292288 00000100:00100000:2.0:1746066758.285086:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983292288 00010000:00010000:2.0:1746066758.285122:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 28 pid: 9591 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066758.285152:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7274 00000100:00100000:2.0:1746066758.285159:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983292288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.285170:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.285185:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 28 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.285195:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 28 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.285213:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d71a00/0xf1867c21abfa76c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2289664->2809855) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bcd expref: 28 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.285234:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.285236:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.285241:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 7 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.285249:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 7 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.285254:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.285255:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.285257:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.285263:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.285290:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 27 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.285301:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984481408:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.285607:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 7 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.285616:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984481536:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.285634:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.287206:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984481408:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.287215:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d01f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984481536:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.287232:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.287337:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983292288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2176us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.287346:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7274 00000100:00100000:0.0:1746066758.291388:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.291423:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.291481:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.291541:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983292800 00000100:00100000:1.0:1746066758.291549:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983292800 00000100:00100000:3.0:1746066758.291567:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983292672 00000100:00100000:3.0:1746066758.291571:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983292672 00002000:00100000:1.0:1746066758.291588:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a5d83800 x1830882983292800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.291594:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d82300 x1830882983292672/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.291597:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882983292800 ext(3145728->4194303) 00002000:00100000:3.0:1746066758.291601:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882983292672 ext(2097152->4194303) 00002000:00010000:1.0:1746066758.291603:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83800 00002000:00010000:3.0:1746066758.291604:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:3.0:1746066758.291616:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983293056 00000100:00100000:3.0:1746066758.291618:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983293056 00000100:00100000:1.0:1746066758.291626:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4341 00002000:00100000:3.0:1746066758.291628:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d80e00 x1830882983293056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066758.291633:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882983292672:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:3.0:1746066758.291640:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882983293056 ext(2097152->4194303) 00002000:00010000:3.0:1746066758.291642:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80e00 00000100:00100000:2.0:1746066758.291652:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4342 00000100:00100000:2.0:1746066758.291660:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983292800:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066758.291744:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4343 00000100:00100000:3.0:1746066758.291751:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983293056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.299762:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983292800:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8094us (8372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066758.299772:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4342 00002000:00100000:2.0:1746066758.299782:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800a5d83800 x1830882983292800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.299791:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83800 with x1830882983292800 ext(3145728->4194303) 00002000:00010000:2.0:1746066758.299797:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83800 00000100:00100000:3.0:1746066758.313803:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983293056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22044us (22312us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066758.313813:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4343 00002000:00100000:3.0:1746066758.313822:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d80e00 x1830882983293056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.313831:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80e00 with x1830882983293056 ext(2097152->4194303) 00002000:00010000:3.0:1746066758.313835:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d80e00 00000100:00100000:1.0:1746066758.313947:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882983292672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22307us (22516us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066758.313955:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4341 00002000:00100000:1.0:1746066758.313964:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a5d82300 x1830882983292672/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.313973:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d82300 with x1830882983292672 ext(2097152->4194303) 00002000:00010000:1.0:1746066758.313978:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5d82300 00000100:00100000:0.0:1746066758.314402:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.314511:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983293312 00000100:00100000:1.0:1746066758.314518:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983293312 00000100:00100000:1.0:1746066758.314573:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16318 00000100:00100000:1.0:1746066758.314580:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+34:765:x1830882983293312:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.314602:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.314620:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa7776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c44 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.314691:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314703:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314713:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314725:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314730:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314735:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314837:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47400/0xf1867c21abfa778b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314847:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47400/0xf1867c21abfa778b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314853:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47400/0xf1867c21abfa778b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066758.314862:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066758.314962:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314969:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314974:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314979:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314985:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa46c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.314989:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.314995:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315005:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066758.315008:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.315012:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315017:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46c00/0xf1867c21abfa777d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315036:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315041:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315046:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315051:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa46a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.315053:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315058:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315065:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20e00) 00010000:00010000:1.0:1746066758.315067:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.315070:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315074:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46a00/0xf1867c21abfa7784 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.315108:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa46e00/0xf1867c21abfa7776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c44 expref: 37 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.315118:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47400/0xf1867c21abfa778b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c44 expref: 36 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.315124:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.315126:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066758.315128:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47400, rc 0) 00000100:00100000:1.0:1746066758.315166:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:765:x1830882983293312:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 585us (764us total) trans 8589936653 rc 0/0 00000100:00100000:1.0:1746066758.315171:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16318 00000100:00100000:0.0:1746066758.317059:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.317151:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983293440 00000100:00100000:2.0:1746066758.317158:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983293440 00000100:00100000:2.0:1746066758.317197:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 788 00000100:00100000:2.0:1746066758.317203:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2013:x1830882983293440:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.317214:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.317234:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa47400/0xf1867c21abfa778b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c44 expref: 36 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.317264:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066758.317268:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.317311:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983293440:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.317317:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 788 00000100:00100000:0.0:1746066758.330060:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.330122:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.330194:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983293824 00000100:00100000:2.0:1746066758.330204:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983293824 00002000:00100000:2.0:1746066758.330243:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a5d83480 x1830882983293824/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.330249:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83480 with x1830882983293824 ext(4194304->5033983) 00002000:00010000:2.0:1746066758.330254:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83480 00000100:00100000:1.0:1746066758.330390:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983293568 00000100:00100000:1.0:1746066758.330397:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983293568 00000100:00100000:1.0:1746066758.330438:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16152 00000100:00100000:1.0:1746066758.330457:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:765:x1830882983293568:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.330475:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066758.330480:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4344 00000100:00100000:2.0:1746066758.330488:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882983293824:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:1.0:1746066758.330491:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c4b expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.330519:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 7 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.330532:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.330538:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.330539:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.330543:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2621440->2899967] (req 2621440->2899967) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.330574:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.330586:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.330599:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984481664:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.331048:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 7 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.331124:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.331142:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983294080 00000100:00100000:3.0:1746066758.331145:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983294080 00002000:00100000:3.0:1746066758.331167:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095cee300 x1830882983294080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.331175:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cee300 with x1830882983294080 ext(4194304->5033983) 00002000:00010000:3.0:1746066758.331179:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cee300 00010000:00010000:1.0:1746066758.331204:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 7 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.331213:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984481792:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.331236:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.331356:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4345 00000100:00100000:3.0:1746066758.331363:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983294080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.341984:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.342008:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.342074:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983294208 00000100:00100000:2.0:1746066758.342086:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983294208 00000100:00100000:1.0:1746066758.342118:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984481664:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.342129:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 8 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.342131:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984481792:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.342154:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2621440->2899967] (req 2621440->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.342174:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa47800, rc 0) 00000100:00100000:1.0:1746066758.342468:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:765:x1830882983293568:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12021us (12418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.342475:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16152 00000100:00100000:0.0:1746066758.342762:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882983293824:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12274us (12639us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066758.342769:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4344 00002000:00100000:0.0:1746066758.342776:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff8800a5d83480 x1830882983293824/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.342783:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83480 with x1830882983293824 ext(4194304->5033983) 00002000:00010000:0.0:1746066758.342788:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83480 00000100:00100000:3.0:1746066758.342986:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983294336 00000100:00100000:3.0:1746066758.342992:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983294336 00000100:00100000:2.0:1746066758.342999:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7275 00000100:00100000:2.0:1746066758.343009:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983294208:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.343012:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.343025:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066758.343033:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7276 00000100:00100000:3.0:1746066758.343040:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882983294336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.343046:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 8 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.343051:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.343058:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 8 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.343067:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.343081:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa7768 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c36 expref: 8 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.343107:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.343143:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066758.343154:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa776f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c3d expref: 28 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.343169:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.343170:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.343175:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.343182:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.343191:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882983294208:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 184us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.343197:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7275 00010000:00010000:3.0:1746066758.343323:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 27 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.343333:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984481920:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066758.343386:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.349305:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.350013:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983294080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18648us (18887us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066758.350024:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4345 00002000:00100000:3.0:1746066758.350034:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880095cee300 x1830882983294080/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.350043:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cee300 with x1830882983294080 ext(4194304->5033983) 00002000:00010000:3.0:1746066758.350048:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cee300 00000100:00100000:0.0:1746066758.350323:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983294464 00000100:00100000:0.0:1746066758.350329:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983294464 00000100:00100000:0.0:1746066758.350366:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16153 00000100:00100000:0.0:1746066758.350373:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882983294464:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066758.350386:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066758.350399:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d200/0xf1867c21abfa77a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c52 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066758.350443:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984482048:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066758.350501:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.350643:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.350656:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983294720 00000100:00100000:2.0:1746066758.350659:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983294720 00002000:00100000:2.0:1746066758.350679:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2621440->2625535) req@ffff8800a4d01f80 x1830882983294720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.350686:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01f80 with x1830882983294720 ext(2621440->2625535) 00002000:00010000:2.0:1746066758.350689:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01f80 00000100:00100000:2.0:1746066758.350700:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4346 00000100:00100000:2.0:1746066758.350705:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983294720:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.350783:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983294720:12345-192.168.204.16@tcp:3:cat.0 Request processed in 77us (140us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066758.350788:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4346 00002000:00100000:2.0:1746066758.350793:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (2621440->2625535) req@ffff8800a4d01f80 x1830882983294720/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.350800:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01f80 with x1830882983294720 ext(2621440->2625535) 00002000:00010000:2.0:1746066758.350803:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01f80 00000100:00100000:2.0:1746066758.350862:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984481920:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.350874:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.350914:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983294336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 7874us (8904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.350921:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7276 00000100:00100000:2.0:1746066758.353514:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d82680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984482048:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066758.353548:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d200/0xf1867c21abfa77a0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c52 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.353560:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb7d200/0xf1867c21abfa77a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c52 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.353569:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb7d200, rc 0) 00000100:00100000:2.0:1746066758.353628:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882983294464:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3254us (4330us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066758.353634:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16153 00000100:00100000:2.0:1746066758.355488:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.355542:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983294976 00000100:00100000:0.0:1746066758.355553:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983294976 00002000:00100000:0.0:1746066758.355596:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2895872->2899967) req@ffff8800a4d01500 x1830882983294976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.355605:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01500 with x1830882983294976 ext(2895872->2899967) 00002000:00010000:0.0:1746066758.355610:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01500 00000100:00100000:0.0:1746066758.355636:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4347 00000100:00100000:0.0:1746066758.355641:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983294976:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.355795:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983294976:12345-192.168.204.16@tcp:3:cat.0 Request processed in 152us (309us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066758.355801:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4347 00002000:00100000:0.0:1746066758.355807:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2895872->2899967) req@ffff8800a4d01500 x1830882983294976/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.355813:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d01500 with x1830882983294976 ext(2895872->2899967) 00002000:00010000:0.0:1746066758.355817:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d01500 00000100:00100000:0.0:1746066758.358293:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.358493:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.358568:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983295232 00000100:00100000:1.0:1746066758.358580:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983295232 00000100:00100000:1.0:1746066758.358619:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983295488 00000100:00100000:1.0:1746066758.358621:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983295488 00000100:00100000:1.0:1746066758.358657:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5958 00000100:00100000:1.0:1746066758.358665:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+36:759:x1830882983295232:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066758.358676:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5959 00000100:00100000:3.0:1746066758.358687:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:765:x1830882983295488:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066758.358919:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:765:x1830882983295488:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 233us (424us total) trans 8589936654 rc 0/0 00000100:00100000:3.0:1746066758.358926:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5959 00000100:00100000:1.0:1746066758.359211:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:759:x1830882983295232:12345-192.168.204.16@tcp:35:cat.0 Request processed in 546us (924us total) trans 8589936655 rc 0/0 00000100:00100000:1.0:1746066758.359218:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5958 00000100:00100000:0.0:1746066758.359638:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.359692:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983295616 00000100:00100000:2.0:1746066758.359697:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983295616 00000100:00100000:2.0:1746066758.359729:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16154 00000100:00100000:2.0:1746066758.359734:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2015:x1830882983295616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.359744:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.359758:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496200/0xf1867c21abfa77a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c59 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.359798:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984482176:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066758.359869:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.362589:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984482176:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066758.362624:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496200/0xf1867c21abfa77a7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c59 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.362637:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496200/0xf1867c21abfa77a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c59 expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.362661:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496200, rc 0) 00000100:00100000:0.0:1746066758.362715:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2015:x1830882983295616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2979us (3076us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066758.362723:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16154 00000100:00100000:0.0:1746066758.378985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.379082:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983295872 00000100:00100000:1.0:1746066758.379096:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983295872 00000100:00100000:1.0:1746066758.379159:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16319 00000100:00100000:1.0:1746066758.379169:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+15:769:x1830882983295872:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.379196:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.379216:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c60 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.379305:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.379319:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.379330:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.379343:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.379349:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.379354:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380112:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa77c3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380124:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa77c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380131:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa77c3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066758.380141:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066758.380216:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380222:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380231:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380237:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380242:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea5e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.380246:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380253:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380264:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066758.380266:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.380270:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380275:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380307:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380312:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380316:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380320:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea4200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.380322:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380331:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380336:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20000) 00010000:00010000:1.0:1746066758.380338:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.380340:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380345:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.380381:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c60 expref: 18 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.380395:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa77c3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c60 expref: 17 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.380402:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.380404:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066758.380406:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5600, rc 0) 00000100:00100000:1.0:1746066758.380481:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:769:x1830882983295872:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1313us (1507us total) trans 8589936656 rc 0/0 00000100:00100000:1.0:1746066758.380488:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16319 00000100:00100000:0.0:1746066758.383584:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.387003:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.387018:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983296128 00000100:00100000:1.0:1746066758.387030:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983296128 00000100:00100000:1.0:1746066758.387072:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5960 00000100:00100000:1.0:1746066758.387078:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+17:769:x1830882983296128:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:3.0:1746066758.387123:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983296256 00000100:00100000:3.0:1746066758.387131:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983296256 00000100:00100000:3.0:1746066758.387172:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 789 00000100:00100000:3.0:1746066758.387180:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+19:2013:x1830882983296256:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.387194:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066758.387218:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa77c3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c60 expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.387237:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066758.387242:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.387256:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:769:x1830882983296128:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 177us (3684us total) trans 8589936657 rc 0/0 00000100:00100000:1.0:1746066758.387263:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5960 00000100:00100000:3.0:1746066758.387268:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2013:x1830882983296256:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.387274:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 789 00000100:00100000:3.0:1746066758.488108:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.488221:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983296512 00000100:00100000:1.0:1746066758.488233:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983296512 00000100:00100000:1.0:1746066758.488299:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16320 00000100:00100000:1.0:1746066758.488308:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:777:x1830882983296512:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.488336:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.488355:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa77d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c67 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.488435:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488462:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488473:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488486:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488492:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488497:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488593:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488602:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488609:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:1.0:1746066758.488617:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066758.488691:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488697:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488702:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488708:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488714:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea4c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.488718:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488724:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488734:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:1.0:1746066758.488737:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.488741:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488746:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4c00/0xf1867c21abfa77d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488772:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488780:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488784:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488788:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ea4200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066758.488790:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488795:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488800:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012ea20500) 00010000:00010000:1.0:1746066758.488802:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066758.488804:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488808:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea4200/0xf1867c21abfa77df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:1.0:1746066758.488843:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5600/0xf1867c21abfa77d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c67 expref: 40 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.490053:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c67 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.490060:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.490062:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746066758.490064:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5ea5e00, rc 0) 00000100:00100000:1.0:1746066758.490142:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:777:x1830882983296512:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1833us (2045us total) trans 8589936658 rc 0/0 00000100:00100000:1.0:1746066758.490150:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16320 00000100:00100000:1.0:1746066758.492512:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.496506:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983296640 00000100:00100000:2.0:1746066758.496521:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983296640 00000100:00100000:2.0:1746066758.499613:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 790 00000100:00100000:2.0:1746066758.499635:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+39:2013:x1830882983296640:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.499657:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.499688:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5ea5e00/0xf1867c21abfa77e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c67 expref: 39 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.499719:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066758.499723:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.500073:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.500119:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983296896 00000100:00100000:0.0:1746066758.500127:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983296896 00000100:00100000:0.0:1746066758.500168:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16321 00000100:00100000:0.0:1746066758.500174:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+17:779:x1830882983296896:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066758.500194:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066758.500207:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa77f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c6e expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.500282:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500294:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500304:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500317:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500322:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500326:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500439:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1e00/0xf1867c21abfa7809 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500458:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1e00/0xf1867c21abfa7809 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500464:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1e00/0xf1867c21abfa7809 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:0.0:1746066758.500473:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:0.0:1746066758.500540:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500546:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500551:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500557:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500562:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb7c200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066758.500566:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500572:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500579:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:0.0:1746066758.500582:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066758.500585:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500589:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7c200/0xf1867c21abfa77fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500610:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500614:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500619:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500623:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095dd0200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:0.0:1746066758.500625:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500629:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500635:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009d891300) 00010000:00010000:0.0:1746066758.500637:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746066758.500639:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500647:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd0200/0xf1867c21abfa7802 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:0.0:1746066758.500685:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb7d200/0xf1867c21abfa77f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c6e expref: 20 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.500700:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1e00/0xf1867c21abfa7809 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c6e expref: 19 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.500706:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066758.500708:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746066758.500710:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095dd1e00, rc 0) 00000100:00100000:0.0:1746066758.501044:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2051f12-252a-4bb3-b8f3-833317fca821+19:779:x1830882983296896:12345-192.168.204.16@tcp:101:cat.0 Request processed in 868us (970us total) trans 8589936659 rc 0/0 00000100:00100000:0.0:1746066758.501051:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16321 00000100:00100000:2.0:1746066758.502156:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+38:2013:x1830882983296640:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2527us (9648us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.502166:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 790 00000100:00100000:0.0:1746066758.503550:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.505627:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.505662:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.505745:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983297152 00000100:00100000:2.0:1746066758.505755:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983297152 00000100:00100000:1.0:1746066758.505785:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983297408 00000100:00100000:1.0:1746066758.505789:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983297408 00002000:00100000:2.0:1746066758.505796:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d80e00 x1830882983297152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 504/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.505807:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80e00 with x1830882983297152 ext(2097152->4194303) 00002000:00010000:2.0:1746066758.505812:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d80e00 00000100:00100000:1.0:1746066758.505822:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5961 00000100:00100000:2.0:1746066758.505825:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4348 00000100:00100000:2.0:1746066758.505829:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983297152:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066758.505829:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+19:779:x1830882983297408:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:3.0:1746066758.505876:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983297536 00000100:00100000:3.0:1746066758.505894:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983297536 00000100:00100000:3.0:1746066758.505925:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 791 00000100:00100000:3.0:1746066758.505932:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882983297536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.505943:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066758.505967:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095dd1e00/0xf1867c21abfa7809 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c6e expref: 21 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.505986:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066758.505990:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.506034:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+20:779:x1830882983297408:12345-192.168.204.16@tcp:35:cat.0 Request processed in 204us (412us total) trans 8589936660 rc 0/0 00000100:00100000:3.0:1746066758.506038:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+20:2014:x1830882983297536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 106us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.506041:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5961 00000100:00100000:3.0:1746066758.506044:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 791 00000100:00100000:0.0:1746066758.512811:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.512868:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.512950:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983297792 00000100:00100000:1.0:1746066758.512959:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983297792 00000100:00100000:2.0:1746066758.512980:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983297664 00000100:00100000:2.0:1746066758.512985:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983297664 00000100:00100000:1.0:1746066758.513156:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16155 00000100:00100000:1.0:1746066758.513166:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882983297792:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.513188:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1746066758.513220:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746066758.513289:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfa7817 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c7c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.513316:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16322 00000100:00100000:2.0:1746066758.513322:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:780:x1830882983297664:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066758.513339:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.513351:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfa781e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c75 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.513354:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984482304:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066758.513409:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.513421:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.513433:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066758.513451:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746066758.513456:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.513461:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.513467:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.513807:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.513818:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 18 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.513830:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.513853:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 18 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.513865:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 18 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066758.513875:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984482432:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.513958:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.520265:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984482432:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.520293:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066758.520307:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.520329:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983297920 00000100:00100000:3.0:1746066758.520335:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983297920 00000100:00100000:1.0:1746066758.520383:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984482304:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066758.520409:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfa7817 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c7c expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.520423:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750a00/0xf1867c21abfa7817 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c7c expref: 8 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.520456:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746066758.521105:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 19 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.521140:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7277 00000100:00100000:3.0:1746066758.521147:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+19:2016:x1830882983297920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.521159:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066758.521166:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 19 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.521175:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 19 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.521191:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecf000/0xf1867c21abfa75af lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1afb expref: 19 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.521205:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066758.521209:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521217:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521223:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521236:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066758.521271:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+18:2016:x1830882983297920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.521277:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7277 00010000:00010000:3.0:1746066758.521307:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521312:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066758.521360:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066758.521364:0:7245:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066758.521382:0:7245:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521392:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521403:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521408:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521414:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521419:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521425:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098496e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066758.521429:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521435:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521453:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066758.521456:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066758.521459:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521463:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496e00/0xf1867c21abfa7825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521473:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521477:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521483:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521487:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098496600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066758.521489:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521493:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521500:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9e00) 00010000:00010000:3.0:1746066758.521502:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066758.521504:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521508:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496600/0xf1867c21abfa782c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.521534:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfa781e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.521579:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750a00, rc 0) 00000100:00100000:1.0:1746066758.521604:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882983297792:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8440us (8734us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066758.521611:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16155 00010000:00010000:3.0:1746066758.521903:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 8 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.521910:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066758.521912:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066758.521913:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496200, rc 0) 00000100:00100000:3.0:1746066758.522331:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:780:x1830882983297664:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 9007us (9529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.522337:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16322 00000100:00100000:2.0:1746066758.523184:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983297152:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17351us (19636us total) trans 0 rc 1818624/1818624 00000100:00100000:2.0:1746066758.523192:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4348 00002000:00100000:2.0:1746066758.523201:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800a4d80e00 x1830882983297152/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 504/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1818624/1818624 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.523210:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d80e00 with x1830882983297152 ext(2097152->4194303) 00002000:00010000:2.0:1746066758.523216:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4d80e00 00000100:00100000:0.0:1746066758.532552:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.538628:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.542108:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.542123:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983298048 00000100:00100000:3.0:1746066758.542131:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983298048 00000100:00100000:3.0:1746066758.542171:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983298176 00000100:00100000:3.0:1746066758.542174:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983298176 00000100:00100000:3.0:1746066758.542186:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16156 00000100:00100000:3.0:1746066758.542192:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+8:779:x1830882983298048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.542210:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.542227:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c83 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.542256:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.542263:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.542265:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.542268:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.542295:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 26 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.542305:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 26 pid: 1893 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.542316:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984482560:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.542414:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16157 00000100:00100000:1.0:1746066758.542421:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:769:x1830882983298176:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.542427:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.542433:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c8a expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.542453:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.542455:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.542458:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->4194303] (req 4063232->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.542466:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->4194303] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.542475:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095750000, rc 0) 00000100:00100000:1.0:1746066758.542497:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:769:x1830882983298176:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 76us (3880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.542503:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16157 00000100:00100000:0.0:1746066758.542721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.542739:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.542753:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.542766:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.542800:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.542814:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983299072 00000100:00100000:0.0:1746066758.542817:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983299072 00000100:00100000:0.0:1746066758.542838:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5962 00000100:00100000:0.0:1746066758.542842:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+38:777:x1830882983299072:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:0.0:1746066758.543001:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+39:777:x1830882983299072:12345-192.168.204.16@tcp:35:cat.0 Request processed in 157us (200us total) trans 8589936661 rc 0/0 00000100:00100000:0.0:1746066758.543006:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5962 00000100:00100000:2.0:1746066758.543054:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983298304 00000100:00100000:2.0:1746066758.543058:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983298304 00000100:00100000:2.0:1746066758.543077:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983298560 00000100:00100000:2.0:1746066758.543079:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983298560 00000100:00100000:2.0:1746066758.543089:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983298432 00000100:00100000:2.0:1746066758.543091:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983298432 00000100:00100000:2.0:1746066758.543363:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983298688 00000100:00100000:2.0:1746066758.543367:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983298688 00000100:00100000:3.0:1746066758.543396:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.544249:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983298816 00000100:00100000:2.0:1746066758.544253:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983298816 00000100:00100000:3.0:1746066758.544269:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16158 00000100:00100000:3.0:1746066758.544277:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983298304:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:2.0:1746066758.544284:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16159 00000100:00100000:2.0:1746066758.544289:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983298560:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066758.544290:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.544297:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.544304:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c91 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.544306:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c9f expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.544321:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.544321:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.544323:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.544323:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.544331:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.544343:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 10 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.544353:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cf7800, rc 0) 00000100:00100000:2.0:1746066758.544384:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983298560:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 95us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.544389:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16159 00010000:00010000:3.0:1746066758.545052:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.545065:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.545072:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8000, rc 0) 00000100:00100000:3.0:1746066758.545094:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983298304:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 818us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.545137:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16160 00000100:00100000:1.0:1746066758.545181:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16161 00000100:00100000:1.0:1746066758.545189:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983298688:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066758.545199:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.545208:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ca6 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.545219:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.545220:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.545224:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.545233:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.545239:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751800, rc 0) 00000100:00100000:1.0:1746066758.545255:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2016:x1830882983298688:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 69us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.545260:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16161 00000100:00100000:1.0:1746066758.545272:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16162 00000100:00100000:1.0:1746066758.545278:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983298816:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066758.545283:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.545290:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095751600/0xf1867c21abfa785d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cad expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.545324:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984482688:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066758.545362:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.545580:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983298432:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066758.545588:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.545596:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1c98 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.545608:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.545610:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.545615:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.545624:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.545632:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097cf6400, rc 0) 00000100:00100000:3.0:1746066758.546034:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16158 00000100:00100000:2.0:1746066758.546378:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983298432:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 800us (3637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.546384:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16160 00000100:00100000:3.0:1746066758.547682:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984482560:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.547706:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.547720:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8a00, rc 0) 00000100:00100000:3.0:1746066758.547767:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+9:779:x1830882983298048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5575us (15227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.547774:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16156 00000100:00100000:1.0:1746066758.549385:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.550046:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983299200 00000100:00100000:2.0:1746066758.550055:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983299200 00002000:00100000:2.0:1746066758.550435:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2621440->2899967) req@ffff88009c7fc700 x1830882983299200/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.550454:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc700 with x1830882983299200 ext(2621440->2899967) 00010000:00010000:2.0:1746066758.550463:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 27 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.550477:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 27 pid: 1893 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066758.550484:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fc700 00000100:00100000:2.0:1746066758.550514:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 973 00000100:00100000:2.0:1746066758.550523:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983299200:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:0.0:1746066758.550580:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984482688:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066758.550608:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095751600/0xf1867c21abfa785d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cad expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.550619:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095751600/0xf1867c21abfa785d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cad expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.550633:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095751600, rc 0) 00000100:00100000:0.0:1746066758.551397:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983298816:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 5394us (7904us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066758.551405:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16162 00000100:00100000:0.0:1746066758.555317:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.555390:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983299456 00000100:00100000:3.0:1746066758.555401:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983299456 00000100:00100000:3.0:1746066758.555461:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16323 00000100:00100000:3.0:1746066758.555471:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:780:x1830882983299456:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066758.555494:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.555513:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa786b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cb4 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.555612:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.555628:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.555635:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.555668:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.555679:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 9 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.555692:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984482816:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066758.555759:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.557398:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983299200:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6869us (8010us total) trans 17179874453 rc 0/0 00000100:00100000:2.0:1746066758.557412:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 973 00002000:00100000:2.0:1746066758.557423:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2621440->2899967) req@ffff88009c7fc700 x1830882983299200/t17179874453(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.557432:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc700 with x1830882983299200 ext(2621440->2899967) 00010000:00010000:2.0:1746066758.557451:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 29 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.557463:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 29 pid: 1893 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066758.557470:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c7fc700 00000100:00100000:0.0:1746066758.558562:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.558616:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983299584 00000100:00100000:1.0:1746066758.558624:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983299584 00010000:00010000:1.0:1746066758.558654:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 10 pid: 7245 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.558660:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984482816:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.558680:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:1.0:1746066758.558691:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7278 00000100:00100000:1.0:1746066758.558699:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983299584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.558717:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.558722:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 10 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.558732:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 10 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.558756:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098496200/0xf1867c21abfa7833 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c75 expref: 10 pid: 7245 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.558781:0:16766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066758.558786:0:16766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.558794:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.558799:0:16766:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7245 initiator: MDT0 00010000:00010000:1.0:1746066758.558814:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.558854:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983299584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 156us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.558859:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7278 00010000:00010000:3.0:1746066758.558994:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.559000:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:3.0:1746066758.559020:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066758.559140:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9c00/0xf1867c21abfa786b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cb4 expref: 10 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.559167:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cb4 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.559174:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066758.559176:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066758.559178:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9600, rc 0) 00000100:00100000:3.0:1746066758.559203:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:780:x1830882983299456:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3734us (3896us total) trans 8589936662 rc 0/0 00000100:00100000:3.0:1746066758.559209:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16323 00000100:00100000:0.0:1746066758.562031:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.562296:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983299840 00000100:00100000:3.0:1746066758.562305:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983299840 00000100:00100000:3.0:1746066758.562352:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16324 00000100:00100000:3.0:1746066758.562360:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:780:x1830882983299840:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066758.562389:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.562393:0:7245:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066758.562418:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f9600/0xf1867c21abfa7872 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cb4 expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.562436:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066758.562440:0:7245:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066758.562464:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa7880 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cbb expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.562570:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562584:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562593:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562604:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562610:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562616:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562622:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a58f8c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066758.562626:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562632:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562639:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066758.562641:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066758.562643:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562648:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8c00/0xf1867c21abfa7887 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.562677:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa7880 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cbb expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.562684:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a58f8800/0xf1867c21abfa7880 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cbb expref: 9 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.562692:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f8800, rc 0) 00000100:00100000:3.0:1746066758.562738:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:780:x1830882983299840:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 378us (716us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.562744:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16324 00000100:00100000:1.0:1746066758.563378:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.563689:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983299968 00000100:00100000:2.0:1746066758.563694:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983299968 00010000:00010000:2.0:1746066758.563716:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 29 pid: 1893 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066758.563749:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7279 00000100:00100000:2.0:1746066758.563755:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983299968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.563764:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.563782:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 29 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.563793:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 29 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.563817:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa47800/0xf1867c21abfa7799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2621440->2899967) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c4b expref: 29 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.563846:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.563848:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.563855:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 8 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.563863:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 8 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.563871:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.563873:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.563876:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 8 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.563909:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 8 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.563941:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 8 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.563954:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984482944:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.564029:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 8 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.564041:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984483072:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.564058:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.565842:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984483072:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.565852:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984482944:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.565872:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.566142:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983299968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2385us (2763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.566152:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7279 00000100:00100000:0.0:1746066758.566623:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.566904:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983300224 00000100:00100000:2.0:1746066758.566910:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983300224 00002000:00100000:2.0:1746066758.566949:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (4063232->4067327) req@ffff88012bb74700 x1830882983300224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.566958:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74700 with x1830882983300224 ext(4063232->4067327) 00002000:00010000:2.0:1746066758.566963:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74700 00000100:00100000:2.0:1746066758.566992:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4349 00000100:00100000:2.0:1746066758.567000:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983300224:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.567134:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983300224:12345-192.168.204.16@tcp:3:cat.0 Request processed in 135us (512us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066758.567140:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4349 00002000:00100000:2.0:1746066758.567146:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (4063232->4067327) req@ffff88012bb74700 x1830882983300224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.567153:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74700 with x1830882983300224 ext(4063232->4067327) 00002000:00010000:2.0:1746066758.567157:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74700 00000100:00100000:0.0:1746066758.569712:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.569798:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983300352 00000100:00100000:2.0:1746066758.569807:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983300352 00000100:00100000:3.0:1746066758.570000:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16163 00000100:00100000:3.0:1746066758.570011:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+20:769:x1830882983300352:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066758.570031:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.570049:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cc2 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.570080:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 24 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.570088:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.570094:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.570101:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.570103:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.570106:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.570135:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.570144:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.570153:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984483200:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.570244:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 14 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.570251:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 14 pid: 3528 timeout: 826 lvb_type: 1 00000100:00100000:3.0:1746066758.570259:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984483328:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.570298:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 24 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.570306:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 24 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.570317:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984483456:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066758.570337:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.571650:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.571758:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983300608 00000100:00100000:0.0:1746066758.571765:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983300608 00002000:00100000:0.0:1746066758.572316:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff880098fbd180 x1830882983300608/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.572327:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882983300608 ext(2097152->3145727) 00002000:00010000:0.0:1746066758.572333:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:0.0:1746066758.572392:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4350 00000100:00100000:0.0:1746066758.572400:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882983300608:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.579715:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.579934:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983300864 00000100:00100000:1.0:1746066758.579944:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983300864 00000100:00100000:1.0:1746066758.579988:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5963 00000100:00100000:1.0:1746066758.579995:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:780:x1830882983300864:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066758.580157:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:780:x1830882983300864:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 161us (452us total) trans 8589936663 rc 0/0 00000100:00100000:1.0:1746066758.580163:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5963 00000100:00100000:3.0:1746066758.580221:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984483200:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066758.580233:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984483328:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066758.580241:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984483456:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.580273:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [4194304->5029887] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 21 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.580290:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a58f9e00, rc 0) 00000100:00100000:3.0:1746066758.580321:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+21:769:x1830882983300352:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 10313us (10619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.580329:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16163 00000100:00100000:2.0:1746066758.581729:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.581761:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.581914:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983301120 00000100:00100000:1.0:1746066758.581921:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983301120 00010000:00010000:1.0:1746066758.581953:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 25 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.581976:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983300992 00000100:00100000:1.0:1746066758.581978:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983300992 00010000:00010000:1.0:1746066758.581989:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 15 pid: 3528 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746066758.582019:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7280 00000100:00100000:1.0:1746066758.582026:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983301120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.582040:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.582061:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 25 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.582071:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 25 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.582098:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326d200/0xf1867c21abfa775a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c28 expref: 25 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.582111:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066758.582129:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7281 00000100:00100000:3.0:1746066758.582137:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983300992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.582145:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746066758.582147:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2015:x1830882983301120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.582153:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7280 00010000:00010000:3.0:1746066758.582154:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 15 pid: 3528 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746066758.582163:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 15 pid: 3528 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746066758.582175:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095751800/0xf1867c21abfa7856 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ca6 expref: 15 pid: 3528 timeout: 826 lvb_type: 1 00010000:00010000:3.0:1746066758.582188:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066758.582204:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983300992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 69us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.582212:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7281 00000100:00100000:2.0:1746066758.583232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.583522:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983301248 00000100:00100000:0.0:1746066758.583528:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983301248 00010000:00010000:0.0:1746066758.583548:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:0.0:1746066758.583582:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7282 00000100:00100000:0.0:1746066758.583588:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+21:2013:x1830882983301248:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066758.583597:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066758.583608:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066758.583619:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066758.583634:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009326c400/0xf1867c21abfa7761 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c2f expref: 21 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:0.0:1746066758.583654:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066758.583655:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066758.583663:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.583671:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.583703:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066758.583715:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984483584:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.583800:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882983300608:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11399us (12152us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066758.583808:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4350 00002000:00100000:1.0:1746066758.583818:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->3145727) req@ffff880098fbd180 x1830882983300608/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.583828:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbd180 with x1830882983300608 ext(2097152->3145727) 00002000:00010000:1.0:1746066758.583832:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098fbd180 00000100:00100000:0.0:1746066758.584049:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.586219:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984483584:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.586244:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.586298:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882983301248:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2708us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.586308:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7282 00000100:00100000:2.0:1746066758.592526:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.592637:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983301504 00000100:00100000:1.0:1746066758.592646:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983301504 00002000:00100000:1.0:1746066758.592697:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880098fbf480 x1830882983301504/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.592707:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882983301504 ext(3145728->4194303) 00002000:00010000:1.0:1746066758.592713:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbf480 00000100:00100000:1.0:1746066758.592745:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4351 00000100:00100000:1.0:1746066758.592753:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882983301504:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066758.593825:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.594787:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983301760 00000100:00100000:2.0:1746066758.594793:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983301760 00002000:00100000:2.0:1746066758.594828:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (5025792->5029887) req@ffff880095cece00 x1830882983301760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.594837:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cece00 with x1830882983301760 ext(5025792->5029887) 00002000:00010000:2.0:1746066758.594842:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cece00 00000100:00100000:2.0:1746066758.594871:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4352 00000100:00100000:2.0:1746066758.594878:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983301760:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.595003:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983301760:12345-192.168.204.16@tcp:3:cat.0 Request processed in 125us (1180us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066758.595009:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4352 00002000:00100000:2.0:1746066758.595015:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (5025792->5029887) req@ffff880095cece00 x1830882983301760/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.595027:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cece00 with x1830882983301760 ext(5025792->5029887) 00002000:00010000:2.0:1746066758.595029:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cece00 00000100:00100000:0.0:1746066758.596644:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.597944:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983302016 00000100:00100000:2.0:1746066758.597954:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983302016 00000100:00100000:2.0:1746066758.598753:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16325 00000100:00100000:2.0:1746066758.598763:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+39:783:x1830882983302016:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066758.598788:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.598807:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa7895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cc9 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.600506:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.600524:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.600536:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.600553:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.600559:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.600564:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.600680:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601673:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601679:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066758.601690:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066758.601773:0:10125:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601778:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601783:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601788:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601793:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094419000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066758.601796:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601801:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601810:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066758.601812:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066758.601816:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.601820:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419000/0xf1867c21abfa789c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00000100:00100000:1.0:1746066758.601859:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2013:x1830882983301504:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9102us (9340us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066758.601870:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4351 00002000:00100000:1.0:1746066758.601879:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff880098fbf480 x1830882983301504/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.601907:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fbf480 with x1830882983301504 ext(3145728->4194303) 00002000:00010000:1.0:1746066758.601911:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098fbf480 00000100:00100000:0.0:1746066758.602561:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066758.602617:0:10125:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.602623:0:10125:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.602628:0:10125:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.602631:0:10125:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094418000 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066758.602633:0:10125:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.602637:0:10125:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.602643:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9b00) 00010000:00010000:2.0:1746066758.602645:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066758.602648:0:10125:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.602652:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418000/0xf1867c21abfa78a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.602698:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094418800/0xf1867c21abfa7895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 42 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.602707:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 41 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.602712:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066758.602715:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066758.602718:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419400, rc 0) 00000100:00100000:2.0:1746066758.602748:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+41:783:x1830882983302016:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3987us (6108us total) trans 8589936664 rc 0/0 00000100:00100000:2.0:1746066758.602753:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16325 00000100:00100000:1.0:1746066758.602806:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983302272 00000100:00100000:1.0:1746066758.602813:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983302272 00000100:00100000:1.0:1746066758.602842:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5964 00000100:00100000:1.0:1746066758.602848:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+18:769:x1830882983302272:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:1.0:1746066758.603329:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+19:769:x1830882983302272:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 479us (766us total) trans 8589936665 rc 0/0 00000100:00100000:1.0:1746066758.603335:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5964 00000100:00100000:2.0:1746066758.609599:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.609963:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983302400 00000100:00100000:3.0:1746066758.609972:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983302400 00000100:00100000:3.0:1746066758.610021:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16164 00000100:00100000:3.0:1746066758.610030:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+9:779:x1830882983302400:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.610049:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.610068:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cd0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.610101:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.610109:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.610111:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066758.610114:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 10 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.610145:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 10 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.610157:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 10 pid: 1893 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.610290:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984483712:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066758.611236:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.613240:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.613348:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984483712:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.613378:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 10 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.613396:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496e00, rc 0) 00000100:00100000:3.0:1746066758.613455:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:779:x1830882983302400:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3425us (3866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.613465:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16164 00000100:00100000:1.0:1746066758.613538:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983302528 00000100:00100000:1.0:1746066758.613550:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983302528 00002000:00100000:1.0:1746066758.613596:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (4063232->4194303) req@ffff88012bb76680 x1830882983302528/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.613605:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76680 with x1830882983302528 ext(4063232->4194303) 00010000:00010000:1.0:1746066758.613613:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 10 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.613627:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 10 pid: 1893 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746066758.613634:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bb76680 00000100:00100000:1.0:1746066758.613667:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 974 00000100:00100000:1.0:1746066758.613675:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983302528:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:1.0:1746066758.618287:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2013:x1830882983302528:12345-192.168.204.16@tcp:4:cat.0 Request processed in 4605us (5046us total) trans 17179874454 rc 0/0 00000100:00100000:1.0:1746066758.618296:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 974 00002000:00100000:1.0:1746066758.618305:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (4063232->4194303) req@ffff88012bb76680 x1830882983302528/t17179874454(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.618311:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb76680 with x1830882983302528 ext(4063232->4194303) 00010000:00010000:1.0:1746066758.618319:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.618329:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00002000:00010000:1.0:1746066758.618334:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bb76680 00000100:00100000:2.0:1746066758.620376:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.620523:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983302656 00000100:00100000:0.0:1746066758.620534:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983302656 00010000:00010000:0.0:1746066758.620573:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00000100:00100000:3.0:1746066758.621009:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7283 00000100:00100000:3.0:1746066758.621019:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2014:x1830882983302656:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.621035:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066758.621056:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.621068:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.621092:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095750000/0xf1867c21abfa7841 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [4063232->18446744073709551615] (req 4063232->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c8a expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:3.0:1746066758.621120:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.621122:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.621128:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 11 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.621136:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 11 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.621169:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 11 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.621181:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984483840:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066758.621251:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.622721:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.622773:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983302784 00000100:00100000:2.0:1746066758.622782:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983302784 00000100:00100000:2.0:1746066758.622818:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16165 00000100:00100000:2.0:1746066758.622825:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:783:x1830882983302784:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066758.622843:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.622858:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cd7 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.622914:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.622923:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.622929:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.622935:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.622936:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.622939:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1134592->1507327] (req 1134592->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.622971:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 11 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.622984:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 11 pid: 1893 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066758.622994:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984483968:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.623178:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 8 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.623187:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 8 pid: 9591 timeout: 826 lvb_type: 1 00000100:00100000:2.0:1746066758.623195:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484096:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.623222:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 29 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.623228:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 29 pid: 9591 timeout: 826 lvb_type: 0 00000100:00100000:2.0:1746066758.623236:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484224:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.623254:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.628862:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.629480:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984483840:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.629569:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984483968:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.629581:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484096:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.629589:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484224:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.629615:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1134592->1507327] (req 1134592->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.629632:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094418800, rc 0) 00000100:00100000:2.0:1746066758.629684:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:783:x1830882983302784:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6859us (6971us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.629693:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16165 00000100:00100000:0.0:1746066758.630084:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.630103:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.630149:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.630328:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983302912 00000100:00100000:1.0:1746066758.630336:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983302912 00010000:00010000:1.0:1746066758.630363:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 9 pid: 9591 timeout: 826 lvb_type: 1 00000100:00100000:1.0:1746066758.630385:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983303296 00000100:00100000:1.0:1746066758.630387:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983303296 00010000:00010000:1.0:1746066758.630396:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.630406:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983303424 00000100:00100000:1.0:1746066758.630408:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983303424 00010000:00010000:1.0:1746066758.630415:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 29 pid: 9591 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.630425:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7284 00000100:00100000:1.0:1746066758.630430:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2013:x1830882983302912:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.630454:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.630473:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 9 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.630481:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 9 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.630504:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cf6400/0xf1867c21abfa7864 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c98 expref: 9 pid: 9591 timeout: 826 lvb_type: 1 00010000:00010000:1.0:1746066758.630519:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.630539:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2013:x1830882983302912:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.630545:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7284 00000100:00100000:1.0:1746066758.630555:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7285 00000100:00100000:1.0:1746066758.630559:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+12:2015:x1830882983303296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.630566:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.630572:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.630584:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.630595:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497e00/0xf1867c21abfa7753 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c21 expref: 12 pid: 1893 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.630603:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.630616:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983303296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 56us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.630621:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7285 00000100:00100000:1.0:1746066758.630629:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7286 00000100:00100000:1.0:1746066758.630633:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983303424:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.630638:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.630644:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 29 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.630652:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 29 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.630662:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984ba800/0xf1867c21abfa7737 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c05 expref: 29 pid: 9591 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.630669:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.630671:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.630677:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.630686:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.630713:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.630724:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984484352:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.630776:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.630798:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983303168 00000100:00100000:1.0:1746066758.630801:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983303168 00002000:00100000:1.0:1746066758.630827:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012bb75f80 x1830882983303168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.630836:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75f80 with x1830882983303168 ext(3145728->4194303) 00002000:00010000:1.0:1746066758.630840:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb75f80 00000100:00100000:1.0:1746066758.630862:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4353 00000100:00100000:1.0:1746066758.630868:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983303168:12345-192.168.204.16@tcp:3:cat.0 00010000:00010000:3.0:1746066758.633193:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066758.633265:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+12:2014:x1830882983302656:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 12239us (12891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.633275:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7283 00000100:00100000:0.0:1746066758.636023:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.636287:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984484352:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.636306:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.636347:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983303424:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5713us (6197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.636356:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7286 00000100:00100000:2.0:1746066758.636622:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983303680 00000100:00100000:2.0:1746066758.636629:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983303680 00002000:00100000:2.0:1746066758.636666:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1134592->1138687) req@ffff88012bb74380 x1830882983303680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.636676:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74380 with x1830882983303680 ext(1134592->1138687) 00002000:00010000:2.0:1746066758.636681:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74380 00000100:00100000:2.0:1746066758.637867:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4354 00000100:00100000:2.0:1746066758.637879:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983303680:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066758.638045:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983303680:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 169us (2030us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066758.638051:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4354 00002000:00100000:2.0:1746066758.638057:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1134592->1138687) req@ffff88012bb74380 x1830882983303680/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.638065:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb74380 with x1830882983303680 ext(1134592->1138687) 00002000:00010000:2.0:1746066758.638069:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb74380 00000100:00100000:1.0:1746066758.638513:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983303168:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7644us (8429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066758.638522:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4353 00002000:00100000:1.0:1746066758.638526:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff88012bb75f80 x1830882983303168/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.638533:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bb75f80 with x1830882983303168 ext(3145728->4194303) 00002000:00010000:1.0:1746066758.638537:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bb75f80 00000100:00100000:1.0:1746066758.644065:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.644126:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.644565:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983303936 00000100:00100000:2.0:1746066758.644575:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983303936 00002000:00100000:2.0:1746066758.644619:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1503232->1507327) req@ffff88009c7fed80 x1830882983303936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.644628:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fed80 with x1830882983303936 ext(1503232->1507327) 00002000:00010000:2.0:1746066758.644634:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fed80 00000100:00100000:2.0:1746066758.645054:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4355 00000100:00100000:2.0:1746066758.645062:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983303936:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066758.645206:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+28:2014:x1830882983303936:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 145us (1153us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066758.645212:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4355 00002000:00100000:2.0:1746066758.645217:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1503232->1507327) req@ffff88009c7fed80 x1830882983303936/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.645224:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fed80 with x1830882983303936 ext(1503232->1507327) 00002000:00010000:2.0:1746066758.645227:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fed80 00000100:00100000:3.0:1746066758.645336:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983304064 00000100:00100000:3.0:1746066758.645339:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983304064 00000100:00100000:3.0:1746066758.645365:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16166 00000100:00100000:3.0:1746066758.645369:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983304064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.647007:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.647026:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa78c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cde expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.647084:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484480:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066758.647179:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.652508:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.652629:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484480:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.652664:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa78c6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cde expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.652684:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa78c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cde expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.652710:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497400, rc 0) 00000100:00100000:3.0:1746066758.652763:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983304064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7391us (8635us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.652771:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16166 00000100:00100000:0.0:1746066758.653937:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983304320 00000100:00100000:0.0:1746066758.653946:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983304320 00000100:00100000:0.0:1746066758.653984:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5965 00000100:00100000:0.0:1746066758.653992:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+41:783:x1830882983304320:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:0.0:1746066758.654178:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+42:783:x1830882983304320:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 187us (1681us total) trans 8589936666 rc 0/0 00000100:00100000:0.0:1746066758.654184:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5965 00000100:00100000:3.0:1746066758.657138:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.657243:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983304576 00000100:00100000:0.0:1746066758.657253:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983304576 00002000:00100000:0.0:1746066758.657296:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff880095cee680 x1830882983304576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.657306:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cee680 with x1830882983304576 ext(5029888->5033983) 00002000:00010000:0.0:1746066758.657311:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cee680 00000100:00100000:0.0:1746066758.657339:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4356 00000100:00100000:0.0:1746066758.657345:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983304576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.657501:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+20:2015:x1830882983304576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 155us (370us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066758.657507:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4356 00002000:00100000:0.0:1746066758.657513:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (5029888->5033983) req@ffff880095cee680 x1830882983304576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.657520:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cee680 with x1830882983304576 ext(5029888->5033983) 00002000:00010000:0.0:1746066758.657523:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cee680 00000100:00100000:0.0:1746066758.659021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.659234:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983304704 00000100:00100000:3.0:1746066758.659240:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983304704 00000100:00100000:3.0:1746066758.659269:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16167 00000100:00100000:3.0:1746066758.659274:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983304704:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.659288:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.659304:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497800/0xf1867c21abfa78cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ce5 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.659351:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484608:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066758.659428:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.660384:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484608:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.660407:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497800/0xf1867c21abfa78cd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ce5 expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.660419:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497800/0xf1867c21abfa78cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ce5 expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.661365:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497800, rc 0) 00000100:00100000:3.0:1746066758.661421:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983304704:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2145us (2404us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.661428:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16167 00000100:00100000:2.0:1746066758.664620:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.665226:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983304832 00000100:00100000:3.0:1746066758.665238:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983304832 00000100:00100000:3.0:1746066758.665293:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16168 00000100:00100000:3.0:1746066758.665300:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983304832:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.665323:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.665341:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa78d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cec expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.665394:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484736:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066758.665497:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.668836:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.669058:0:10125:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983305088 00000100:00100000:2.0:1746066758.669067:0:10125:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983305088 00000100:00100000:2.0:1746066758.669120:0:10125:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16326 00000100:00100000:2.0:1746066758.669129:0:10125:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+42:789:x1830882983305088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.669156:0:10125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.669174:0:10125:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa78db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cf3 expref: -99 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.669282:0:10125:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa78e2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.669296:0:10125:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa78e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10125 initiator: MDT0 00010000:00010000:2.0:1746066758.669307:0:10125:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa78e2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10125 initiator: MDT0 00000004:00200000:2.0:1746066758.669318:0:10125:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066758.669412:0:10125:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2400/0xf1867c21abfa78db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cf3 expref: 45 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.669434:0:10125:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa78e2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cf3 expref: 44 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.669455:0:10125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066758.669458:0:10125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746066758.669462:0:10125:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a3800, rc 0) 00000100:00100000:2.0:1746066758.669522:0:10125:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4a932635-1bad-46b9-b237-470f1d1c8595+44:789:x1830882983305088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 394us (695us total) trans 8589936667 rc 0/0 00000100:00100000:2.0:1746066758.669529:0:10125:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16326 00000100:00100000:3.0:1746066758.669717:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12237:1830882984484736:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.669742:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa78d4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cec expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.669751:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa78d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cec expref: 11 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.669764:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497400, rc 0) 00000100:00100000:3.0:1746066758.669787:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983304832:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4487us (5175us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.669797:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16168 00000100:00100000:0.0:1746066758.673862:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.675012:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.675161:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983305216 00000100:00100000:1.0:1746066758.675172:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983305216 00000100:00100000:1.0:1746066758.675225:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983305344 00000100:00100000:1.0:1746066758.675227:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983305344 00000100:00100000:1.0:1746066758.675360:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16169 00000100:00100000:1.0:1746066758.675368:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983305216:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.675389:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.675408:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1cfa expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.675478:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984484864:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066758.675561:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.675923:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16170 00000100:00100000:3.0:1746066758.675935:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983305344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.675944:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.675954:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d01 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.675967:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.675968:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.675976:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.675990:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 29 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.675999:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098496600, rc 0) 00000100:00100000:3.0:1746066758.676024:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983305344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 95us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.676029:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16170 00002000:00010000:1.0:1746066758.677222:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066758 -> 1746066759 00000100:00100000:1.0:1746066758.677244:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984484864:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066758.677267:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78f0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cfa expref: 25 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.677284:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cfa expref: 25 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.677297:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5400, rc 0) 00000100:00100000:1.0:1746066758.677324:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983305216:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1956us (3471us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066758.677330:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16169 00000100:00100000:1.0:1746066758.682617:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.682689:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983305600 00000100:00100000:0.0:1746066758.682698:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983305600 00002000:00100000:0.0:1746066758.682744:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009c7fe300 x1830882983305600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 504/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.682753:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fe300 with x1830882983305600 ext(1048576->2097151) 00002000:00010000:0.0:1746066758.682759:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fe300 00000100:00100000:2.0:1746066758.683916:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4357 00000100:00100000:2.0:1746066758.683929:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983305600:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.690170:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983305600:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6233us (7551us total) trans 0 rc 675840/675840 00000100:00100000:2.0:1746066758.690182:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4357 00002000:00100000:2.0:1746066758.690197:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009c7fe300 x1830882983305600/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 504/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 675840/675840 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.690207:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fe300 with x1830882983305600 ext(1048576->2097151) 00002000:00010000:2.0:1746066758.690213:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c7fe300 00000100:00100000:0.0:1746066758.698035:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.698154:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983305728 00000100:00100000:1.0:1746066758.698164:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983305728 00000100:00100000:1.0:1746066758.698264:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16171 00000100:00100000:1.0:1746066758.698273:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+24:789:x1830882983305728:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.698294:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.698312:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d08 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.698342:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.698353:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.698355:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.698359:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.698389:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 19 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.698406:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 19 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.698418:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984484992:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.698635:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.700047:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984484992:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.700073:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.700087:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5400, rc 0) 00000100:00100000:1.0:1746066758.700123:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+25:789:x1830882983305728:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1850us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.700129:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16171 00000100:00100000:0.0:1746066758.701058:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.701188:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983305856 00000100:00100000:2.0:1746066758.701198:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983305856 00002000:00100000:2.0:1746066758.701244:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5029887) req@ffff880130d8b800 x1830882983305856/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.701253:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b800 with x1830882983305856 ext(4194304->5029887) 00010000:00010000:2.0:1746066758.701260:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 20 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.701274:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 20 pid: 12237 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066758.701280:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d8b800 00000100:00100000:2.0:1746066758.701320:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 975 00000100:00100000:2.0:1746066758.701327:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+20:2016:x1830882983305856:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066758.710131:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983305856:12345-192.168.204.16@tcp:4:cat.0 Request processed in 8792us (9062us total) trans 21474841905 rc 0/0 00000100:00100000:2.0:1746066758.710142:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 975 00002000:00100000:2.0:1746066758.710153:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5029887) req@ffff880130d8b800 x1830882983305856/t21474841905(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.710162:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b800 with x1830882983305856 ext(4194304->5029887) 00010000:00010000:2.0:1746066758.710172:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 22 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:2.0:1746066758.710189:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 22 pid: 12237 timeout: 826 lvb_type: 0 00002000:00010000:2.0:1746066758.710196:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130d8b800 00000100:00100000:0.0:1746066758.713544:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.713675:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983305984 00000100:00100000:1.0:1746066758.713685:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983305984 00010000:00010000:1.0:1746066758.713724:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 22 pid: 12237 timeout: 826 lvb_type: 0 00000100:00100000:1.0:1746066758.713776:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7287 00000100:00100000:1.0:1746066758.713785:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983305984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.713801:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.713823:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 22 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.713840:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 22 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.713865:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f9e00/0xf1867c21abfa788e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5029887) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc2 expref: 22 pid: 12237 timeout: 826 lvb_type: 0 00010000:00010000:1.0:1746066758.713907:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.713909:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.713916:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.713925:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.713958:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.713971:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984485120:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.714066:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.715642:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984485120:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.715658:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.715758:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882983305984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1973us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.715767:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7287 00000100:00100000:0.0:1746066758.722725:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.723021:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.723106:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983306240 00000100:00100000:1.0:1746066758.723116:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983306240 00002000:00100000:1.0:1746066758.723165:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880130d88a80 x1830882983306240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.723175:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88a80 with x1830882983306240 ext(2097152->4194303) 00002000:00010000:1.0:1746066758.723181:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d88a80 00000100:00100000:1.0:1746066758.723211:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983306496 00000100:00100000:1.0:1746066758.723214:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983306496 00002000:00100000:1.0:1746066758.723227:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880130d8ad80 x1830882983306496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.723233:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8ad80 with x1830882983306496 ext(2097152->4194303) 00002000:00010000:1.0:1746066758.723236:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8ad80 00000100:00100000:1.0:1746066758.723249:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4358 00000100:00100000:1.0:1746066758.723256:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983306240:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.723417:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4359 00000100:00100000:2.0:1746066758.723424:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983306496:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066758.742895:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983306240:12345-192.168.204.16@tcp:3:cat.0 Request processed in 19614us (20157us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066758.742909:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4358 00002000:00100000:1.0:1746066758.742923:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff880130d88a80 x1830882983306240/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.742933:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d88a80 with x1830882983306240 ext(2097152->4194303) 00002000:00010000:1.0:1746066758.742940:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d88a80 00000100:00100000:2.0:1746066758.753587:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983306496:12345-192.168.204.16@tcp:3:cat.0 Request processed in 30151us (30554us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746066758.753601:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4359 00002000:00100000:2.0:1746066758.753614:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff880130d8ad80 x1830882983306496/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.753624:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8ad80 with x1830882983306496 ext(2097152->4194303) 00002000:00010000:2.0:1746066758.753631:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130d8ad80 00000100:00100000:0.0:1746066758.760803:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.760943:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983306752 00000100:00100000:2.0:1746066758.760953:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983306752 00002000:00100000:2.0:1746066758.760997:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880130d8b480 x1830882983306752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.761007:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b480 with x1830882983306752 ext(4194304->5033983) 00002000:00010000:2.0:1746066758.761012:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d8b480 00000100:00100000:2.0:1746066758.761043:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4360 00000100:00100000:2.0:1746066758.761050:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983306752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.765712:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983306752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4651us (4909us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746066758.765723:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4360 00002000:00100000:2.0:1746066758.765735:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880130d8b480 x1830882983306752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.765744:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8b480 with x1830882983306752 ext(4194304->5033983) 00002000:00010000:2.0:1746066758.765751:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130d8b480 00000100:00100000:0.0:1746066758.801787:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.801953:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983307008 00000100:00100000:2.0:1746066758.801964:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983307008 00000100:00100000:2.0:1746066758.802011:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16327 00000100:00100000:2.0:1746066758.802020:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+19:794:x1830882983307008:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.802046:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.802066:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa7905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d0f expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.802140:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802152:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802163:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802173:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802178:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802183:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802269:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802277:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802281:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066758.802288:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066758.802351:0:7245:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802357:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802363:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802369:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802374:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094419200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066758.802378:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802384:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802395:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066758.802398:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066758.802402:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802410:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419200/0xf1867c21abfa790c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802447:0:7245:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802452:0:7245:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802455:0:7245:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802459:0:7245:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094419800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066758.802462:0:7245:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802466:0:7245:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802471:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9e00) 00010000:00010000:2.0:1746066758.802473:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066758.802475:0:7245:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802479:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419800/0xf1867c21abfa7913 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.802512:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa7905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.802524:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 21 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.802534:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066758.802535:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066758.802537:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419600, rc 0) 00000100:00100000:2.0:1746066758.804650:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+21:794:x1830882983307008:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2619us (2862us total) trans 8589936668 rc 0/0 00000100:00100000:2.0:1746066758.804661:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16327 00000100:00100000:0.0:1746066758.808421:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.809173:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983307264 00000100:00100000:1.0:1746066758.809183:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983307264 00000100:00100000:1.0:1746066758.809240:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5966 00000100:00100000:1.0:1746066758.809247:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+21:794:x1830882983307264:12345-192.168.204.16@tcp:35:cat.0 00000100:00100000:1.0:1746066758.809477:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:794:x1830882983307264:12345-192.168.204.16@tcp:35:cat.0 Request processed in 228us (1065us total) trans 8589936669 rc 0/0 00000100:00100000:1.0:1746066758.809485:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5966 00000100:00100000:0.0:1746066758.811840:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.811935:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983307392 00000100:00100000:1.0:1746066758.811944:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983307392 00000100:00100000:1.0:1746066758.812003:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16172 00000100:00100000:1.0:1746066758.812011:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983307392:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.812031:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.812049:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4000/0xf1867c21abfa7928 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d16 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.812121:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984485248:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066758.812218:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.813493:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.813544:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983307520 00000100:00100000:2.0:1746066758.813551:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983307520 00000100:00100000:2.0:1746066758.813599:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16173 00000100:00100000:2.0:1746066758.813606:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+21:2014:x1830882983307520:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.813618:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.813632:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d1d expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.813647:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.813649:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.813657:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 22 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.813675:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 22 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.813685:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094419000, rc 0) 00000100:00100000:2.0:1746066758.813718:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983307520:12345-192.168.204.16@tcp:101:cat.0 Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.813724:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16173 00000100:00100000:1.0:1746066758.817962:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984485248:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066758.818002:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4000/0xf1867c21abfa7928 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d16 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.818016:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4000/0xf1867c21abfa7928 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d16 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.818041:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4000, rc 0) 00000100:00100000:1.0:1746066758.818101:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983307392:12345-192.168.204.16@tcp:101:cat.0 Request processed in 6089us (6268us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066758.818109:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16172 00000100:00100000:0.0:1746066758.824575:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.824646:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983307648 00000100:00100000:1.0:1746066758.824656:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983307648 00000100:00100000:1.0:1746066758.824716:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16174 00000100:00100000:1.0:1746066758.824725:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:794:x1830882983307648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066758.824744:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.824762:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d24 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.824793:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.824801:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.824803:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.824806:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.824837:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 28 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.824849:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 28 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.824862:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984485376:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.826219:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.830284:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.830583:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984485376:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.830616:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.830634:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe4200, rc 0) 00000100:00100000:1.0:1746066758.830680:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+11:794:x1830882983307648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5955us (6115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.830687:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983307776 00000100:00100000:1.0:1746066758.830690:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16174 00000100:00100000:2.0:1746066758.830695:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983307776 00002000:00100000:2.0:1746066758.830731:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1134592->1507327) req@ffff880130d8aa00 x1830882983307776/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.830740:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8aa00 with x1830882983307776 ext(1134592->1507327) 00010000:00010000:2.0:1746066758.830747:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 29 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066758.830759:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 29 pid: 12237 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066758.830764:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d8aa00 00000100:00100000:2.0:1746066758.830785:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 976 00000100:00100000:2.0:1746066758.830791:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983307776:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066758.836377:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983307776:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5573us (6093us total) trans 17179874455 rc 0/0 00000100:00100000:2.0:1746066758.836391:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 976 00002000:00100000:2.0:1746066758.836403:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1134592->1507327) req@ffff880130d8aa00 x1830882983307776/t17179874455(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.836412:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130d8aa00 with x1830882983307776 ext(1134592->1507327) 00010000:00010000:2.0:1746066758.836423:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 31 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066758.836447:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 31 pid: 12237 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066758.836459:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130d8aa00 00000100:00100000:0.0:1746066758.838317:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.838458:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983308032 00000100:00100000:2.0:1746066758.838468:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983308032 00000100:00100000:2.0:1746066758.838528:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16328 00000100:00100000:2.0:1746066758.838538:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+22:796:x1830882983308032:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066758.838565:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.838585:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa793d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d2b expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.838692:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.838708:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 43 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.838714:0:7245:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.838721:0:7245:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.838752:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.838763:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 23 pid: 7245 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066758.838774:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984485504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.839811:0:7245:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 43 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.839827:0:7245:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 43 pid: 10125 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066758.839836:0:7245:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984485632:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066758.839866:0:7245:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.840149:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.840197:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983308160 00000100:00100000:1.0:1746066758.840203:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983308160 00010000:00010000:1.0:1746066758.840230:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 31 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.840256:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7288 00000100:00100000:1.0:1746066758.840262:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983308160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.840273:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.840291:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 31 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066758.840303:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 31 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066758.840332:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094418800/0xf1867c21abfa78bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1507327) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd7 expref: 31 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066758.840351:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.840353:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.840360:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.840368:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.840390:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066758.840399:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984485760:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.840936:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984485504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.841142:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.841599:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.841632:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.841677:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983308416 00000100:00100000:1.0:1746066758.841682:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983308416 00010000:00010000:1.0:1746066758.841701:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 44 pid: 10125 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.841719:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983308288 00000100:00100000:1.0:1746066758.841721:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983308288 00010000:00010000:1.0:1746066758.841729:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.841742:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7289 00000100:00100000:1.0:1746066758.841747:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983308416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.841760:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.841765:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 44 pid: 10125 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066758.841772:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 44 pid: 10125 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066758.841780:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7290 00010000:00010000:1.0:1746066758.841788:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000100:00100000:3.0:1746066758.841789:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983308288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.841792:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.841797:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.841800:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.841802:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066758.841809:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066758.841812:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.841825:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419600/0xf1867c21abfa791a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d0f expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.841832:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc83050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+44:2013:x1830882983308416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 84us (236us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066758.841836:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094419400/0xf1867c21abfa78aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cc9 expref: 44 pid: 10125 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.841839:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00000100:00100000:1.0:1746066758.841839:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7289 00010000:00010000:3.0:1746066758.841842:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.841849:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00010000:00010000:3.0:1746066758.841854:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7245 initiator: MDT0 00000100:00100000:2.0:1746066758.841859:0:7245:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7245:1830882984485632:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.841866:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066758.841877:0:7245:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066758.841903:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983308288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (251us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066758.841903:0:7245:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000100:00100000:3.0:1746066758.841908:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7290 00010000:00010000:2.0:1746066758.841908:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066758.841925:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066758.842030:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa793d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 24 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.842042:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 23 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.842054:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066758.842056:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066758.842058:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2600, rc 0) 00000100:00100000:2.0:1746066758.842100:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+23:796:x1830882983308032:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 3564us (3792us total) trans 8589936670 rc 0/0 00000100:00100000:2.0:1746066758.842107:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16328 00000100:00100000:1.0:1746066758.844863:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16766:1830882984485760:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.844901:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.845173:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983308160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4867us (4980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.845184:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7288 00000100:00100000:2.0:1746066758.845635:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.845816:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983308544 00000100:00100000:1.0:1746066758.845823:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983308544 00000100:00100000:1.0:1746066758.845869:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16175 00000100:00100000:1.0:1746066758.845875:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+22:796:x1830882983308544:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.845909:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.845926:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d32 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.845952:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.845960:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.845966:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.845967:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.845971:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2523136->2559999] (req 2523136->2559999) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.845999:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.846011:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 23 pid: 9591 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066758.846024:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984485888:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.846099:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.846108:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 24 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.846116:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984486016:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.846134:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.851668:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.851742:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983308800 00000100:00100000:1.0:1746066758.851744:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984485888:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066758.851752:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.851753:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983308800 00000100:00100000:1.0:1746066758.851756:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984486016:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066758.851784:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066758.851787:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2523136->2559999] (req 2523136->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066758.851798:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012b54ca80 x1830882983308800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746066758.851805:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5800, rc 0) 00000100:00100000:0.0:1746066758.851805:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983309056 00002000:00100000:3.0:1746066758.851807:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ca80 with x1830882983308800 ext(1048576->2097151) 00000100:00100000:0.0:1746066758.851810:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983309056 00002000:00010000:3.0:1746066758.851813:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54ca80 00000100:00100000:3.0:1746066758.851831:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4361 00010000:00010000:0.0:1746066758.851833:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 25 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066758.851838:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983308800:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066758.851852:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+23:796:x1830882983308544:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5976us (6222us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.851863:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16175 00000100:00100000:0.0:1746066758.851867:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983308928 00000100:00100000:0.0:1746066758.851869:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983308928 00010000:00010000:0.0:1746066758.851877:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 23 pid: 9591 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066758.851911:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7291 00000100:00100000:0.0:1746066758.851916:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7292 00000100:00100000:1.0:1746066758.851919:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+25:2013:x1830882983309056:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066758.851922:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2013:x1830882983308928:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.851930:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066758.851930:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.851947:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 25 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066758.851947:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 23 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066758.851956:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 25 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066758.851967:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 23 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066758.851987:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5400/0xf1867c21abfa78fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d08 expref: 25 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066758.852000:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094419000/0xf1867c21abfa792f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d1d expref: 23 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066758.852007:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.852009:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.852016:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.852024:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.852032:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066758.852052:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2013:x1830882983308928:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 130us (268us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066758.852054:0:16766:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066758.852058:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7292 00000100:00100000:1.0:1746066758.852065:0:16766:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984486144:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066758.852120:0:16766:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.862961:0:16766:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16766:1830882984486144:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066758.862986:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.863030:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+24:2013:x1830882983309056:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 11111us (11276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.863041:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7291 00000100:00100000:0.0:1746066758.863852:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.864142:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983309312 00000100:00100000:2.0:1746066758.864149:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983309312 00002000:00100000:2.0:1746066758.864187:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2523136->2527231) req@ffff88012b54f800 x1830882983309312/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.864197:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54f800 with x1830882983309312 ext(2523136->2527231) 00002000:00010000:2.0:1746066758.864201:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54f800 00000100:00100000:2.0:1746066758.864224:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4362 00000100:00100000:2.0:1746066758.864230:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983309312:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066758.864349:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983309312:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 117us (497us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066758.864354:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4362 00002000:00100000:2.0:1746066758.864359:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2523136->2527231) req@ffff88012b54f800 x1830882983309312/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.865716:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54f800 with x1830882983309312 ext(2523136->2527231) 00002000:00010000:2.0:1746066758.865720:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54f800 00000100:00100000:3.0:1746066758.866979:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983308800:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15134us (15314us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066758.866991:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4361 00002000:00100000:3.0:1746066758.867001:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012b54ca80 x1830882983308800/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.867008:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ca80 with x1830882983308800 ext(1048576->2097151) 00002000:00010000:3.0:1746066758.867013:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54ca80 00000100:00100000:0.0:1746066758.869627:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.869776:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983309568 00000100:00100000:3.0:1746066758.869787:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983309568 00002000:00100000:3.0:1746066758.869836:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2555904->2559999) req@ffff88012b54c700 x1830882983309568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.869846:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c700 with x1830882983309568 ext(2555904->2559999) 00002000:00010000:3.0:1746066758.869852:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c700 00000100:00100000:3.0:1746066758.870262:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4363 00000100:00100000:3.0:1746066758.870271:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983309568:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066758.870431:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983309568:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 160us (815us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066758.870449:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4363 00002000:00100000:3.0:1746066758.870455:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2555904->2559999) req@ffff88012b54c700 x1830882983309568/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.870462:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c700 with x1830882983309568 ext(2555904->2559999) 00002000:00010000:3.0:1746066758.870464:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c700 00000100:00100000:0.0:1746066758.876089:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.876196:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983309824 00000100:00100000:2.0:1746066758.876207:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983309824 00000100:00100000:2.0:1746066758.876255:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16329 00000100:00100000:2.0:1746066758.876262:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+43:798:x1830882983309824:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066758.876289:0:7245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.876306:0:7245:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfa7959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d39 expref: -99 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.876411:0:7245:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.876425:0:7245:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7245 initiator: MDT0 00010000:00010000:2.0:1746066758.876548:0:7245:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7245 initiator: MDT0 00000004:00200000:2.0:1746066758.876562:0:7245:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066758.876666:0:7245:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d06a00/0xf1867c21abfa7959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 46 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.876700:0:7245:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 45 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.876707:0:7245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066758.876710:0:7245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066758.876713:0:7245:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07e00, rc 0) 00000100:00100000:2.0:1746066758.876767:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+45:798:x1830882983309824:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 504us (689us total) trans 8589936671 rc 0/0 00000100:00100000:2.0:1746066758.876773:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16329 00000100:00100000:0.0:1746066758.879577:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.879632:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983310080 00000100:00100000:2.0:1746066758.879641:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983310080 00002000:00100000:2.0:1746066758.879763:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012b54c000 x1830882983310080/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 504/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.879774:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c000 with x1830882983310080 ext(2097152->4194303) 00002000:00010000:2.0:1746066758.879780:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c000 00000100:00100000:2.0:1746066758.879809:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4364 00000100:00100000:2.0:1746066758.879818:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983310080:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066758.880566:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.880673:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983310208 00000100:00100000:1.0:1746066758.880677:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983310208 00000100:00100000:1.0:1746066758.880770:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16176 00000100:00100000:1.0:1746066758.880776:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:798:x1830882983310208:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.880787:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.880803:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d40 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.880829:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 10 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.880837:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 7 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.880844:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.880849:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.880851:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.880854:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 31 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.880902:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.880915:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 31 pid: 12237 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066758.880925:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984486272:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.881010:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 7 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.881018:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 7 pid: 9591 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066758.881025:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984486400:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.881046:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 10 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.881053:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 10 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.881060:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984486528:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.881073:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854840 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.886104:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984486272:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066758.888173:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.888199:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.888226:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983310336 00000100:00100000:0.0:1746066758.888234:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983310336 00000100:00100000:2.0:1746066758.888252:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983310464 00000100:00100000:2.0:1746066758.888263:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983310464 00010000:00010000:0.0:1746066758.888268:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 8 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066758.888297:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 32 pid: 12237 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746066758.888330:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7293 00000100:00100000:2.0:1746066758.888337:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983310336:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.888351:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.888367:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 8 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066758.888378:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 8 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066758.888398:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.888460:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983310336:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 122us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.888466:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7293 00000100:00100000:2.0:1746066758.888481:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7294 00000100:00100000:2.0:1746066758.888486:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+32:2014:x1830882983310464:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.888504:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.888511:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 32 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066758.888519:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 32 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066758.888530:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c185800/0xf1867c21abfa7642 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b8e expref: 32 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066758.888548:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.888561:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983310464:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.888567:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7294 00010000:00010000:1.0:1746066758.888931:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097cf7800/0xf1867c21abfa784f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c9f expref: 7 pid: 9591 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066758.888962:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984486400:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.889007:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984486528:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.889034:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.889048:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe5600, rc 0) 00000100:00100000:1.0:1746066758.889076:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+30:798:x1830882983310208:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8300us (8511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.889083:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16176 00000100:00100000:1.0:1746066758.889145:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.889192:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983310592 00000100:00100000:2.0:1746066758.889197:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983310592 00010000:00010000:2.0:1746066758.889211:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066758.889229:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7295 00000100:00100000:2.0:1746066758.889234:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983310592:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066758.889241:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066758.889248:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066758.889261:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066758.889273:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2de00/0xf1867c21abfa7618 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b4f expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066758.889282:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.889283:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066758.889289:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.889296:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.889321:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066758.889331:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984486656:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.889384:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.891785:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7231:1830882984486656:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066758.891803:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.891850:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983310592:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2614us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.891860:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7295 00000100:00100000:0.0:1746066758.892986:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.893044:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983310848 00000100:00100000:3.0:1746066758.893052:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983310848 00002000:00100000:3.0:1746066758.893090:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1986560->1990655) req@ffff88012b54e300 x1830882983310848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.893106:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54e300 with x1830882983310848 ext(1986560->1990655) 00002000:00010000:3.0:1746066758.893111:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54e300 00000100:00100000:3.0:1746066758.893138:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4365 00000100:00100000:3.0:1746066758.893144:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983310848:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066758.893254:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:2015:x1830882983310080:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13399us (13648us total) trans 0 rc 2060288/2060288 00000100:00100000:2.0:1746066758.893262:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4364 00002000:00100000:2.0:1746066758.893268:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012b54c000 x1830882983310080/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 504/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 2060288/2060288 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.893276:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54c000 with x1830882983310080 ext(2097152->4194303) 00002000:00010000:2.0:1746066758.893279:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54c000 00000100:00100000:3.0:1746066758.893964:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983310848:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 103us (263us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066758.893973:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4365 00002000:00100000:3.0:1746066758.893980:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1986560->1990655) req@ffff88012b54e300 x1830882983310848/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.893988:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54e300 with x1830882983310848 ext(1986560->1990655) 00002000:00010000:3.0:1746066758.893991:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54e300 00000100:00100000:0.0:1746066758.895824:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.895980:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983310976 00000100:00100000:1.0:1746066758.895989:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983310976 00000100:00100000:1.0:1746066758.896163:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16177 00000100:00100000:1.0:1746066758.896172:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+24:798:x1830882983310976:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066758.896193:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.896212:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d47 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.896242:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.896290:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.896301:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.896308:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.896310:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066758.896313:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.896347:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 25 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.896360:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 25 pid: 11630 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.896372:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984486784:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.896578:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 21 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.896587:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 21 pid: 11630 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.896596:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984486912:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.896621:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 13 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066758.896634:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 13 pid: 9591 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066758.896642:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984487040:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066758.896660:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.896793:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.896856:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983311104 00000100:00100000:3.0:1746066758.896860:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983311104 00000100:00100000:3.0:1746066758.896962:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16178 00000100:00100000:3.0:1746066758.896969:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983311104:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066758.897053:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.897076:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983311232 00000100:00100000:2.0:1746066758.897080:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983311232 00000100:00100000:2.0:1746066758.897110:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16179 00000100:00100000:2.0:1746066758.897115:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983311232:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.897122:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.897122:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.897130:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d4e expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.897130:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfa797c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d55 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.897143:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.897144:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.897150:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066758.897159:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984487168:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.897162:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 31 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.897172:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497200, rc 0) 00000100:00100000:3.0:1746066758.897193:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882983311104:12345-192.168.204.16@tcp:101:cat.0 Request processed in 224us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.897195:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.897199:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16178 00000100:00100000:3.0:1746066758.900497:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9591:1830882984487168:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.900529:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfa797c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d55 expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066758.900534:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066758.900543:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07600/0xf1867c21abfa797c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d55 expref: 27 pid: 9591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066758.900554:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:3.0:1746066758.900569:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07600, rc 0) 00000100:00100000:3.0:1746066758.900761:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983311232:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3643us (3705us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.900769:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16179 00000100:00100000:0.0:1746066758.900770:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983311488 00000100:00100000:0.0:1746066758.900778:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983311488 00010000:00010000:0.0:1746066758.900805:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 14 pid: 9591 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746066758.900834:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983311360 00000100:00100000:0.0:1746066758.900836:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983311360 00010000:00010000:0.0:1746066758.900847:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 22 pid: 11630 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.900988:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7296 00000100:00100000:1.0:1746066758.900996:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983311488:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066758.901011:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066758.901022:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 14 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066758.901032:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 14 pid: 9591 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066758.901056:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066758.901072:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983311488:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066758.901078:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7296 00000100:00100000:1.0:1746066758.901142:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.901192:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7297 00000100:00100000:0.0:1746066758.901197:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983311360:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066758.901204:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066758.901211:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 22 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066758.901223:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 22 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066758.901235:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066758.901249:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983311360:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066758.901255:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7297 00000100:00100000:3.0:1746066758.901331:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983311744 00000100:00100000:3.0:1746066758.901335:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983311744 00000100:00100000:3.0:1746066758.901353:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16180 00000100:00100000:3.0:1746066758.901358:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983311744:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.901370:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066758.901381:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa798a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d63 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.901397:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.901404:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa798a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d63 expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.901412:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098497400/0xf1867c21abfa798a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d63 expref: 23 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.901419:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497400, rc 0) 00000100:00100000:3.0:1746066758.901455:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2016:x1830882983311744:12345-192.168.204.16@tcp:101:cat.0 Request processed in 96us (312us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.901460:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16180 00000100:00100000:2.0:1746066758.901681:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984486784:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.901696:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800964b1e00/0xf1867c21abfa763b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b79 expref: 21 pid: 11630 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066758.901808:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984486912:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.901820:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa44c00/0xf1867c21abfa74eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1abc expref: 13 pid: 9591 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746066758.901829:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984487040:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066758.901852:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1114111] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 25 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066758.901861:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d93ce00, rc 0) 00000100:00100000:2.0:1746066758.901982:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+25:798:x1830882983310976:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5811us (6164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.901990:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16177 00000100:00100000:0.0:1746066758.903235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.903363:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.903420:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983311616 00000100:00100000:2.0:1746066758.903426:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983311616 00000100:00100000:3.0:1746066758.903514:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983311872 00000100:00100000:3.0:1746066758.903518:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983311872 00010000:00010000:3.0:1746066758.903535:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 25 pid: 11630 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066758.903931:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7298 00000100:00100000:3.0:1746066758.903938:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983311872:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.903949:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066758.903965:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 25 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.903975:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 25 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.903994:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a576a600/0xf1867c21abfa7603 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b41 expref: 25 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.904013:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.904015:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.904022:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.904029:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.904059:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.904075:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984487296:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066758.904103:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16181 00000100:00100000:2.0:1746066758.904110:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983311616:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.904124:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.904136:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfa7991 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d5c expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.904143:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.904169:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984487424:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066758.904191:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00002000:00010000:2.0:1746066758.905766:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066758 -> 1746066759 00000100:00100000:3.0:1746066758.905767:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984487296:192.168.204.16@tcp:105: 00002000:00010000:2.0:1746066758.905770:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066758 -> 1746066759 00002000:00010000:2.0:1746066758.905772:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066758 -> 1746066759 00010000:00010000:3.0:1746066758.905785:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066758.905788:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984487424:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066758.905807:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfa7991 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d5c expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066758.905818:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983311872:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1880us (2454us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066758.905819:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d07a00/0xf1867c21abfa7991 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d5c expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066758.905827:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7298 00010000:00010000:2.0:1746066758.905834:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d07a00, rc 0) 00000100:00100000:2.0:1746066758.905855:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983311616:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1746us (2623us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066758.905862:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16181 00000100:00100000:0.0:1746066758.907002:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.907146:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983312128 00000100:00100000:3.0:1746066758.907153:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983312128 00002000:00100000:3.0:1746066758.907192:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1110016->1114111) req@ffff88012b54ed80 x1830882983312128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.907202:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ed80 with x1830882983312128 ext(1110016->1114111) 00002000:00010000:3.0:1746066758.907206:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54ed80 00000100:00100000:3.0:1746066758.907222:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4366 00000100:00100000:3.0:1746066758.907230:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983312128:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066758.907367:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983312128:12345-192.168.204.16@tcp:3:cat.0 Request processed in 136us (367us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066758.907372:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4366 00002000:00100000:3.0:1746066758.907377:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1110016->1114111) req@ffff88012b54ed80 x1830882983312128/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/4536 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.907384:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54ed80 with x1830882983312128 ext(1110016->1114111) 00002000:00010000:3.0:1746066758.907387:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b54ed80 00000100:00100000:0.0:1746066758.909938:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.909977:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.910001:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.910002:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983312512 00000100:00100000:3.0:1746066758.910010:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983312512 00002000:00100000:3.0:1746066758.910051:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1986559) req@ffff88012b54dc00 x1830882983312512/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.910060:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54dc00 with x1830882983312512 ext(1048576->1986559) 00002000:00010000:3.0:1746066758.910065:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54dc00 00000100:00100000:3.0:1746066758.910082:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983312384 00000100:00100000:3.0:1746066758.910084:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983312384 00002000:00100000:3.0:1746066758.910093:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012b54df80 x1830882983312384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.910100:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54df80 with x1830882983312384 ext(1048576->2097151) 00002000:00010000:3.0:1746066758.910103:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54df80 00000100:00100000:2.0:1746066758.910116:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983312896 00000100:00100000:2.0:1746066758.910120:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983312896 00000100:00100000:3.0:1746066758.910121:0:29518:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4367 00000100:00100000:3.0:1746066758.910128:0:29518:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983312512:12345-192.168.204.16@tcp:3:cat.0 00002000:00100000:2.0:1746066758.910140:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c492300 x1830882983312896/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746066758.910141:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4368 00002000:00100000:2.0:1746066758.910148:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492300 with x1830882983312896 ext(4194304->5033983) 00000100:00100000:1.0:1746066758.910149:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983312384:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:2.0:1746066758.910151:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c492300 00000100:00100000:2.0:1746066758.910164:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4369 00000100:00100000:2.0:1746066758.910169:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983312896:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066758.926666:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983312896:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16486us (16654us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066758.926676:0:29518:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882983312512:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16541us (16740us total) trans 0 rc 937984/937984 00000100:00100000:2.0:1746066758.926678:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4369 00002000:00100000:2.0:1746066758.926689:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c492300 x1830882983312896/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066758.926691:0:29518:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4367 00002000:00100000:3.0:1746066758.926700:0:29518:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1986559) req@ffff88012b54dc00 x1830882983312512/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066758.926709:0:29518:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54dc00 with x1830882983312512 ext(1048576->1986559) 00002000:00010000:3.0:1746066758.926715:0:29518:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54dc00 00002000:00100000:2.0:1746066758.927102:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c492300 with x1830882983312896 ext(4194304->5033983) 00002000:00010000:2.0:1746066758.927109:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c492300 00000100:00100000:1.0:1746066758.928799:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882983312384:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18644us (18815us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066758.928809:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4368 00002000:00100000:1.0:1746066758.928818:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012b54df80 x1830882983312384/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.928826:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b54df80 with x1830882983312384 ext(1048576->2097151) 00002000:00010000:1.0:1746066758.928830:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b54df80 00000100:00100000:2.0:1746066758.933936:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.934017:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.934048:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983313024 00000100:00100000:3.0:1746066758.934061:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983313024 00000100:00100000:3.0:1746066758.934118:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983313152 00000100:00100000:3.0:1746066758.934120:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983313152 00000100:00100000:3.0:1746066758.934141:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16182 00000100:00100000:3.0:1746066758.934149:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983313024:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.934168:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746066758.934588:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16183 00010000:00010000:3.0:1746066758.934662:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497800/0xf1867c21abfa7998 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d6a expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.934724:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984487552:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066758.934745:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983313152:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066758.934763:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066758.934778:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfa799f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d71 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.934820:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:2.0:1746066758.934822:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984487680:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066758.934877:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.936020:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066758.936067:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983313408 00000100:00100000:1.0:1746066758.936073:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983313408 00002000:00100000:1.0:1746066758.936106:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1114112->2097151) req@ffff88012c493800 x1830882983313408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.936113:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493800 with x1830882983313408 ext(1114112->2097151) 00002000:00010000:1.0:1746066758.936117:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493800 00000100:00100000:1.0:1746066758.936144:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4370 00000100:00100000:1.0:1746066758.936151:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983313408:12345-192.168.204.16@tcp:3:cat.0 00002000:00010000:2.0:1746066758.936587:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066758 -> 1746066759 00002000:00010000:2.0:1746066758.936591:0:3528:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066758 -> 1746066759 00002000:00010000:2.0:1746066758.936592:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066758 -> 1746066759 00000100:00100000:2.0:1746066758.936601:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984487680:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066758.936623:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfa799f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d71 expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.936633:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d06c00/0xf1867c21abfa799f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d71 expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066758.936645:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d06c00, rc 0) 00000100:00100000:2.0:1746066758.936675:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983313152:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2079us (2658us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066758.936681:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16183 00000100:00100000:3.0:1746066758.937605:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984487552:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.937630:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497800/0xf1867c21abfa7998 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d6a expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.937642:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497800/0xf1867c21abfa7998 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d6a expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.937667:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497800, rc 0) 00000100:00100000:3.0:1746066758.937715:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983313024:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3567us (3785us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.937723:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16182 00000100:00100000:0.0:1746066758.938923:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.938991:0:8138:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983313536 00000100:00100000:2.0:1746066758.938998:0:8138:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983313536 00000100:00100000:0.0:1746066758.939035:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:0.0:1746066758.939042:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882983313536:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:0.0:1746066758.939101:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7e2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882983313536:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 60us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066758.939107:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 185 00000100:00100000:0.0:1746066758.940159:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.940231:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.940276:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983313792 00000100:00100000:2.0:1746066758.940280:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983313792 00000100:00100000:0.0:1746066758.940283:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.940426:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983313664 00000100:00100000:2.0:1746066758.940429:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983313664 00000100:00100000:2.0:1746066758.940459:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 910 00000100:00100000:2.0:1746066758.940466:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882983313792:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066758.940506:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2051f12-252a-4bb3-b8f3-833317fca821+5:2016:x1830882983313792:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.940510:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 910 00000100:00100000:2.0:1746066758.940520:0:7245:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983313920 00000100:00100000:2.0:1746066758.940522:0:7245:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983313920 00000100:00100000:2.0:1746066758.940536:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 911 00000100:00100000:2.0:1746066758.940540:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882983313664:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066758.940560:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a932635-1bad-46b9-b237-470f1d1c8595+365:2016:x1830882983313664:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 19us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.940565:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 911 00000100:00100000:2.0:1746066758.940572:0:7245:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 912 00000100:00100000:2.0:1746066758.940576:0:7245:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882983313920:12345-192.168.204.16@tcp:400:kworker.0 00000100:00100000:2.0:1746066758.940592:0:7245:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2016:x1830882983313920:12345-192.168.204.16@tcp:400:kworker.0 Request processed in 16us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066758.940596:0:7245:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 912 00000100:00080000:3.0:1746066758.940676:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746066758.940750:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2014:x1830882983313408:12345-192.168.204.16@tcp:3:cat.0 Request processed in 4599us (4730us total) trans 0 rc 983040/983040 00000100:00100000:1.0:1746066758.940757:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4370 00002000:00100000:1.0:1746066758.940767:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1114112->2097151) req@ffff88012c493800 x1830882983313408/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.940775:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493800 with x1830882983313408 ext(1114112->2097151) 00002000:00010000:1.0:1746066758.940780:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493800 00000100:00100000:2.0:1746066758.945229:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.945380:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066758.945471:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.945735:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983314048 00000100:00100000:0.0:1746066758.945743:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983314048 00000100:00100000:0.0:1746066758.946290:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983314176 00000100:00100000:0.0:1746066758.946300:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983314176 00000100:00100000:3.0:1746066758.946332:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983314304 00000100:00100000:3.0:1746066758.946336:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983314304 00000100:00100000:3.0:1746066758.946372:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16184 00000100:00100000:3.0:1746066758.946381:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983314048:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066758.946401:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066758.946423:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16185 00000100:00100000:1.0:1746066758.946427:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16186 00000100:00100000:0.0:1746066758.946428:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882983314176:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:1.0:1746066758.946442:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+24:802:x1830882983314304:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066758.946446:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.946451:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066758.946463:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d86 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066758.946463:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfa79a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d7f expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.946491:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.946498:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.946499:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066758.946502:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066758.946519:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984487808:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066758.946521:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 22 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.946531:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 22 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066758.946539:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984487936:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066758.946627:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa79b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d78 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.946654:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984488064:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066758.947598:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066758.947607:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854180 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.947649:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066758.949405:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.949420:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984488064:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066758.949458:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984487808:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066758.949461:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa79b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d78 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.949474:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497400/0xf1867c21abfa79b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d78 expref: 11 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.949474:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfa79a6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d7f expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066758.949481:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a03cd200/0xf1867c21abfa79a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d7f expref: 22 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066758.949488:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098497400, rc 0) 00010000:00010000:0.0:1746066758.949490:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a03cd200, rc 0) 00000100:00100000:3.0:1746066758.949539:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983314048:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3158us (4317us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066758.949547:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16184 00000100:00100000:0.0:1746066758.950450:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+21:2016:x1830882983314176:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4018us (5067us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066758.950531:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984487936:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066758.950552:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066758.950566:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c6200, rc 0) 00000100:00100000:1.0:1746066758.950605:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+25:802:x1830882983314304:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4171us (5134us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066758.951002:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16185 00000100:00100000:2.0:1746066758.951024:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983314432 00000100:00100000:2.0:1746066758.951032:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983314432 00002000:00100000:2.0:1746066758.951070:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2523136->2559999) req@ffff88012c490000 x1830882983314432/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.951079:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490000 with x1830882983314432 ext(2523136->2559999) 00010000:00010000:2.0:1746066758.951086:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 21 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066758.951099:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 21 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066758.951106:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c490000 00000100:00100000:1.0:1746066758.951163:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16186 00000100:00100000:2.0:1746066758.951378:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 977 00000100:00100000:2.0:1746066758.951386:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+21:2015:x1830882983314432:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066758.955318:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983314432:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3922us (5908us total) trans 21474841906 rc 0/0 00000100:00100000:2.0:1746066758.955331:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 977 00002000:00100000:2.0:1746066758.955343:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2523136->2559999) req@ffff88012c490000 x1830882983314432/t21474841906(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:164/0 lens 488/448 e 0 to 0 dl 1746066769 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066758.955353:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490000 with x1830882983314432 ext(2523136->2559999) 00010000:00010000:2.0:1746066758.955363:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066758.955379:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066758.955386:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c490000 00000100:00100000:0.0:1746066758.963235:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066758.963362:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983314560 00000100:00100000:3.0:1746066758.963374:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983314560 00010000:00010000:3.0:1746066758.963413:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066758.963469:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7299 00000100:00100000:3.0:1746066758.963478:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983314560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066758.963493:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066758.963515:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.963527:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.963551:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe5800/0xf1867c21abfa7952 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2523136->2559999) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d32 expref: 23 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066758.963580:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.963582:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066758.963591:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.963599:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066758.963871:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066758.963925:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984488192:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066758.964613:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066758.965922:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984488192:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066758.965942:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066758.965988:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+22:2014:x1830882983314560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2510us (2764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066758.965997:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7299 00000100:00100000:2.0:1746066758.971961:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066758.972601:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983314816 00000100:00100000:0.0:1746066758.972613:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983314816 00002000:00100000:0.0:1746066758.972661:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800a5d83b80 x1830882983314816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/0 e 0 to 0 dl 1746066769 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066758.972676:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83b80 with x1830882983314816 ext(2097152->4194303) 00002000:00010000:0.0:1746066758.972681:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83b80 00000100:00100000:0.0:1746066758.972718:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4371 00000100:00100000:0.0:1746066758.972725:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983314816:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066758.997305:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983314816:12345-192.168.204.16@tcp:3:cat.0 Request processed in 24568us (25346us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746066758.997314:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4371 00002000:00100000:1.0:1746066758.997483:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff8800a5d83b80 x1830882983314816/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:164/0 lens 488/440 e 0 to 0 dl 1746066769 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066758.997492:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d83b80 with x1830882983314816 ext(2097152->4194303) 00002000:00010000:1.0:1746066758.997497:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d83b80 00000100:00100000:0.0:1746066759.006690:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.006917:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983315072 00000100:00100000:1.0:1746066759.006927:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983315072 00002000:00100000:1.0:1746066759.007666:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490380 x1830882983315072/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.007676:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882983315072 ext(4194304->5033983) 00002000:00010000:1.0:1746066759.007681:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490380 00000100:00100000:1.0:1746066759.008120:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4372 00000100:00100000:1.0:1746066759.008130:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983315072:12345-192.168.204.16@tcp:3:cat.0 00000100:00080000:3.0:1746066759.008286:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066759.019445:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983315072:12345-192.168.204.16@tcp:3:cat.0 Request processed in 11295us (12743us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746066759.019457:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4372 00002000:00100000:1.0:1746066759.019469:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012c490380 x1830882983315072/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.019478:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490380 with x1830882983315072 ext(4194304->5033983) 00002000:00010000:1.0:1746066759.019484:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490380 00000100:00100000:0.0:1746066759.045816:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.045926:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983315200 00000100:00100000:1.0:1746066759.045936:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983315200 00000100:00100000:1.0:1746066759.046020:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16187 00000100:00100000:1.0:1746066759.046029:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+22:808:x1830882983315200:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.046049:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.046066:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d8d expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.046096:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.046103:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066759.046105:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066759.046108:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.046137:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 24 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.046148:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 24 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.046160:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984488320:192.168.204.16@tcp:104: 00000100:00080000:3.0:1746066759.046808:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746066759.047412:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.050872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.051012:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984488320:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.051043:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.051067:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0cc00, rc 0) 00000100:00100000:1.0:1746066759.051125:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:808:x1830882983315200:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 5096us (5320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.051134:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16187 00000100:00100000:2.0:1746066759.051218:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983315328 00000100:00100000:2.0:1746066759.051226:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983315328 00002000:00100000:2.0:1746066759.051265:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1114111) req@ffff88012c491880 x1830882983315328/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.051281:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491880 with x1830882983315328 ext(1048576->1114111) 00010000:00010000:2.0:1746066759.051288:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 25 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.051300:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 25 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.051306:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c491880 00000100:00100000:2.0:1746066759.051334:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 978 00000100:00100000:2.0:1746066759.051341:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983315328:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066759.054559:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983315328:12345-192.168.204.16@tcp:4:cat.0 Request processed in 3207us (3687us total) trans 21474841907 rc 0/0 00000100:00100000:2.0:1746066759.054570:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 978 00002000:00100000:2.0:1746066759.054581:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1114111) req@ffff88012c491880 x1830882983315328/t21474841907(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.054590:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c491880 with x1830882983315328 ext(1048576->1114111) 00010000:00010000:2.0:1746066759.054600:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 27 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.054613:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 27 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.054620:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c491880 00000100:00100000:0.0:1746066759.058016:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.058199:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983315456 00000100:00100000:3.0:1746066759.058209:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983315456 00010000:00010000:3.0:1746066759.058246:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 27 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.058274:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7300 00000100:00100000:3.0:1746066759.058281:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983315456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.058296:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.058316:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 27 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.058329:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 27 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.058353:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009d93ce00/0xf1867c21abfa7975 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1114111) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d47 expref: 27 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.058385:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.058388:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.058395:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.058404:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.058446:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 22 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.058458:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984488448:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066759.058702:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.060708:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984488448:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066759.060726:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066759.060740:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.060820:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983315712 00000100:00100000:2.0:1746066759.060828:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983315712 00002000:00100000:2.0:1746066759.060871:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1675264->1679359) req@ffff88012c493480 x1830882983315712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.060909:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882983315712 ext(1675264->1679359) 00002000:00010000:2.0:1746066759.060913:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:2.0:1746066759.060934:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4373 00000100:00100000:2.0:1746066759.060941:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983315712:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066759.061124:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983315456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2783us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.061133:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7300 00000100:00100000:2.0:1746066759.061734:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+23:2015:x1830882983315712:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 792us (994us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066759.061740:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4373 00002000:00100000:2.0:1746066759.061745:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1675264->1679359) req@ffff88012c493480 x1830882983315712/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.061752:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c493480 with x1830882983315712 ext(1675264->1679359) 00002000:00010000:2.0:1746066759.061755:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c493480 00000100:00100000:0.0:1746066759.068251:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.068333:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983315840 00000100:00100000:1.0:1746066759.068343:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983315840 00000100:00100000:1.0:1746066759.068403:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16188 00000100:00100000:1.0:1746066759.068411:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+23:808:x1830882983315840:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.068431:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.068458:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d94 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.068489:0:20361:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.068497:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.068499:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.068503:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->2183167] (req 2097152->2183167) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.068534:0:20361:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 25 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.068747:0:20361:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 25 pid: 20361 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.068765:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984488576:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.069112:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.071102:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20361:1830882984488576:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.071129:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->2183167] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.071144:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0da00, rc 0) 00000100:00100000:1.0:1746066759.071190:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+24:808:x1830882983315840:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2779us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.071197:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16188 00000100:00100000:0.0:1746066759.073786:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.073929:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983315968 00000100:00100000:3.0:1746066759.073939:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983315968 00010000:00010000:3.0:1746066759.073974:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.074015:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7301 00000100:00100000:3.0:1746066759.074022:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983315968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.074037:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.074057:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.074072:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.074094:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c6200/0xf1867c21abfa79ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d86 expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.074118:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.074120:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.074126:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.074133:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.074164:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.074175:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984488704:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066759.074243:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.077470:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7231:1830882984488704:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066759.077494:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.077554:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983315968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3529us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.077564:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7301 00000100:00100000:0.0:1746066759.078079:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.078322:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983316224 00000100:00100000:2.0:1746066759.078330:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983316224 00002000:00100000:2.0:1746066759.078372:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2179072->2183167) req@ffff88012c490a80 x1830882983316224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.078382:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490a80 with x1830882983316224 ext(2179072->2183167) 00002000:00010000:2.0:1746066759.078387:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490a80 00000100:00100000:2.0:1746066759.078418:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4374 00000100:00100000:2.0:1746066759.078426:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983316224:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066759.078561:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+24:2015:x1830882983316224:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 136us (483us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066759.078570:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4374 00002000:00100000:2.0:1746066759.078575:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2179072->2183167) req@ffff88012c490a80 x1830882983316224/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.078582:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c490a80 with x1830882983316224 ext(2179072->2183167) 00002000:00010000:2.0:1746066759.078585:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c490a80 00000100:00100000:0.0:1746066759.100904:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.101309:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983316352 00000100:00100000:3.0:1746066759.101319:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983316352 00000100:00100000:3.0:1746066759.101371:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16330 00000100:00100000:3.0:1746066759.101379:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:819:x1830882983316352:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066759.101402:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.101420:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfa79c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1d9b expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.101499:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101512:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101523:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101535:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101540:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101545:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101625:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101635:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.101642:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 44 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.101650:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.101680:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 44 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.101691:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 44 pid: 7245 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.101701:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984488832:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.101801:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 22 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.101808:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 22 pid: 7245 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.101815:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984488960:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.101833:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.104063:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.104230:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983316608 00000100:00100000:1.0:1746066759.104238:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983316608 00000100:00100000:1.0:1746066759.104280:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5967 00000100:00100000:1.0:1746066759.104285:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:30848:x1830882983316608:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066759.104506:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:30848:x1830882983316608:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 219us (450us total) trans 8589936672 rc 0/0 00000100:00100000:1.0:1746066759.104512:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5967 00000100:00100000:3.0:1746066759.105141:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984488832:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066759.106719:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.106816:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983316864 00000100:00100000:1.0:1746066759.106828:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983316864 00000100:00100000:1.0:1746066759.106926:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5968 00000100:00100000:1.0:1746066759.106934:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:314:x1830882983316864:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746066759.107067:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095ceed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984488960:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.107102:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066759.107136:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:314:x1830882983316864:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 202us (421us total) trans 8589936673 rc 0/0 00000100:00100000:1.0:1746066759.107146:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5968 00000100:00100000:0.0:1746066759.107649:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.108182:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983316992 00000100:00100000:3.0:1746066759.108187:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983316992 00010000:00010000:3.0:1746066759.108212:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 46 pid: 7245 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.108538:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7302 00000100:00100000:3.0:1746066759.108546:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983316992:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.108558:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.108563:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 46 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.108573:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 46 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.108595:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07e00/0xf1867c21abfa7960 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d39 expref: 46 pid: 7245 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746066759.109502:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.109524:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983317120 00000100:00100000:0.0:1746066759.109528:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983317120 00010000:00010000:0.0:1746066759.109544:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.109584:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.109590:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.109598:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.109603:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.109609:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.109832:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+45:2015:x1830882983316992:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1286us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.109839:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7302 00000100:00100000:1.0:1746066759.110316:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7303 00000100:00100000:1.0:1746066759.110325:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+24:2014:x1830882983317120:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.110334:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.110339:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.110350:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.110364:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2600/0xf1867c21abfa7944 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d2b expref: 24 pid: 7245 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.110376:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066759.110379:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066759.110386:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066759.110393:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066759.110415:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.110452:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+23:2014:x1830882983317120:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.110458:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7303 00010000:00010000:3.0:1746066759.110546:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110558:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066759.110634:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066759.110638:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066759.110655:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110665:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110676:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110681:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110687:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110692:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110697:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098497400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066759.110700:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110706:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110713:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:3.0:1746066759.110716:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066759.110718:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110724:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098497400/0xf1867c21abfa79d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110733:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110737:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110742:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110747:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098497e00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:3.0:1746066759.110749:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110753:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110757:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5feb000) 00010000:00010000:3.0:1746066759.110759:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746066759.110761:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110765:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098497e00/0xf1867c21abfa79d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.110791:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098497a00/0xf1867c21abfa79c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.110801:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 10 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.110811:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.110813:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066759.110815:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800958a2000, rc 0) 00000100:00100000:3.0:1746066759.112485:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:819:x1830882983316352:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 11098us (11602us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.112494:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16330 00000100:00100000:0.0:1746066759.115089:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.115126:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.115150:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983317248 00000100:00100000:1.0:1746066759.115157:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983317248 00000100:00100000:1.0:1746066759.115188:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983317376 00000100:00100000:1.0:1746066759.115190:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983317376 00000100:00100000:0.0:1746066759.115199:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16189 00000100:00100000:1.0:1746066759.115205:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16190 00000100:00100000:0.0:1746066759.115208:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983317248:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:1.0:1746066759.115210:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983317376:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066759.115231:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.115231:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.115245:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa79e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1da9 expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.115245:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1da2 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.115264:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.115265:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.115273:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.115285:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066759.115290:0:20361:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984489088:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066759.115295:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7200, rc 0) 00000100:00100000:0.0:1746066759.115337:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983317248:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 130us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.115343:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16189 00000100:00100000:1.0:1746066759.115474:0:20361:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854840 going to sleep for 11 seconds 00002000:00010000:1.0:1746066759.117163:0:20361:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746066759 -> 1746066760 00000100:00100000:1.0:1746066759.117180:0:20361:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20361:1830882984489088:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.117202:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa79e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da9 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.117211:0:20361:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fa0d000/0xf1867c21abfa79e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da9 expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.117220:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0d000, rc 0) 00000100:00100000:1.0:1746066759.117344:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983317376:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 2132us (2215us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.117349:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16190 00000100:00100000:0.0:1746066759.118999:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.119035:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.119052:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983317504 00000100:00100000:0.0:1746066759.119057:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983317504 00000100:00100000:0.0:1746066759.119098:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983317632 00000100:00100000:0.0:1746066759.119100:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983317632 00000100:00100000:0.0:1746066759.119114:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16191 00000100:00100000:0.0:1746066759.119120:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983317504:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066759.119134:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.119146:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c7600/0xf1867c21abfa79f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1db0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.119193:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984489216:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066759.119303:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16192 00000100:00100000:0.0:1746066759.119494:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.119551:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983317632:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066759.119558:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.119566:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c400/0xf1867c21abfa79fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1db7 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.119597:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984489344:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066759.119625:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854840 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.119675:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.119777:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983317760 00000100:00100000:2.0:1746066759.119780:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983317760 00000100:00100000:2.0:1746066759.119799:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16193 00000100:00100000:2.0:1746066759.119803:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983317760:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066759.119945:0:20361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.119955:0:20361:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1dbe expref: -99 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.119966:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.119968:0:20361:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.119975:0:20361:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.119986:0:20361:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 9 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.119994:0:20361:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d31a00, rc 0) 00000100:00100000:2.0:1746066759.120031:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983317760:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 227us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.120037:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16193 00002000:00010000:2.0:1746066759.122020:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746066759 -> 1746066760 00002000:00010000:2.0:1746066759.122026:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746066759 -> 1746066760 00000100:00100000:2.0:1746066759.122042:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984489216:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066759.122068:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c7600/0xf1867c21abfa79f3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1db0 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.122079:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c7600/0xf1867c21abfa79f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1db0 expref: 16 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.122094:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c7600, rc 0) 00000100:00100000:2.0:1746066759.122120:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983317504:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3000us (3125us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066759.122126:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16191 00002000:00010000:1.0:1746066759.122215:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime: 1746066759 -> 1746066760 00002000:00010000:1.0:1746066759.122218:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime: 1746066759 -> 1746066760 00000100:00100000:1.0:1746066759.122225:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984489344:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.122238:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c400/0xf1867c21abfa79fa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1db7 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.122369:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0c400/0xf1867c21abfa79fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1db7 expref: 14 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.122377:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c400, rc 0) 00000100:00100000:1.0:1746066759.122406:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983317632:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3097us (3370us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.122411:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16192 00000100:00100000:0.0:1746066759.124984:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.125504:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983318016 00000100:00100000:3.0:1746066759.125516:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983318016 00000100:00100000:3.0:1746066759.125568:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16331 00000100:00100000:3.0:1746066759.125574:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:819:x1830882983318016:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066759.125590:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.125609:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfa7a08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1dc5 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.125697:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.125710:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.125717:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.125743:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.125755:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 11 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.125767:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984489472:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.125868:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.128228:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.130834:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983318272 00000100:00100000:1.0:1746066759.130847:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983318272 00000100:00100000:1.0:1746066759.130917:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16332 00000100:00100000:1.0:1746066759.130926:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+45:822:x1830882983318272:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.130950:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.130968:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0de00/0xf1867c21abfa7a16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1dcc expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.131065:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.131079:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.131088:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:3.0:1746066759.131401:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984489472:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.131607:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066759.131671:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.132151:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983318400 00000100:00100000:0.0:1746066759.132156:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983318400 00010000:00010000:0.0:1746066759.132180:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 12 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746066759.132206:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7304 00000100:00100000:0.0:1746066759.132211:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983318400:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066759.132221:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066759.132225:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 12 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066759.132234:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 12 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066759.132251:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a2000/0xf1867c21abfa79de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d9b expref: 12 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:0.0:1746066759.132276:0:11928:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:0.0:1746066759.132280:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066759.132288:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066759.132297:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:0.0:1746066759.132303:0:11928:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066759.132307:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066759.132311:0:11928:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066759.132333:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066759.132343:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.132351:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066759.132368:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000100:00100000:0.0:1746066759.132376:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983318400:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 164us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.132382:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7304 00010000:00010000:3.0:1746066759.132495:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80ee00/0xf1867c21abfa7a08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dc5 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.132511:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dc5 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.132518:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.132520:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066759.132523:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00010000:00010000:1.0:1746066759.132528:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.132534:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:1.0:1746066759.132543:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000100:00100000:3.0:1746066759.132545:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:819:x1830882983318016:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 6971us (7572us total) trans 8589936674 rc 0/0 00000100:00100000:3.0:1746066759.132551:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16331 00010000:00010000:1.0:1746066759.132597:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0de00/0xf1867c21abfa7a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 48 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.132607:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 47 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.132611:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066759.132613:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066759.132615:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0c200, rc 0) 00000100:00100000:1.0:1746066759.132633:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+47:822:x1830882983318272:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 1709us (4416us total) trans 8589936675 rc 0/0 00000100:00100000:1.0:1746066759.132638:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16332 00000100:00100000:0.0:1746066759.135777:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.137379:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983318656 00000100:00100000:1.0:1746066759.137391:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983318656 00000100:00100000:1.0:1746066759.137459:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16333 00000100:00100000:1.0:1746066759.137467:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:819:x1830882983318656:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:1.0:1746066759.137495:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.137498:0:13370:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746066759.137526:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a0f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dc5 expref: 11 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.137545:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066759.137549:0:13370:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066759.137561:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0dc00/0xf1867c21abfa7a32 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1dd3 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.137658:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.137671:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 46 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.137677:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.137707:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 46 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.137719:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 46 pid: 13370 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.137732:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984489600:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.137834:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.143950:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984489600:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.143977:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:0.0:1746066759.144206:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.145250:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983318784 00000100:00100000:1.0:1746066759.145259:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983318784 00010000:00010000:1.0:1746066759.145301:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 47 pid: 13370 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.145344:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7305 00000100:00100000:1.0:1746066759.145354:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+47:2015:x1830882983318784:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.145370:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.145376:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 47 pid: 13370 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.145387:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 47 pid: 13370 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.145409:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0c200/0xf1867c21abfa7a1d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dcc expref: 47 pid: 13370 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.145423:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066759.145428:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.145448:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.145455:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066759.145484:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.145536:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+46:2015:x1830882983318784:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 183us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.145544:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7305 00010000:00010000:2.0:1746066759.145768:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145782:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145804:0:13370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145809:0:13370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145815:0:13370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145821:0:13370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa0ca00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066759.145826:0:13370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145833:0:13370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145847:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.145850:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746066759.145853:0:13370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145857:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0ca00/0xf1867c21abfa7a39 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.145953:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0dc00/0xf1867c21abfa7a32 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dd3 expref: 11 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.145972:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa0dc00/0xf1867c21abfa7a32 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dd3 expref: 11 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.145980:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0dc00, rc 0) 00000100:00100000:2.0:1746066759.146037:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:819:x1830882983318656:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 8570us (10272us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066759.146045:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16333 00000100:00100000:0.0:1746066759.150950:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.151343:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983319040 00000100:00100000:1.0:1746066759.151354:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983319040 00000100:00100000:1.0:1746066759.152782:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5969 00000100:00100000:1.0:1746066759.152795:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:819:x1830882983319040:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:1.0:1746066759.153047:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:819:x1830882983319040:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 255us (2108us total) trans 8589936676 rc 0/0 00000100:00100000:1.0:1746066759.153055:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5969 00000100:00100000:0.0:1746066759.163946:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.163987:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.164193:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983319168 00000100:00100000:1.0:1746066759.164203:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983319168 00000100:00100000:1.0:1746066759.165081:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983319296 00000100:00100000:1.0:1746066759.165086:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983319296 00000100:00100000:3.0:1746066759.165190:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16194 00000100:00100000:3.0:1746066759.165200:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983319168:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.165220:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.165238:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1dda expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.165295:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984489728:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066759.165369:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.165553:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16195 00000100:00100000:1.0:1746066759.165561:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2014:x1830882983319296:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.165567:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.165578:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa0dc00/0xf1867c21abfa7a47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1de1 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.165602:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984489856:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066759.165627:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.172793:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984489856:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066759.172815:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984489728:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.172830:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0dc00/0xf1867c21abfa7a47 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1de1 expref: 28 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.172833:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a40 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dda expref: 28 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.172844:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d80f800/0xf1867c21abfa7a40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dda expref: 28 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.172844:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0dc00/0xf1867c21abfa7a47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1de1 expref: 28 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.172874:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f800, rc 0) 00010000:00010000:1.0:1746066759.172875:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa0dc00, rc 0) 00000100:00100000:1.0:1746066759.172939:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983319296:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7376us (8949us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.172947:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16195 00000100:00100000:3.0:1746066759.173085:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+25:2014:x1830882983319168:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7886us (9149us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066759.173090:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16194 00000100:00100000:1.0:1746066759.194967:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.196829:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983319424 00000100:00100000:3.0:1746066759.196842:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983319424 00000100:00100000:3.0:1746066759.196966:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16196 00000100:00100000:3.0:1746066759.196976:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983319424:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.196999:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.197017:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa7a4e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1de8 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.197078:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984489984:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066759.197184:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00080000:0.0:1746066759.197571:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066759.197781:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.198356:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983319552 00000100:00100000:2.0:1746066759.198363:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983319552 00000100:00100000:2.0:1746066759.198411:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16197 00000100:00100000:2.0:1746066759.198417:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:827:x1830882983319552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.198442:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.198457:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1def expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.198484:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.198493:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.198494:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.198498:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.198522:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 23 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.198535:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 23 pid: 20361 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.198546:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984490112:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.198611:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800965e6540 going to sleep for 11 seconds 00002000:00010000:3.0:1746066759.200070:0:3528:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746066759 -> 1746066760 00000100:00100000:2.0:1746066759.200124:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d80380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984490112:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.200151:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.200166:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30600, rc 0) 00000100:00100000:2.0:1746066759.200528:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:827:x1830882983319552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2108us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.200537:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16197 00002000:00010000:3.0:1746066759.200591:0:3528:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746066759 -> 1746066760 00000100:00100000:3.0:1746066759.200609:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984489984:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066759.200640:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa7a4e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1de8 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.200650:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d80f000/0xf1867c21abfa7a4e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1de8 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.200777:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d80f000, rc 0) 00000100:00100000:3.0:1746066759.200802:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983319424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3828us (5847us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066759.200807:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16196 00000100:00100000:0.0:1746066759.202794:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.203991:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983319680 00000100:00100000:1.0:1746066759.204002:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983319680 00002000:00100000:1.0:1746066759.204049:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1675264->2097151) req@ffff88009677fb80 x1830882983319680/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.204059:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677fb80 with x1830882983319680 ext(1675264->2097151) 00010000:00010000:1.0:1746066759.204069:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 24 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.204083:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 24 pid: 20361 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746066759.204091:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009677fb80 00000100:00100000:1.0:1746066759.204124:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 979 00000100:00100000:1.0:1746066759.204132:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+24:2013:x1830882983319680:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:0.0:1746066759.210950:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.211021:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983319936 00000100:00100000:2.0:1746066759.211034:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983319936 00000100:00100000:2.0:1746066759.211099:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16334 00000100:00100000:2.0:1746066759.211108:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+23:833:x1830882983319936:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066759.211136:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.211156:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31200/0xf1867c21abfa7a5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1dfd expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.211265:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.211281:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.211293:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:2.0:1746066759.211304:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066759.211407:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d31200/0xf1867c21abfa7a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 26 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.211442:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 25 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.211452:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.211455:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066759.211458:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d30c00, rc 0) 00000100:00100000:2.0:1746066759.211516:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+25:833:x1830882983319936:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 410us (577us total) trans 8589936677 rc 0/0 00000100:00100000:2.0:1746066759.211524:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16334 00000100:00100000:2.0:1746066759.215421:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+26:2013:x1830882983319680:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 11274us (12620us total) trans 21474841908 rc 0/0 00000100:00100000:2.0:1746066759.215447:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 979 00002000:00100000:2.0:1746066759.215460:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1675264->2097151) req@ffff88009677fb80 x1830882983319680/t21474841908(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.215470:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677fb80 with x1830882983319680 ext(1675264->2097151) 00010000:00010000:2.0:1746066759.215481:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.215497:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.215504:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009677fb80 00000100:00100000:0.0:1746066759.217029:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.217378:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983320064 00000100:00100000:3.0:1746066759.217388:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983320064 00000100:00100000:3.0:1746066759.217448:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16198 00000100:00100000:3.0:1746066759.217456:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:831:x1830882983320064:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.217475:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.217492:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1df6 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.217771:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.217785:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066759.217788:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066759.217791:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.217822:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 30 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.217834:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 30 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.217847:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984490240:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.217971:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.220660:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.220706:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.220725:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983320192 00000100:00100000:1.0:1746066759.220734:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983320192 00010000:00010000:1.0:1746066759.220775:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.220778:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983320320 00000100:00100000:2.0:1746066759.220782:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983320320 00000100:00100000:1.0:1746066759.220808:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7306 00000100:00100000:1.0:1746066759.220816:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+26:2014:x1830882983320192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.220830:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:2.0:1746066759.220832:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1986560->2097151) req@ffff88009677c700 x1830882983320320/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.220841:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882983320320 ext(1986560->2097151) 00010000:00010000:2.0:1746066759.220849:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 31 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.220852:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.220860:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 31 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.220862:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.220867:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677c700 00000100:00100000:2.0:1746066759.220879:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 980 00000100:00100000:2.0:1746066759.220905:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983320320:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746066759.220907:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0cc00/0xf1867c21abfa79bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d8d expref: 26 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.220931:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.220933:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.220941:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.220949:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.220981:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 25 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.220992:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984490368:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066759.221046:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1746066759.221145:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746066759.221209:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984490240:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.221228:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 11 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.221239:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b19ed600, rc 0) 00000100:00100000:3.0:1746066759.221265:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+11:831:x1830882983320064:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3810us (4241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.221272:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16198 00000100:00100000:1.0:1746066759.224566:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984490368:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066759.224587:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.224638:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983320192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3821us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.224648:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7306 00000100:00100000:3.0:1746066759.226506:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983320320:12345-192.168.204.16@tcp:4:cat.0 Request processed in 5612us (5790us total) trans 17179874456 rc 0/0 00000100:00100000:3.0:1746066759.226518:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 980 00002000:00100000:3.0:1746066759.226528:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1986560->2097151) req@ffff88009677c700 x1830882983320320/t17179874456(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.226536:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677c700 with x1830882983320320 ext(1986560->2097151) 00010000:00010000:3.0:1746066759.226545:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 33 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.226560:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 33 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746066759.226566:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009677c700 00000100:00100000:2.0:1746066759.227217:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.227471:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983320576 00000100:00100000:3.0:1746066759.227480:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983320576 00002000:00100000:3.0:1746066759.227523:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830882983320576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.227532:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830882983320576 ext(1048576->2097151) 00002000:00010000:3.0:1746066759.228078:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:3.0:1746066759.228160:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4375 00000100:00100000:3.0:1746066759.228169:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882983320576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.231672:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.231741:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983320704 00000100:00100000:1.0:1746066759.231752:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983320704 00010000:00010000:1.0:1746066759.231789:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 33 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.231821:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7307 00000100:00100000:1.0:1746066759.231829:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882983320704:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.231843:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.231864:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 33 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.231876:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 33 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.231918:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe5600/0xf1867c21abfa796e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d40 expref: 33 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.231943:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.231945:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.231953:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.231967:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.232002:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 10 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.232015:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984490496:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066759.232097:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.236683:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11928:1830882984490496:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066759.236702:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.236763:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+32:2013:x1830882983320704:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4933us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.236773:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7307 00000100:00100000:0.0:1746066759.244557:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.244598:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+26:2013:x1830882983320576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 16428us (17385us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066759.244610:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4375 00002000:00100000:3.0:1746066759.244622:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800a5d80380 x1830882983320576/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.244632:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5d80380 with x1830882983320576 ext(1048576->2097151) 00002000:00010000:3.0:1746066759.244638:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5d80380 00000100:00100000:3.0:1746066759.244662:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983320960 00000100:00100000:3.0:1746066759.244668:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983320960 00002000:00100000:3.0:1746066759.244697:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009677e680 x1830882983320960/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.244709:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e680 with x1830882983320960 ext(1048576->2097151) 00002000:00010000:3.0:1746066759.244712:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677e680 00000100:00100000:3.0:1746066759.244726:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4376 00000100:00100000:3.0:1746066759.248190:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882983320960:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.248355:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.248458:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983321088 00000100:00100000:2.0:1746066759.248466:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983321088 00000100:00100000:2.0:1746066759.248503:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16199 00000100:00100000:2.0:1746066759.248508:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:827:x1830882983321088:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.248518:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.248536:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e04 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.248562:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.248569:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.248571:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.248574:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.248602:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 24 pid: 20361 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.248613:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 24 pid: 20361 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.248625:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984490624:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.248704:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.271014:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.271097:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984490624:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.271122:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.271137:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848be00, rc 0) 00000100:00100000:2.0:1746066759.271189:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+27:827:x1830882983321088:12345-192.168.204.16@tcp:101:cat.0 Request processed in 22679us (22835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.271197:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16199 00000100:00100000:2.0:1746066759.271652:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+11:2013:x1830882983320960:12345-192.168.204.16@tcp:3:cat.0 Request processed in 23487us (27105us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.271660:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4376 00002000:00100000:2.0:1746066759.271668:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009677e680 x1830882983320960/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.271677:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009677e680 with x1830882983320960 ext(1048576->2097151) 00002000:00010000:2.0:1746066759.271681:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009677e680 00000100:00100000:2.0:1746066759.271695:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983321216 00000100:00100000:2.0:1746066759.271700:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983321216 00002000:00100000:2.0:1746066759.271723:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2183167) req@ffff88012ea25f80 x1830882983321216/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.271729:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25f80 with x1830882983321216 ext(2097152->2183167) 00010000:00010000:2.0:1746066759.271734:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 25 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.271746:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 25 pid: 20361 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.271756:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea25f80 00000100:00100000:2.0:1746066759.271768:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 981 00000100:00100000:2.0:1746066759.271775:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+25:2014:x1830882983321216:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066759.278720:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882983321216:12345-192.168.204.16@tcp:4:cat.0 Request processed in 6938us (7709us total) trans 21474841909 rc 0/0 00000100:00100000:2.0:1746066759.278731:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 981 00002000:00100000:2.0:1746066759.278741:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2183167) req@ffff88012ea25f80 x1830882983321216/t21474841909(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.278750:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25f80 with x1830882983321216 ext(2097152->2183167) 00010000:00010000:2.0:1746066759.278758:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 27 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.278772:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 27 pid: 20361 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.278778:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ea25f80 00000100:00100000:0.0:1746066759.283402:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.284766:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983321344 00000100:00100000:2.0:1746066759.284775:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983321344 00000100:00100000:2.0:1746066759.284823:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16200 00000100:00100000:2.0:1746066759.284830:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+27:831:x1830882983321344:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.284844:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.284856:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e0b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.284879:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.284893:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.284899:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.284910:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.284918:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848aa00, rc 0) 00000100:00100000:2.0:1746066759.284952:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+28:831:x1830882983321344:12345-192.168.204.16@tcp:101:cat.0 Request processed in 123us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.284957:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16200 00000100:00100000:0.0:1746066759.286080:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.286473:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983321472 00000100:00100000:2.0:1746066759.286479:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983321472 00010000:00010000:2.0:1746066759.286502:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 28 pid: 20361 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.286521:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7308 00000100:00100000:2.0:1746066759.286526:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983321472:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.286534:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.286549:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 28 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.286558:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 28 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.286579:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa0da00/0xf1867c21abfa79c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d94 expref: 28 pid: 20361 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.286593:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.286595:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.286599:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.286606:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.286628:0:11928:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.286637:0:11928:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984490752:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066759.286690:0:11928:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8727480 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.300608:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.300705:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983321728 00000100:00100000:2.0:1746066759.300716:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983321728 00002000:00100000:2.0:1746066759.300762:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012ea26a00 x1830882983321728/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.300770:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea26a00 with x1830882983321728 ext(1048576->2097151) 00002000:00010000:2.0:1746066759.300775:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea26a00 00000100:00100000:2.0:1746066759.300820:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4377 00000100:00100000:2.0:1746066759.300827:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983321728:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066759.301228:0:11928:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11928:1830882984490752:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066759.301243:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.301302:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882983321472:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 14774us (15222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.301310:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7308 00000100:00100000:1.0:1746066759.303699:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.303729:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983321984 00000100:00100000:2.0:1746066759.303737:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983321984 00002000:00100000:2.0:1746066759.303772:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009c7fc380 x1830882983321984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.303781:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc380 with x1830882983321984 ext(2097152->4194303) 00002000:00010000:2.0:1746066759.303786:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc380 00000100:00100000:2.0:1746066759.303877:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4378 00000100:00100000:2.0:1746066759.303900:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983321984:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.309680:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+27:2014:x1830882983321728:12345-192.168.204.16@tcp:3:cat.0 Request processed in 8845us (9077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.309692:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4377 00002000:00100000:2.0:1746066759.309702:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012ea26a00 x1830882983321728/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.309711:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea26a00 with x1830882983321728 ext(1048576->2097151) 00002000:00010000:2.0:1746066759.309716:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea26a00 00000100:00100000:0.0:1746066759.318589:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.319291:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983322112 00000100:00100000:2.0:1746066759.319302:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983322112 00000100:00100000:3.0:1746066759.319331:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983321984:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15443us (15637us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066759.319343:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4378 00002000:00100000:3.0:1746066759.319355:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009c7fc380 x1830882983321984/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.319365:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c7fc380 with x1830882983321984 ext(2097152->4194303) 00000100:00100000:2.0:1746066759.319367:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16201 00002000:00010000:3.0:1746066759.319371:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c7fc380 00000100:00100000:2.0:1746066759.319374:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+27:831:x1830882983322112:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.319390:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.319404:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e12 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.319424:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.319426:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.319440:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.319457:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.319466:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848ba00, rc 0) 00000100:00100000:2.0:1746066759.319509:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+28:831:x1830882983322112:12345-192.168.204.16@tcp:101:cat.0 Request processed in 136us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.319515:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16201 00000100:00100000:0.0:1746066759.326407:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.326535:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983322368 00000100:00100000:3.0:1746066759.326546:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983322368 00002000:00100000:3.0:1746066759.326596:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012ea25880 x1830882983322368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.326604:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25880 with x1830882983322368 ext(2097152->4194303) 00002000:00010000:3.0:1746066759.326609:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea25880 00000100:00100000:3.0:1746066759.326636:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4379 00000100:00100000:3.0:1746066759.326643:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983322368:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.339760:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.339874:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983322496 00000100:00100000:2.0:1746066759.339916:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983322496 00000100:00100000:2.0:1746066759.339965:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16202 00000100:00100000:2.0:1746066759.339974:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+32:2015:x1830882983322496:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.339993:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.340012:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e19 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.340142:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.340144:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.340153:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 33 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.340169:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 33 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.340180:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848b200, rc 0) 00000100:00100000:2.0:1746066759.340401:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983322496:12345-192.168.204.16@tcp:101:cat.0 Request processed in 428us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.340410:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16202 00000100:00100000:3.0:1746066759.344232:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2013:x1830882983322368:12345-192.168.204.16@tcp:3:cat.0 Request processed in 17578us (17824us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066759.344243:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4379 00002000:00100000:3.0:1746066759.344254:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88012ea25880 x1830882983322368/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.344263:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea25880 with x1830882983322368 ext(2097152->4194303) 00002000:00010000:3.0:1746066759.344269:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea25880 00000100:00100000:0.0:1746066759.350819:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.352653:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983322752 00000100:00100000:3.0:1746066759.352668:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983322752 00002000:00100000:3.0:1746066759.352727:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ea24e00 x1830882983322752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.352737:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea24e00 with x1830882983322752 ext(4194304->5033983) 00002000:00010000:3.0:1746066759.352743:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea24e00 00000100:00100000:3.0:1746066759.352788:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4380 00000100:00100000:3.0:1746066759.352796:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983322752:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066759.361935:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983322752:12345-192.168.204.16@tcp:3:cat.0 Request processed in 9130us (11121us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066759.361946:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4380 00002000:00100000:3.0:1746066759.361956:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ea24e00 x1830882983322752/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.361965:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea24e00 with x1830882983322752 ext(4194304->5033983) 00002000:00010000:3.0:1746066759.361971:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea24e00 00000100:00100000:0.0:1746066759.363470:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.363628:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983323008 00000100:00100000:3.0:1746066759.363635:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983323008 00002000:00100000:3.0:1746066759.363666:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ea26680 x1830882983323008/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.363674:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea26680 with x1830882983323008 ext(4194304->5033983) 00002000:00010000:3.0:1746066759.363678:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea26680 00000100:00100000:3.0:1746066759.363706:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4381 00000100:00100000:3.0:1746066759.363713:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983323008:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.372239:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.372328:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983323136 00000100:00100000:2.0:1746066759.372337:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983323136 00000100:00100000:2.0:1746066759.372378:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16203 00000100:00100000:2.0:1746066759.372385:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:822:x1830882983323136:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066759.372402:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.372419:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e20 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.372458:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 10 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.372467:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.372473:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 34 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.372479:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.372481:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.372485:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.372511:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 34 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.372523:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746066759.372534:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984490880:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.372648:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 8 pid: 20361 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.372656:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 8 pid: 20361 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746066759.372664:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984491008:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.372689:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 10 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.372697:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 10 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.372705:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984491136:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.372720:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.375826:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+28:2014:x1830882983323008:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12104us (12350us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066759.375838:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4381 00002000:00100000:3.0:1746066759.375849:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88012ea26680 x1830882983323008/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.375857:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ea26680 with x1830882983323008 ext(4194304->5033983) 00002000:00010000:3.0:1746066759.375862:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ea26680 00000100:00100000:2.0:1746066759.377351:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d83100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984490880:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066759.385171:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.385206:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.385443:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984491008:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.385456:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984491136:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.385533:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [3993600->4194303] (req 3993600->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.385944:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066759.386190:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a400, rc 0) 00000100:00100000:2.0:1746066759.386237:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+34:822:x1830882983323136:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13851us (14004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.386248:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16203 00000100:00100000:1.0:1746066759.386495:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983323264 00000100:00100000:1.0:1746066759.386501:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983323264 00010000:00010000:1.0:1746066759.386527:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 9 pid: 20361 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.386546:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983323392 00000100:00100000:1.0:1746066759.386549:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983323392 00010000:00010000:1.0:1746066759.386557:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.386565:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983323520 00000100:00100000:2.0:1746066759.386567:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983323520 00000100:00100000:1.0:1746066759.386570:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7309 00000100:00100000:1.0:1746066759.386576:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2016:x1830882983323264:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.386577:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066759.386587:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066759.386592:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7310 00000100:00100000:2.0:1746066759.386595:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983323392:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.386600:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.386602:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 9 pid: 20361 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.386605:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.386610:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 9 pid: 20361 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746066759.386636:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7311 00000100:00100000:0.0:1746066759.386641:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:2013:x1830882983323520:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066759.386647:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.387438:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.387461:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496e00/0xf1867c21abfa78b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cd0 expref: 11 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.387479:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.387505:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983323392:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 908us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.387511:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7310 00010000:00010000:1.0:1746066759.387537:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d31a00/0xf1867c21abfa7a01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dbe expref: 9 pid: 20361 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066759.387550:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.387570:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2016:x1830882983323264:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 993us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.387575:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7309 00010000:00010000:0.0:1746066759.387729:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746066759.387739:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746066759.387751:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098496600/0xf1867c21abfa78f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d01 expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746066759.387773:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.387775:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.387781:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.387788:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.387815:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.387825:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea26300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984491264:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066759.389857:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.389917:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.390027:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983323648 00000100:00100000:3.0:1746066759.390033:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983323648 00000100:00100000:3.0:1746066759.390069:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16204 00000100:00100000:3.0:1746066759.390076:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983323648:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.390089:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.390101:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7a9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e27 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.390140:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984491392:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066759.390186:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.391846:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.391941:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea26300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7232:1830882984491264:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066759.391960:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.392201:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+33:2013:x1830882983323520:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 5558us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.392211:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7311 00000100:00100000:2.0:1746066759.392289:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983323904 00000100:00100000:2.0:1746066759.392297:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983323904 00002000:00100000:2.0:1746066759.392331:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3993600->3997695) req@ffff880095ced880 x1830882983323904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.392340:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced880 with x1830882983323904 ext(3993600->3997695) 00002000:00010000:2.0:1746066759.392345:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ced880 00000100:00100000:2.0:1746066759.392375:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4382 00000100:00100000:2.0:1746066759.392381:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983323904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.393200:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983323904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 817us (1359us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066759.393207:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4382 00002000:00100000:2.0:1746066759.393215:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7a:0x0] (3993600->3997695) req@ffff880095ced880 x1830882983323904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.393222:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ced880 with x1830882983323904 ext(3993600->3997695) 00002000:00010000:2.0:1746066759.393225:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ced880 00002000:00010000:3.0:1746066759.394495:0:12233:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime: 1746066759 -> 1746066760 00002000:00010000:3.0:1746066759.394501:0:12233:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime: 1746066759 -> 1746066760 00002000:00010000:3.0:1746066759.394503:0:12233:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime: 1746066759 -> 1746066760 00000100:00100000:3.0:1746066759.394522:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984491392:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066759.394641:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7a9b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e27 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.394657:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7a9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e27 expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.394879:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009414ca00, rc 0) 00000100:00100000:2.0:1746066759.395811:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+10:2014:x1830882983323648:12345-192.168.204.16@tcp:101:cat.0 Request processed in 5731us (5955us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066759.395821:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16204 00000100:00100000:0.0:1746066759.397568:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.397672:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983324032 00000100:00100000:2.0:1746066759.397681:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983324032 00000100:00100000:2.0:1746066759.397874:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16205 00000100:00100000:2.0:1746066759.397899:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:822:x1830882983324032:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066759.397917:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.397934:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e2e expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.397946:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066759.397964:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.397972:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.397978:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.397980:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.397983:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->5001215] (req 4194304->5001215) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.398012:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.398023:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 27 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.398035:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984491520:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.398209:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983324160 00000100:00100000:1.0:1746066759.398213:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983324160 00000100:00100000:1.0:1746066759.398240:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16206 00000100:00100000:1.0:1746066759.398245:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983324160:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.398252:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.398261:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecee00/0xf1867c21abfa7aa9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e35 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.398629:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 28 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.398637:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.398646:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984491648:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.398669:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.398865:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984491776:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066759.399113:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.400634:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984491520:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.400643:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984491648:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.400667:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [4194304->5001215] (req 4194304->5001215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 28 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.400681:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155ce00, rc 0) 00000100:00100000:2.0:1746066759.400720:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:822:x1830882983324032:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2837us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.400728:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16205 00000100:00100000:1.0:1746066759.400975:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984491776:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.400995:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecee00/0xf1867c21abfa7aa9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e35 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.401005:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecee00/0xf1867c21abfa7aa9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e35 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.401019:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecee00, rc 0) 00000100:00100000:1.0:1746066759.401039:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+10:2013:x1830882983324160:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2794us (3093us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.401045:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16206 00000100:00100000:3.0:1746066759.405470:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.405548:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983324288 00000100:00100000:1.0:1746066759.405556:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983324288 00000100:00100000:1.0:1746066759.405602:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16207 00000100:00100000:1.0:1746066759.405609:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+28:833:x1830882983324288:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.405627:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.405643:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e3c expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.405671:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.405683:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.405689:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.405690:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.405693:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1064960->1835007] (req 1064960->1835007) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.405721:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.405730:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.405740:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984491904:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.405821:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.405828:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 27 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.405835:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984492032:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.405849:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.407491:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.407560:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983324416 00000100:00100000:1.0:1746066759.407565:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983324416 00010000:00010000:1.0:1746066759.407593:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.407673:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7312 00000100:00100000:1.0:1746066759.407680:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983324416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.407692:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.407719:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.407729:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.407749:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7a78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e04 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.407802:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.407841:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983324416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.407846:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7312 00000100:00100000:0.0:1746066759.408235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.408263:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.408340:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984491904:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.408349:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984492032:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.408376:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1064960->1835007] (req 1064960->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.408388:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ece000, rc 0) 00000100:00100000:1.0:1746066759.408411:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+29:833:x1830882983324288:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 2803us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.408418:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16207 00000100:00100000:2.0:1746066759.408582:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983324672 00000100:00100000:2.0:1746066759.408586:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983324672 00010000:00010000:2.0:1746066759.408602:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.408616:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983324544 00000100:00100000:2.0:1746066759.408618:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983324544 00010000:00010000:2.0:1746066759.408626:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 30 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.408638:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7313 00000100:00100000:2.0:1746066759.408643:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2014:x1830882983324672:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.408650:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.408660:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 30 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.408674:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 30 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.408687:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848aa00/0xf1867c21abfa7a7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e0b expref: 30 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.408699:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.408719:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2014:x1830882983324672:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.408724:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7313 00000100:00100000:2.0:1746066759.408735:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7314 00000100:00100000:2.0:1746066759.408739:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2016:x1830882983324544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.408746:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.408753:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.408761:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.408772:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7a86 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e12 expref: 28 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.408780:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.408782:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.408788:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.408796:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.408822:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 26 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.408833:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984492160:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066759.408902:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.409985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.410613:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983324800 00000100:00100000:3.0:1746066759.410620:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983324800 00010000:00010000:3.0:1746066759.410644:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 27 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.410841:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7315 00000100:00100000:3.0:1746066759.410853:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983324800:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.410863:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.410878:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 27 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.410909:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 27 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.410915:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7232:1830882984492160:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066759.410930:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066759.410931:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d30600/0xf1867c21abfa7a55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1def expref: 27 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.410944:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.410945:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.410950:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.410953:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983324544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2213us (2689us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066759.410958:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 27 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.410959:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7314 00010000:00010000:3.0:1746066759.410979:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.410989:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984492288:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066759.411029:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.413034:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7230:1830882984492288:192.168.204.16@tcp:105: 00010000:00010000:3.0:1746066759.413053:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.414132:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983324800:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3279us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.414142:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7315 00000100:00100000:2.0:1746066759.416451:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.416565:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983325056 00000100:00100000:0.0:1746066759.416574:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983325056 00002000:00100000:0.0:1746066759.416620:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4997120->5001215) req@ffff8800966e1c00 x1830882983325056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066759.416630:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882983325056 ext(4997120->5001215) 00002000:00010000:0.0:1746066759.416636:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e1c00 00000100:00100000:0.0:1746066759.416768:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4383 00000100:00100000:0.0:1746066759.416777:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983325056:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.416949:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983325056:12345-192.168.204.16@tcp:3:cat.0 Request processed in 172us (504us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746066759.416958:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4383 00002000:00100000:0.0:1746066759.416964:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4997120->5001215) req@ffff8800966e1c00 x1830882983325056/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066759.416970:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e1c00 with x1830882983325056 ext(4997120->5001215) 00002000:00010000:0.0:1746066759.416973:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e1c00 00000100:00100000:0.0:1746066759.417871:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.417954:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983325312 00000100:00100000:1.0:1746066759.417958:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983325312 00002000:00100000:1.0:1746066759.417976:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1830912->1835007) req@ffff88012faf3800 x1830882983325312/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.417981:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3800 with x1830882983325312 ext(1830912->1835007) 00002000:00010000:1.0:1746066759.417984:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf3800 00000100:00100000:1.0:1746066759.418002:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4384 00000100:00100000:1.0:1746066759.418006:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983325312:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066759.418067:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e2051f12-252a-4bb3-b8f3-833317fca821+27:2016:x1830882983325312:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 60us (198us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066759.418071:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4384 00002000:00100000:1.0:1746066759.418073:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1830912->1835007) req@ffff88012faf3800 x1830882983325312/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.418078:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012faf3800 with x1830882983325312 ext(1830912->1835007) 00002000:00010000:1.0:1746066759.418080:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012faf3800 00000100:00100000:0.0:1746066759.419805:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.419910:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983325568 00000100:00100000:2.0:1746066759.419916:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983325568 00000100:00100000:2.0:1746066759.419953:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5970 00000100:00100000:2.0:1746066759.419957:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+46:822:x1830882983325568:12345-192.168.204.16@tcp:35:multiop.0 00000100:00100000:2.0:1746066759.420137:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+47:822:x1830882983325568:12345-192.168.204.16@tcp:35:multiop.0 Request processed in 179us (339us total) trans 8589936678 rc 0/0 00000100:00100000:2.0:1746066759.420142:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5970 00000100:00100000:2.0:1746066759.469106:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.469230:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983325696 00000100:00100000:3.0:1746066759.469241:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983325696 00000100:00100000:3.0:1746066759.469321:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16335 00000100:00100000:3.0:1746066759.469330:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:838:x1830882983325696:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066759.469359:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.469376:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e43 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.469565:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469579:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469590:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469603:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469608:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469613:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469684:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469695:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 24 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.469701:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.469730:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 24 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.469746:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 24 pid: 13370 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.469756:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984492416:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.469965:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.471213:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984492416:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.471232:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066759.471988:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.472069:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983325952 00000100:00100000:1.0:1746066759.472075:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983325952 00000100:00100000:1.0:1746066759.472111:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5971 00000100:00100000:1.0:1746066759.472118:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:30848:x1830882983325952:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746066759.472616:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:30848:x1830882983325952:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 497us (629us total) trans 8589936679 rc 0/0 00000100:00100000:1.0:1746066759.472624:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5971 00000100:00100000:0.0:1746066759.474072:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.474221:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983326080 00000100:00100000:3.0:1746066759.474226:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983326080 00010000:00010000:3.0:1746066759.474254:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 26 pid: 13370 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.474286:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7316 00000100:00100000:3.0:1746066759.474292:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983326080:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.474302:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.474308:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 26 pid: 13370 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.474317:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 26 pid: 13370 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.474339:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d30c00/0xf1867c21abfa7a63 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1dfd expref: 26 pid: 13370 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.474371:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.474376:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.474386:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.474392:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.474421:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.474458:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+25:2015:x1830882983326080:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 166us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.474464:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7316 00010000:00010000:2.0:1746066759.474553:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474561:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066759.474610:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066759.474615:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066759.474629:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474637:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474648:0:7244:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474653:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474659:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474664:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474669:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066759.474673:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474679:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474687:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066759.474689:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066759.474693:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474698:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474722:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474727:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474732:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474736:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8c00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066759.474739:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474743:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474750:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a5feb800) 00010000:00010000:2.0:1746066759.474752:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066759.474755:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474759:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7ac5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.474789:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.474800:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 12 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.474815:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.474817:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066759.474819:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c9200, rc 0) 00000100:00100000:2.0:1746066759.474854:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:838:x1830882983325696:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 5526us (5760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.474860:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16335 00000100:00100000:0.0:1746066759.476317:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.476354:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.476382:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.476418:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983326208 00000100:00100000:2.0:1746066759.476423:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983326208 00000100:00100000:0.0:1746066759.476423:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.476458:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16208 00000100:00100000:2.0:1746066759.476466:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2013:x1830882983326208:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:0.0:1746066759.476472:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983326336 00000100:00100000:0.0:1746066759.476475:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983326336 00010000:00010000:2.0:1746066759.476482:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066759.476494:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983326464 00000100:00100000:0.0:1746066759.476496:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983326464 00000100:00100000:2.0:1746066759.476497:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983326592 00000100:00100000:2.0:1746066759.476499:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983326592 00000100:00100000:0.0:1746066759.476508:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16209 00000100:00100000:2.0:1746066759.476511:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16210 00000100:00100000:0.0:1746066759.476513:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983326336:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066759.476514:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2014:x1830882983326464:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066759.476519:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.476519:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.476529:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa7ada lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e58 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.476529:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7ad3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e51 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.476569:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984492544:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066759.476569:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984492672:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066759.477202:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16211 00000100:00100000:1.0:1746066759.477210:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983326592:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066759.477217:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.477225:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecf000/0xf1867c21abfa7ae1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e5f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.477256:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984492800:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066759.477437:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e4a expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.477445:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00010000:00010000:2.0:1746066759.477449:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.477450:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.477460:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.477472:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.477481:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155da00, rc 0) 00000100:00100000:2.0:1746066759.477561:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983326208:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1036us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.477567:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16208 00000100:00100000:2.0:1746066759.477589:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854480 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.477626:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746066759.478781:0:12237:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066759 -> 1746066760 00000100:00100000:0.0:1746066759.478802:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984492672:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066759.478828:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7ad3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e51 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.478838:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7ad3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e51 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.478850:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2a00, rc 0) 00000100:00100000:0.0:1746066759.478875:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2014:x1830882983326336:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2361us (2520us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066759.478897:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16209 00002000:00010000:2.0:1746066759.479103:0:11630:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime: 1746066759 -> 1746066760 00000100:00100000:2.0:1746066759.479113:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984492544:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066759.479127:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa7ada lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e58 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.479135:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155d200/0xf1867c21abfa7ada lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e58 expref: 14 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.479142:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d200, rc 0) 00000100:00100000:2.0:1746066759.479173:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2014:x1830882983326464:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2657us (2790us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066759.479178:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16210 00000100:00100000:1.0:1746066759.480006:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984492800:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.480023:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecf000/0xf1867c21abfa7ae1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e5f expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.480031:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecf000/0xf1867c21abfa7ae1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e5f expref: 10 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.480055:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecf000, rc 0) 00000100:00100000:1.0:1746066759.480083:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2014:x1830882983326592:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2874us (3658us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.480089:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16211 00000100:00100000:0.0:1746066759.482572:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.483458:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983326848 00000100:00100000:2.0:1746066759.483468:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983326848 00000100:00100000:2.0:1746066759.483514:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16336 00000100:00100000:2.0:1746066759.483522:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:838:x1830882983326848:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066759.483544:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.483803:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012155de00/0xf1867c21abfa7aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e66 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.483940:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.483955:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.483962:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.483992:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.484004:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 13 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.484016:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984492928:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.484100:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854480 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.485810:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984492928:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.485830:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066759.486418:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.487022:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983326976 00000100:00100000:2.0:1746066759.487029:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983326976 00010000:00010000:2.0:1746066759.487060:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.487099:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7317 00000100:00100000:2.0:1746066759.487106:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983326976:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.487116:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.487121:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.487130:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.487151:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c9200/0xf1867c21abfa7acc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e43 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.487165:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.487170:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.487178:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.487183:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.487200:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.487235:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983326976:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 129us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.487241:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7317 00010000:00010000:2.0:1746066759.487280:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.487289:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:2.0:1746066759.487306:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066759.487436:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155de00/0xf1867c21abfa7aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.487448:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.487454:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.487456:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066759.487459:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d800, rc 0) 00000100:00100000:2.0:1746066759.487497:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:838:x1830882983326848:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3976us (4933us total) trans 8589936680 rc 0/0 00000100:00100000:2.0:1746066759.487504:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16336 00000100:00100000:1.0:1746066759.488974:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.489009:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983327104 00000100:00100000:2.0:1746066759.489014:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983327104 00000100:00100000:2.0:1746066759.489047:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16337 00000100:00100000:2.0:1746066759.489053:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:838:x1830882983327104:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066759.489070:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.489081:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012155cc00/0xf1867c21abfa7b04 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e6d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.489147:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.489155:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.489160:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.489180:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.489188:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.489196:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984493056:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.489482:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.491759:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.491811:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983327232 00000100:00100000:2.0:1746066759.491818:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983327232 00010000:00010000:2.0:1746066759.491854:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.491858:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984493056:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.491880:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066759.491911:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7318 00000100:00100000:2.0:1746066759.491919:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983327232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.491933:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.491939:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.491949:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.491971:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d800/0xf1867c21abfa7af6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e66 expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.491987:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.491991:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.492000:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.492007:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.492035:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.492082:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983327232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 163us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.492088:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7318 00010000:00010000:3.0:1746066759.492264:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.492270:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066759.492322:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066759.492327:0:7244:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066759.492344:0:7244:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.492374:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155cc00/0xf1867c21abfa7b04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.492401:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 13 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.492407:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.492409:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066759.492412:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009414ca00, rc 0) 00000100:00100000:3.0:1746066759.492445:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:838:x1830882983327104:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3392us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.492451:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16337 00000100:00100000:0.0:1746066759.494509:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.494533:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.494576:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.494600:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983327360 00000100:00100000:0.0:1746066759.494609:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983327360 00000100:00100000:0.0:1746066759.494647:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983327488 00000100:00100000:0.0:1746066759.494649:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983327488 00000100:00100000:0.0:1746066759.494659:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983327616 00000100:00100000:0.0:1746066759.494660:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983327616 00000100:00100000:0.0:1746066759.494673:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16212 00000100:00100000:0.0:1746066759.494680:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983327360:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066759.494698:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.494715:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa7b12 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e74 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.494771:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984493184:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066759.494842:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.495082:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16213 00000100:00100000:2.0:1746066759.495089:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983327488:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066759.495096:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.495104:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7b19 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e7b expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.495129:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984493312:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066759.495164:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.495333:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16214 00000100:00100000:3.0:1746066759.495342:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983327616:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066759.495350:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.495359:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8000/0xf1867c21abfa7b20 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e82 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.495383:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984493440:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066759.495408:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.497701:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:12233:1830882984493312:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066759.497734:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7b19 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e7b expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.497746:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848be00/0xf1867c21abfa7b19 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e7b expref: 16 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066759.498203:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984493440:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066759.498220:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8000/0xf1867c21abfa7b20 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e82 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.498228:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8000/0xf1867c21abfa7b20 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e82 expref: 10 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.498241:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8000, rc 0) 00010000:00010000:0.0:1746066759.498565:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848be00, rc 0) 00000100:00100000:0.0:1746066759.498594:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984493184:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066759.498612:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa7b12 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e74 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.498620:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2200/0xf1867c21abfa7b12 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e74 expref: 15 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.498627:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2200, rc 0) 00000100:00100000:3.0:1746066759.498755:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983327616:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3413us (4176us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066759.498763:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16214 00000100:00100000:0.0:1746066759.498957:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983327360:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4276us (4456us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066759.498961:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16212 00000100:00100000:0.0:1746066759.498983:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983327488:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 3895us (4449us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066759.498987:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16213 00000100:00100000:0.0:1746066759.503543:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.503746:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983327872 00000100:00100000:3.0:1746066759.503755:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983327872 00000100:00100000:3.0:1746066759.503805:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16338 00000100:00100000:3.0:1746066759.503813:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:838:x1830882983327872:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066759.503835:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.503855:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7b27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e89 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.503988:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.504004:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.504015:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066759.504027:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066759.504122:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8a00/0xf1867c21abfa7b27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 16 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.504139:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 15 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.504151:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.504154:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066759.504157:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8800, rc 0) 00000100:00100000:3.0:1746066759.504214:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:838:x1830882983327872:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 401us (682us total) trans 8589936681 rc 0/0 00000100:00100000:3.0:1746066759.504220:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16338 00000100:00100000:0.0:1746066759.509402:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.510609:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328128 00000100:00100000:2.0:1746066759.510621:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328128 00000100:00100000:2.0:1746066759.510669:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16215 00000100:00100000:2.0:1746066759.510677:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983328128:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.510695:0:12233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.510713:0:12233:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848a000/0xf1867c21abfa7b3c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e97 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.510772:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984493568:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066759.511481:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.511499:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328000 00000100:00100000:0.0:1746066759.511502:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328000 00000100:00100000:2.0:1746066759.512066:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.512307:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16216 00000100:00100000:0.0:1746066759.512315:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983328000:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:0.0:1746066759.512326:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.512340:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa7b43 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e90 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.512375:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984493696:192.168.204.16@tcp:106: 00000100:00100000:0.0:1746066759.512419:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.513667:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.513734:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.513759:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.513773:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.513784:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.513913:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.514148:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328256 00000100:00100000:1.0:1746066759.514157:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328256 00000100:00100000:1.0:1746066759.514192:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328384 00000100:00100000:1.0:1746066759.514194:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328384 00000100:00100000:1.0:1746066759.514206:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328512 00000100:00100000:1.0:1746066759.514207:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328512 00000100:00100000:1.0:1746066759.514215:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328640 00000100:00100000:1.0:1746066759.514217:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328640 00000100:00100000:1.0:1746066759.514222:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328768 00000100:00100000:1.0:1746066759.514224:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328768 00000100:00100000:1.0:1746066759.514230:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983328896 00000100:00100000:1.0:1746066759.514231:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983328896 00000100:00100000:1.0:1746066759.514243:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16217 00000100:00100000:1.0:1746066759.514250:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983328256:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066759.514293:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514312:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514319:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514326:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 26 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514332:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.514334:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.514337:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514364:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 26 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514376:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 26 pid: 12237 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.514389:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984493824:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.514471:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 15 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514478:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 15 pid: 11630 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.514487:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984493952:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.514512:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 27 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514518:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 27 pid: 9591 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.514524:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984494080:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.514537:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.514560:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16218 00000100:00100000:1.0:1746066759.514565:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983328384:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066759.514584:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514595:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514606:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514613:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 34 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514618:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.514619:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.514621:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514638:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 34 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514645:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.514655:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984494208:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.514680:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514687:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 11 pid: 3528 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.514694:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984494336:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.514714:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514721:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 9 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.514734:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984494464:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.514748:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966300 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.514764:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16219 00000100:00100000:1.0:1746066759.514769:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983328512:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066759.514783:0:12255:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514792:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514799:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514805:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514809:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.514811:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.514812:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514830:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514837:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 34 pid: 12233 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.514844:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984494592:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.514867:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 11 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.514874:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 11 pid: 12233 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.514896:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984494720:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.514918:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 9 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514925:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 9 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.514932:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984494848:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.514944:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096966000 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.514958:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16220 00000100:00100000:1.0:1746066759.514964:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983328640:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066759.514979:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514988:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.514993:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066759.514994:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066759.514996:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.515010:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 26 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.515017:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 26 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.515024:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984494976:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.515039:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f03480 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.515662:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16221 00000100:00100000:3.0:1746066759.515671:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983328768:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066759.515688:0:11630:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515698:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515703:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066759.515705:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066759.515707:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515723:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 27 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515730:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 27 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.515739:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984495104:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.515765:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.515781:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16222 00000100:00100000:3.0:1746066759.515786:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983328896:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066759.515800:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515808:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515815:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515819:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066759.515820:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746066759.515822:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515834:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 9 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515840:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 9 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.515847:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984495232:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.515876:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 34 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.515903:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 34 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.515910:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984495360:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.515923:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76180 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.517685:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984493568:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066759.517714:0:12233:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848a000/0xf1867c21abfa7b3c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e97 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.517725:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848a000/0xf1867c21abfa7b3c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e97 expref: 34 pid: 12233 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066759.517939:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d8cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984493696:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.517958:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa7b43 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e90 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.517965:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe3400/0xf1867c21abfa7b43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e90 expref: 27 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.519156:0:12233:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a000, rc 0) 00000100:00100000:0.0:1746066759.519211:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983328128:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8532us (9821us total) trans 0 rc 301/301 00000100:00100000:0.0:1746066759.519220:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16215 00010000:00010000:1.0:1746066759.519471:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe3400, rc 0) 00000100:00100000:1.0:1746066759.519496:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+26:2014:x1830882983328000:12345-192.168.204.16@tcp:101:cat.0 Request processed in 7183us (8016us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.519501:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16216 00000100:00100000:0.0:1746066759.520289:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984494208:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066759.520299:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984494336:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.520433:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984493824:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.520444:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984493952:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.520451:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984494080:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.520475:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.521697:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984494720:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.521789:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9590:1830882984494464:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.521810:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.522015:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984494848:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066759.522222:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.522239:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329024 00000100:00100000:0.0:1746066759.522245:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329024 00010000:00010000:0.0:1746066759.522274:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 16 pid: 11630 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746066759.522296:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7319 00000100:00100000:0.0:1746066759.522302:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882983329024:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066759.522315:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066759.522335:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 16 pid: 11630 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746066759.522345:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 16 pid: 11630 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746066759.522364:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a58f8000/0xf1867c21abfa7848 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c91 expref: 16 pid: 11630 timeout: 827 lvb_type: 1 00010000:00010000:0.0:1746066759.522380:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066759.522411:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882983329024:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 109us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.522419:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7319 00010000:00010000:2.0:1746066759.522716:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746066759.522764:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984495232:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.522773:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984495360:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.522787:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.522806:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984495104:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.522825:0:11630:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.523146:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984494592:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.523166:0:12255:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.523184:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984494976:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.523191:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.527695:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.527731:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.528462:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.529087:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.529154:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329152 00000100:00100000:2.0:1746066759.529164:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329152 00010000:00010000:2.0:1746066759.529207:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 26 pid: 9591 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.529237:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329408 00000100:00100000:2.0:1746066759.529239:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329408 00010000:00010000:2.0:1746066759.529252:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 12 pid: 12233 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.529822:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329664 00000100:00100000:1.0:1746066759.529827:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329664 00010000:00010000:1.0:1746066759.529847:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 27 pid: 12237 timeout: 827 lvb_type: 1 00000100:00100000:0.0:1746066759.530319:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.530339:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.530690:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.530719:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329280 00000100:00100000:2.0:1746066759.530723:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329280 00010000:00010000:2.0:1746066759.530740:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 13 pid: 3528 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746066759.530759:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7320 00000100:00100000:2.0:1746066759.530767:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983329152:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.530781:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.530803:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 26 pid: 9591 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.530814:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 26 pid: 9591 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.530836:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098f66e00/0xf1867c21abfa770d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bf7 expref: 26 pid: 9591 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.530858:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.530912:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983329152:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 145us (3224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.530918:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7320 00000100:00100000:2.0:1746066759.530932:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7321 00000100:00100000:2.0:1746066759.530937:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983329408:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.530945:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.530956:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 13 pid: 12233 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.530964:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 13 pid: 12233 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.530976:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012155da00/0xf1867c21abfa7ae8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e4a expref: 13 pid: 12233 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.530985:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.530998:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983329408:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.531004:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7321 00000100:00100000:2.0:1746066759.531012:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7322 00000100:00100000:2.0:1746066759.531016:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882983329664:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.531021:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.531027:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 27 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.531035:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 27 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.531044:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984bac00/0xf1867c21abfa773e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c0c expref: 27 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.531052:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.531054:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.531058:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.531066:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.531085:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.531097:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983329664:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.531101:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7322 00000100:00100000:2.0:1746066759.531113:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7323 00000100:00100000:2.0:1746066759.531117:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983329280:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.531124:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.531130:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 11 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.531137:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 11 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.531152:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c7200/0xf1867c21abfa79ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1da2 expref: 11 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.531160:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.531170:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2015:x1830882983329280:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.531175:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7323 00000100:00100000:1.0:1746066759.531219:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329920 00000100:00100000:1.0:1746066759.531224:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329920 00002000:00100000:1.0:1746066759.531253:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5001215) req@ffff880098fb5180 x1830882983329920/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.531262:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb5180 with x1830882983329920 ext(4194304->5001215) 00000100:00100000:3.0:1746066759.531268:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330176 00010000:00010000:1.0:1746066759.531269:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 25 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.531272:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330176 00010000:00010000:1.0:1746066759.531280:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 25 pid: 12233 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746066759.531286:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fb5180 00002000:00100000:3.0:1746066759.531291:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3993600->4194303) req@ffff880098fb7800 x1830882983330176/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.531298:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb7800 with x1830882983330176 ext(3993600->4194303) 00000100:00100000:1.0:1746066759.531301:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 982 00010000:00010000:3.0:1746066759.531303:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.531307:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983329920:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:3.0:1746066759.531311:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746066759.531317:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fb7800 00000100:00100000:3.0:1746066759.531336:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 983 00000100:00100000:3.0:1746066759.531341:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983330176:12345-192.168.204.16@tcp:4:cat.0 00010000:00010000:1.0:1746066759.531450:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531459:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531475:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531481:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531492:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531498:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009629a800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066759.531501:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531508:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531518:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.531524:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009629a800/0xf1867c21abfa7b4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.531530:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.531567:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983328256:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 17317us (17905us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.531571:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.531574:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16217 00000100:00100000:0.0:1746066759.531590:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.531598:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329536 00000100:00100000:1.0:1746066759.531601:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329536 00000100:00100000:0.0:1746066759.531607:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066759.531613:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 10 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746066759.531624:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.531628:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330048 00000100:00100000:1.0:1746066759.531630:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330048 00010000:00010000:1.0:1746066759.531655:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 11 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746066759.531656:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.531664:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7324 00000100:00100000:1.0:1746066759.531669:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+11:2015:x1830882983329536:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.531675:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.531683:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 11 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.531689:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 11 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.531699:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009dbe4200/0xf1867c21abfa7936 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d24 expref: 11 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.531706:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.531719:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983329536:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.531724:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7324 00000100:00100000:1.0:1746066759.531751:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330304 00000100:00100000:1.0:1746066759.531753:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330304 00010000:00010000:1.0:1746066759.531761:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 10 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.531768:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330432 00000100:00100000:1.0:1746066759.531770:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330432 00010000:00010000:1.0:1746066759.531776:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 35 pid: 12237 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746066759.531781:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330560 00000100:00100000:3.0:1746066759.531785:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330560 00000100:00100000:1.0:1746066759.531788:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7325 00000100:00100000:1.0:1746066759.531792:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983330048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.531797:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 36 pid: 12233 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066759.531798:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.531805:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 10 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.531810:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7326 00010000:00010000:1.0:1746066759.531813:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 10 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.531815:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983330304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.531821:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.531823:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b19ed600/0xf1867c21abfa7a71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1df6 expref: 10 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.531828:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 10 pid: 12237 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.531830:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066759.531836:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 9 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.531846:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983330048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 53us (275us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066759.531847:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a58f8a00/0xf1867c21abfa783a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1c83 expref: 9 pid: 12237 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.531852:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7325 00010000:00010000:3.0:1746066759.531861:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.531861:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7327 00000100:00100000:3.0:1746066759.531876:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e2051f12-252a-4bb3-b8f3-833317fca821+7:2016:x1830882983330304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 61us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.531876:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882983330432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066759.531897:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7326 00000100:00100000:3.0:1746066759.531907:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7328 00000100:00100000:3.0:1746066759.531912:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882983330560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.531919:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.531925:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 36 pid: 12233 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.531932:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 36 pid: 12233 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.531942:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848b200/0xf1867c21abfa7a8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e19 expref: 36 pid: 12233 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.531950:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.531951:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.531954:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.531961:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.531975:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.531988:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983330560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.531993:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7328 00010000:00010000:1.0:1746066759.532001:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.532010:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.532011:0:12255:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.532017:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.532018:0:12255:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.532032:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098497200/0xf1867c21abfa7983 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1d4e expref: 34 pid: 12237 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.532035:0:12255:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.532040:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.532041:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.532042:0:12255:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.532044:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.532048:0:12255:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.532050:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.532053:0:12255:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e82600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066759.532055:0:12255:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.532061:0:12255:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.532065:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066759.532069:0:12255:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.532075:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e82600/0xf1867c21abfa7b58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.532079:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983330432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 203us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.532085:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7327 00000100:00100000:1.0:1746066759.532101:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330688 00000100:00100000:1.0:1746066759.532103:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330688 00000100:00100000:3.0:1746066759.532108:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2015:x1830882983328512:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 17339us (18347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.532115:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16219 00000100:00100000:1.0:1746066759.532119:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16223 00000100:00100000:1.0:1746066759.532123:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:841:x1830882983330688:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:3.0:1746066759.532131:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983329792 00010000:00010000:1.0:1746066759.532132:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066759.532134:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983329792 00002000:00100000:3.0:1746066759.532145:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1064960->1835007) req@ffff8800958afb80 x1830882983329792/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746066759.532148:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1e9e expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746066759.532152:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882983329792 ext(1064960->1835007) 00010000:00010000:3.0:1746066759.532157:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 26 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746066759.532159:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd47, atime: 0x6812dd46, ctime: 0x6812dd46, blocks: 0x808 00010000:00010000:3.0:1746066759.532164:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 26 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746066759.532169:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958afb80 00010000:00010000:1.0:1746066759.532169:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.532171:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.532176:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.532180:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 984 00000100:00100000:3.0:1746066759.532185:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+26:2015:x1830882983329792:12345-192.168.204.16@tcp:4:multiop.0 00010000:00010000:1.0:1746066759.532186:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.532194:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356ba00, rc 0) 00000100:00100000:1.0:1746066759.532209:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:841:x1830882983330688:12345-192.168.204.16@tcp:101:cat.0 Request processed in 84us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.532214:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16223 00010000:00010000:2.0:1746066759.532453:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532461:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532472:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532476:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532487:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532492:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5e83e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066759.532495:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532500:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532508:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.532513:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5e83e00/0xf1867c21abfa7b51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.532543:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983328384:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 17978us (18808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.532549:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16218 00000100:00100000:0.0:1746066759.538245:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.538450:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.538468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.538480:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.538492:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.538517:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330816 00000100:00100000:0.0:1746066759.538526:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330816 00000100:00100000:2.0:1746066759.538537:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983330944 00000100:00100000:2.0:1746066759.538541:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983330944 00000100:00100000:2.0:1746066759.538565:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983331072 00000100:00100000:2.0:1746066759.538567:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983331072 00000100:00100000:1.0:1746066759.541250:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983331200 00000100:00100000:1.0:1746066759.541261:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983331200 00000100:00100000:1.0:1746066759.541292:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983331328 00000100:00100000:1.0:1746066759.541294:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983331328 00000100:00100000:1.0:1746066759.541309:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16224 00000100:00100000:1.0:1746066759.541319:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983330944:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.541340:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746066759.541791:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16225 00000100:00100000:3.0:1746066759.541801:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983330816:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.541811:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.541822:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ea5 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.541851:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.541854:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.541864:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066759.541877:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16226 00010000:00010000:3.0:1746066759.541894:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066759.541895:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:2016:x1830882983331072:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.541903:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.541909:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8200, rc 0) 00010000:00010000:2.0:1746066759.541912:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1eb3 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066759.541930:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd47, blocks: 0x800 00010000:00010000:2.0:1746066759.541940:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.541941:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.541946:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.541957:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.541963:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848be00, rc 0) 00000100:00100000:3.0:1746066759.541969:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+31:2015:x1830882983330816:12345-192.168.204.16@tcp:101:cat.0 Request processed in 170us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.541975:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16225 00000100:00100000:2.0:1746066759.541981:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983331072:12345-192.168.204.16@tcp:101:cat.0 Request processed in 98us (3512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.541986:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16226 00000100:00100000:3.0:1746066759.541991:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16227 00000100:00100000:3.0:1746066759.541996:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983331200:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:2.0:1746066759.541997:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16228 00000100:00100000:2.0:1746066759.542001:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983331328:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.542002:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.542007:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.542009:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7b90 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1eba expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.542013:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa7b97 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ec1 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.542045:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984495488:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066759.542045:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984495616:192.168.204.16@tcp:106: 00000100:00100000:2.0:1746066759.542087:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746066759.542090:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1eac expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066759.542103:0:12237:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd47, atime: 0x6812dd47, ctime: 0x6812dd47, blocks: 0x808 00010000:00010000:1.0:1746066759.542112:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.542114:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.542119:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.542128:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.542140:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356b200, rc 0) 00000100:00100000:3.0:1746066759.544584:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76180 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.545414:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983330944:12345-192.168.204.16@tcp:101:cat.0 Request processed in 4087us (6953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.545436:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16224 00000100:00100000:2.0:1746066759.545659:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983330176:12345-192.168.204.16@tcp:4:cat.0 Request processed in 14315us (15337us total) trans 17179874457 rc 0/0 00000100:00100000:2.0:1746066759.545669:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 983 00002000:00100000:2.0:1746066759.545681:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (3993600->4194303) req@ffff880098fb7800 x1830882983330176/t17179874457(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.545691:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb7800 with x1830882983330176 ext(3993600->4194303) 00010000:00010000:2.0:1746066759.545701:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.545713:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.545720:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098fb7800 00000100:00100000:0.0:1746066759.550070:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.550141:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983329920:12345-192.168.204.16@tcp:4:cat.0 Request processed in 18831us (21051us total) trans 21474841910 rc 0/0 00000100:00100000:1.0:1746066759.550152:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 982 00002000:00100000:1.0:1746066759.550165:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5001215) req@ffff880098fb5180 x1830882983329920/t21474841910(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.550173:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098fb5180 with x1830882983329920 ext(4194304->5001215) 00010000:00010000:1.0:1746066759.550183:0:29519:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 28 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.550195:0:29519:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 28 pid: 12233 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746066759.550201:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098fb5180 00000100:00100000:1.0:1746066759.550234:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983331456 00000100:00100000:1.0:1746066759.550240:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983331456 00000100:00100000:1.0:1746066759.550280:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16229 00000100:00100000:1.0:1746066759.550286:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983331456:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.550700:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.550717:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009356a600/0xf1867c21abfa7b9e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ec8 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.550905:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984495744:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066759.550973:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f03540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.553180:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.553262:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.554659:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983331712 00000100:00100000:2.0:1746066759.554671:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983331712 00002000:00100000:2.0:1746066759.554721:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800958adf80 x1830882983331712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.554730:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adf80 with x1830882983331712 ext(0->1048575) 00002000:00010000:2.0:1746066759.554736:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958adf80 00000100:00100000:2.0:1746066759.554761:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4385 00000100:00100000:2.0:1746066759.554770:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882983331712:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066759.556319:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984495488:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066759.556352:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7b90 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eba expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.556370:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8c00/0xf1867c21abfa7b90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eba expref: 32 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.556387:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800962c8c00, rc 0) 00000100:00100000:2.0:1746066759.556492:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983332096 00000100:00100000:2.0:1746066759.556497:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983332096 00010000:00010000:2.0:1746066759.556521:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.556541:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7329 00000100:00100000:2.0:1746066759.556546:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983332096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.556559:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.556570:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.556579:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 33 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.556597:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.556599:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.556603:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.556611:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.556629:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.556642:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983332096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 95us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.556647:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7329 00000100:00100000:2.0:1746066759.556683:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984495616:192.168.204.16@tcp:106: 00010000:00010000:2.0:1746066759.556697:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa7b97 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ec1 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.556705:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848a000/0xf1867c21abfa7b97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ec1 expref: 31 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.556716:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a000, rc 0) 00000100:00100000:2.0:1746066759.556731:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983331328:12345-192.168.204.16@tcp:101:cat.0 Request processed in 14729us (18238us total) trans 0 rc 301/301 00000100:00100000:2.0:1746066759.556737:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16228 00000100:00100000:3.0:1746066759.557590:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983331200:12345-192.168.204.16@tcp:101:cat.0 Request processed in 15590us (19105us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066759.557596:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16227 00010000:00010000:3.0:1746066759.557620:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557628:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557647:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557654:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557661:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557668:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c8400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066759.557672:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557679:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557693:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.557699:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800962c8400/0xf1867c21abfa7b6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.557741:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2015:x1830882983328896:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 41955us (43828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.557747:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16222 00000100:00100000:3.0:1746066759.557913:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.558135:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983331968 00000100:00100000:0.0:1746066759.558142:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983331968 00000100:00100000:0.0:1746066759.558192:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16339 00000100:00100000:0.0:1746066759.558199:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+47:849:x1830882983331968:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:0.0:1746066759.558220:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.558235:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7ba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ecf expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.558335:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066759.558350:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.558357:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.558363:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 5/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:0.0:1746066759.558392:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.558402:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746066759.558413:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984495872:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.558486:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 14 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.558493:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:0.0:1746066759.558505:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984496000:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066759.558522:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db840 going to sleep for 11 seconds 00010000:00010000:1.0:1746066759.558638:0:1893:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.16@tcp) returned -22 from glimpse AST (req@ffff880098fbd500 x1830882984495744) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 32 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.558659:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7a94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3993600->18446744073709551615] (req 3993600->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e20 expref: 32 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.558673:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984495744:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.558693:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009356a600/0xf1867c21abfa7b9e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ec8 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.558702:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356a600/0xf1867c21abfa7b9e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ec8 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.558716:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009356a600, rc 0) 00000100:00100000:1.0:1746066759.558736:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983331456:12345-192.168.204.16@tcp:101:cat.0 Request processed in 8450us (8678us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.558742:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16229 00000100:00100000:1.0:1746066759.558783:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.558878:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983332224 00000100:00100000:2.0:1746066759.558910:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983332224 00010000:00010000:2.0:1746066759.558928:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 30 pid: 12233 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.558953:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7330 00000100:00100000:2.0:1746066759.558963:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983332224:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.558972:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.558982:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 30 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.558992:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 30 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.559004:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155ce00/0xf1867c21abfa7aa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5001215) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e2e expref: 30 pid: 12233 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.559013:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.559015:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.559018:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.559026:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.559054:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.559073:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983332224:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 115us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.559079:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7330 00010000:00010000:3.0:1746066759.559080:0:11630:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559088:0:11630:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559101:0:11630:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559108:0:11630:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559114:0:11630:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559119:0:11630:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066759.559121:0:11630:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559128:0:11630:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559142:0:11630:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.559148:0:11630:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9600/0xf1867c21abfa7b66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.559183:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983328768:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 43513us (45397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.559190:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16221 00000100:00100000:2.0:1746066759.564902:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983329792:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 32684us (33340us total) trans 21474841911 rc 0/0 00000100:00100000:2.0:1746066759.564916:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 984 00002000:00100000:2.0:1746066759.564932:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1064960->1835007) req@ffff8800958afb80 x1830882983329792/t21474841911(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.564941:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958afb80 with x1830882983329792 ext(1064960->1835007) 00010000:00010000:2.0:1746066759.564953:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.564967:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.564974:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800958afb80 00000100:00100000:0.0:1746066759.566323:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.566479:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984495872:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.566487:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984496000:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.566511:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:3.0:1746066759.566686:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983332480 00000100:00100000:3.0:1746066759.566695:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983332480 00010000:00010000:3.0:1746066759.566726:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.566750:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7331 00000100:00100000:3.0:1746066759.566757:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2016:x1830882983332480:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.566772:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.566777:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.566785:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.566807:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009414ca00/0xf1867c21abfa7b0b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e6d expref: 15 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.566824:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.566828:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.566836:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.566841:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066759.567114:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.568092:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983332480:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1332us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.568100:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7331 00000100:00100000:0.0:1746066759.568639:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.568809:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983332352 00000100:00100000:3.0:1746066759.568814:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983332352 00010000:00010000:3.0:1746066759.568833:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.568947:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7332 00000100:00100000:2.0:1746066759.568955:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2016:x1830882983332352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.568966:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.568971:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.568981:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.568997:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800962c8800/0xf1867c21abfa7b2e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e89 expref: 14 pid: 7244 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.569010:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.569014:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.569022:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.569029:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.569049:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.569078:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2016:x1830882983332352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 124us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.569084:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7332 00000100:00100000:2.0:1746066759.569164:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2013:x1830882983331712:12345-192.168.204.16@tcp:3:cat.0 Request processed in 14396us (15994us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.569172:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4385 00002000:00100000:2.0:1746066759.569181:0:29519:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800958adf80 x1830882983331712/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.569195:0:29519:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800958adf80 with x1830882983331712 ext(0->1048575) 00002000:00010000:2.0:1746066759.569200:0:29519:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800958adf80 00010000:00010000:2.0:1746066759.569219:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.569225:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:2.0:1746066759.569243:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:2.0:1746066759.569369:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7ba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 50 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.569381:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 49 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.569386:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.569388:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066759.569391:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2000, rc 0) 00000100:00100000:2.0:1746066759.569412:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+49:849:x1830882983331968:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 11215us (11500us total) trans 8589936682 rc 0/0 00000100:00100000:2.0:1746066759.569417:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16339 00000100:00100000:1.0:1746066759.569944:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983332608 00000100:00100000:1.0:1746066759.569949:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983332608 00010000:00010000:1.0:1746066759.569965:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.570135:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7333 00000100:00100000:1.0:1746066759.570141:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983332608:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.570148:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.570164:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.570173:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.570187:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ece000/0xf1867c21abfa7ab0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1835007) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e3c expref: 29 pid: 3528 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.570198:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.570200:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.570204:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.570211:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.570225:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.570243:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983332608:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 102us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.570248:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7333 00010000:00010000:0.0:1746066759.570460:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570468:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570483:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570490:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570497:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570503:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009356bc00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066759.570507:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570514:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570530:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.570535:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356bc00/0xf1867c21abfa7b5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.570580:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983328640:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 55616us (56806us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.570587:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16220 00000100:00100000:3.0:1746066759.574362:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.574397:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.574411:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.574489:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.574554:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983332864 00000100:00100000:2.0:1746066759.574564:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983332864 00000100:00100000:2.0:1746066759.574608:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16340 00000100:00100000:2.0:1746066759.574615:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:838:x1830882983332864:12345-192.168.204.16@tcp:36:lfs.0 00000100:00100000:2.0:1746066759.574719:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:838:x1830882983332864:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 103us (366us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746066759.574729:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16340 00000100:00100000:2.0:1746066759.574750:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983333120 00000100:00100000:2.0:1746066759.574753:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983333120 00002000:00100000:2.0:1746066759.574776:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880095cef100 x1830882983333120/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.574785:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef100 with x1830882983333120 ext(0->1048575) 00002000:00010000:2.0:1746066759.574791:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef100 00000100:00100000:2.0:1746066759.574810:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983333376 00000100:00100000:2.0:1746066759.574812:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983333376 00002000:00100000:2.0:1746066759.574826:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095cefb80 x1830882983333376/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.574833:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cefb80 with x1830882983333376 ext(1048576->2097151) 00002000:00010000:2.0:1746066759.574836:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cefb80 00000100:00100000:2.0:1746066759.574845:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983333632 00000100:00100000:2.0:1746066759.574847:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983333632 00002000:00100000:2.0:1746066759.574857:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095ceed80 x1830882983333632/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.574862:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceed80 with x1830882983333632 ext(1048576->2097151) 00002000:00010000:2.0:1746066759.574865:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ceed80 00000100:00100000:2.0:1746066759.574874:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4386 00000100:00100000:2.0:1746066759.574878:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983333120:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066759.574971:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4387 00000100:00100000:1.0:1746066759.574978:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983333376:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.575499:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4388 00000100:00100000:0.0:1746066759.575507:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983333632:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.582540:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.582880:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983333760 00000100:00100000:2.0:1746066759.582929:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983333760 00000100:00100000:2.0:1746066759.582980:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16230 00000100:00100000:2.0:1746066759.582989:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+32:841:x1830882983333760:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.583008:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.583027:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ed6 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.583054:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.583056:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.583064:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.583079:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 33 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.583089:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848a400, rc 0) 00000100:00100000:2.0:1746066759.583142:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:841:x1830882983333760:12345-192.168.204.16@tcp:101:cat.0 Request processed in 154us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.583148:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16230 00000100:00100000:0.0:1746066759.588473:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.588773:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095ceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2051f12-252a-4bb3-b8f3-833317fca821+11:2016:x1830882983333632:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13264us (14280us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.588786:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4388 00002000:00100000:2.0:1746066759.588800:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880095ceed80 x1830882983333632/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.588810:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095ceed80 with x1830882983333632 ext(1048576->2097151) 00002000:00010000:2.0:1746066759.588816:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095ceed80 00000100:00100000:1.0:1746066759.589109:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983334016 00000100:00100000:1.0:1746066759.589118:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983334016 00000100:00100000:1.0:1746066759.589158:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5972 00000100:00100000:1.0:1746066759.589165:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:838:x1830882983334016:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:1.0:1746066759.591601:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:838:x1830882983334016:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 2425us (3129us total) trans 8589936683 rc 0/0 00000100:00100000:1.0:1746066759.591612:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5972 00000100:00100000:3.0:1746066759.593173:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983333120:12345-192.168.204.16@tcp:3:cat.0 Request processed in 18289us (18770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066759.593183:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4386 00002000:00100000:3.0:1746066759.593195:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880095cef100 x1830882983333120/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.593204:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cef100 with x1830882983333120 ext(0->1048575) 00002000:00010000:3.0:1746066759.593211:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095cef100 00000100:00100000:0.0:1746066759.596878:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.597154:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983333376:12345-192.168.204.16@tcp:3:cat.0 Request processed in 22174us (22739us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066759.597166:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4387 00002000:00100000:1.0:1746066759.597177:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880095cefb80 x1830882983333376/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.597187:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095cefb80 with x1830882983333376 ext(1048576->2097151) 00002000:00010000:1.0:1746066759.597193:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095cefb80 00000100:00100000:2.0:1746066759.597267:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983334272 00000100:00100000:2.0:1746066759.597274:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983334272 00000100:00100000:2.0:1746066759.597320:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5973 00000100:00100000:2.0:1746066759.597327:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:838:x1830882983334272:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746066759.597503:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:838:x1830882983334272:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 176us (638us total) trans 8589936684 rc 0/0 00000100:00100000:2.0:1746066759.597509:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5973 00000100:00100000:0.0:1746066759.598697:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.599194:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983334528 00000100:00100000:1.0:1746066759.599200:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983334528 00002000:00100000:1.0:1746066759.599238:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009d9b2680 x1830882983334528/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.599247:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2680 with x1830882983334528 ext(1048576->2097151) 00002000:00010000:1.0:1746066759.599251:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b2680 00000100:00100000:1.0:1746066759.599278:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4389 00000100:00100000:1.0:1746066759.599284:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983334528:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.613169:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.614125:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983334656 00000100:00100000:3.0:1746066759.614136:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983334656 00000100:00100000:3.0:1746066759.614198:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16231 00000100:00100000:3.0:1746066759.614207:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+28:848:x1830882983334656:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.614228:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.614249:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1edd expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066759.614274:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd48, blocks: 0x800 00010000:00010000:3.0:1746066759.614296:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.614298:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.614306:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.614321:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.614331:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155c000, rc 0) 00000100:00100000:3.0:1746066759.614377:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2051f12-252a-4bb3-b8f3-833317fca821+29:848:x1830882983334656:12345-192.168.204.16@tcp:101:cat.0 Request processed in 171us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.614384:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16231 00000100:00100000:1.0:1746066759.614940:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+33:2014:x1830882983334528:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15654us (16243us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066759.614953:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4389 00002000:00100000:1.0:1746066759.614963:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009d9b2680 x1830882983334528/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.614971:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2680 with x1830882983334528 ext(1048576->2097151) 00002000:00010000:1.0:1746066759.614976:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b2680 00000100:00100000:0.0:1746066759.618865:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.619077:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983334784 00000100:00100000:2.0:1746066759.619087:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983334784 00000100:00100000:2.0:1746066759.619762:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16232 00000100:00100000:2.0:1746066759.619772:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+33:841:x1830882983334784:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.619793:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.619813:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ee4 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.619839:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.619840:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.619848:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.619868:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 34 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.619878:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848aa00, rc 0) 00000100:00100000:2.0:1746066759.619954:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+34:841:x1830882983334784:12345-192.168.204.16@tcp:101:cat.0 Request processed in 183us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.619960:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16232 00000100:00100000:0.0:1746066759.621950:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.622043:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983335040 00000100:00100000:1.0:1746066759.622051:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983335040 00002000:00100000:1.0:1746066759.622088:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d9b1500 x1830882983335040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.622098:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1500 with x1830882983335040 ext(1048576->2097151) 00002000:00010000:1.0:1746066759.622102:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1500 00000100:00100000:1.0:1746066759.622128:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4390 00000100:00100000:1.0:1746066759.622133:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983335040:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.631752:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.633048:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983335040:12345-192.168.204.16@tcp:3:cat.0 Request processed in 10909us (11098us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066759.633062:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4390 00002000:00100000:1.0:1746066759.633074:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009d9b1500 x1830882983335040/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.633083:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b1500 with x1830882983335040 ext(1048576->2097151) 00002000:00010000:1.0:1746066759.633088:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009d9b1500 00000100:00100000:1.0:1746066759.634075:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983335296 00000100:00100000:1.0:1746066759.634083:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983335296 00002000:00100000:1.0:1746066759.634210:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009d9b0700 x1830882983335296/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.634223:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882983335296 ext(1048576->2097151) 00002000:00010000:1.0:1746066759.634227:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:1.0:1746066759.634243:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4391 00000100:00100000:1.0:1746066759.634417:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983335296:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.642047:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.642659:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.642805:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983335424 00000100:00100000:2.0:1746066759.642816:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983335424 00000100:00100000:2.0:1746066759.642862:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983335552 00000100:00100000:2.0:1746066759.642864:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983335552 00000100:00100000:2.0:1746066759.643839:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16233 00000100:00100000:2.0:1746066759.643849:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+29:2015:x1830882983335424:12345-192.168.204.16@tcp:101:cat.0 00000100:00100000:0.0:1746066759.643870:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066759.643872:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.643916:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1eeb expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066759.643942:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd48, blocks: 0x1668 00010000:00010000:2.0:1746066759.643966:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.643968:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.643977:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.643995:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.644005:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009848ba00, rc 0) 00000100:00100000:2.0:1746066759.644054:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983335424:12345-192.168.204.16@tcp:101:cat.0 Request processed in 207us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.644060:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16233 00000100:00100000:2.0:1746066759.646109:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983335680 00000100:00100000:2.0:1746066759.646119:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983335680 00000100:00100000:1.0:1746066759.646140:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16234 00000100:00100000:1.0:1746066759.646157:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+9:2015:x1830882983335552:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.646176:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.646195:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ef2 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746066759.646217:0:1893:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd48, blocks: 0x1000 00010000:00010000:1.0:1746066759.646236:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.646237:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.646248:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.646264:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 10 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.646273:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32a00, rc 0) 00000100:00100000:1.0:1746066759.646320:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983335552:12345-192.168.204.16@tcp:101:cat.0 Request processed in 167us (3657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.646861:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16234 00000100:00100000:1.0:1746066759.646922:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16235 00000100:00100000:1.0:1746066759.646936:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:849:x1830882983335680:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.646947:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.646955:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ef9 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.646975:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.646984:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.646986:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.646988:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2539520->3145727] (req 2539520->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.647017:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 29 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.647030:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 29 pid: 3528 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.647045:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984496128:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.647120:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.649172:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.649475:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983335936 00000100:00100000:3.0:1746066759.649483:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983335936 00000100:00100000:3.0:1746066759.649645:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16341 00000100:00100000:3.0:1746066759.649652:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+25:852:x1830882983335936:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066759.649675:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.649692:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d200/0xf1867c21abfa7be4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f00 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.649792:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.649807:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:3.0:1746066759.649818:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:3.0:1746066759.649829:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066759.649953:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d200/0xf1867c21abfa7be4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.649977:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 27 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.649985:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.649987:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066759.649990:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012155d000, rc 0) 00000100:00100000:3.0:1746066759.650026:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:852:x1830882983335936:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 374us (862us total) trans 8589936685 rc 0/0 00000100:00100000:3.0:1746066759.650032:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16341 00000100:00100000:1.0:1746066759.650219:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2016:x1830882983335296:12345-192.168.204.16@tcp:3:cat.0 Request processed in 15968us (18476us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066759.650228:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4391 00002000:00100000:1.0:1746066759.650244:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009d9b0700 x1830882983335296/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.650258:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b0700 with x1830882983335296 ext(1048576->2097151) 00002000:00010000:1.0:1746066759.650263:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009d9b0700 00000100:00100000:1.0:1746066759.654814:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984496128:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.654851:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2539520->3145727] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.654869:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b32200, rc 0) 00000100:00100000:1.0:1746066759.654944:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:849:x1830882983335680:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 8010us (11073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.654953:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16235 00000100:00100000:0.0:1746066759.660131:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066759.660155:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984496256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066759.660228:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066759.660377:0:11459:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984496256 00000100:00100000:2.0:1746066759.660386:0:11459:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984496256 00000100:00080000:0.0:1746066759.660593:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066759.660927:0:11459:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1746066759.660936:0:11459:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984496256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746066759.660963:0:11459:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1060273472 pending 1216512 free 3912097792 avail 3669745664 00000100:00100000:2.0:1746066759.661015:0:11459:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3776:x1830882984496256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.661022:0:11459:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1746066759.661151:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3776:1830882984496256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746066759.661613:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.662064:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.662105:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.662159:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983336192 00000100:00100000:3.0:1746066759.662165:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983336192 00002000:00100000:3.0:1746066759.662196:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009d9b2d80 x1830882983336192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.662205:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2d80 with x1830882983336192 ext(2097152->4194303) 00010000:00010000:3.0:1746066759.662214:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.662227:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00002000:00010000:3.0:1746066759.662234:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d9b2d80 00000100:00100000:3.0:1746066759.662245:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983336576 00000100:00100000:3.0:1746066759.662247:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983336576 00002000:00100000:3.0:1746066759.662255:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800967aaa00 x1830882983336576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.662261:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882983336576 ext(2097152->4194303) 00002000:00010000:3.0:1746066759.662264:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967aaa00 00000100:00100000:3.0:1746066759.662274:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 985 00000100:00100000:3.0:1746066759.662277:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983336192:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:3.0:1746066759.663624:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4392 00000100:00100000:3.0:1746066759.663632:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983336576:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.664082:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983336448 00000100:00100000:2.0:1746066759.664087:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983336448 00000100:00100000:2.0:1746066759.664124:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16236 00000100:00100000:2.0:1746066759.664129:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:841:x1830882983336448:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.664138:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.664159:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f07 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.664182:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.664183:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.664191:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.664204:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.664213:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009dbe2a00, rc 0) 00000100:00100000:2.0:1746066759.664240:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:841:x1830882983336448:12345-192.168.204.16@tcp:101:cat.0 Request processed in 111us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.664246:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16236 00000100:00100000:0.0:1746066759.666389:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.666612:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983336704 00000100:00100000:1.0:1746066759.666621:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983336704 00000100:00100000:1.0:1746066759.666658:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16237 00000100:00100000:1.0:1746066759.666665:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+32:852:x1830882983336704:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.666683:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.666699:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f0e expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.666729:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.666736:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.666742:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.666745:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.666748:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1433600->1667071] (req 1433600->1667071) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.666778:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.666789:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 28 pid: 1893 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.666801:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984496384:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.666899:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 33 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.666908:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 33 pid: 11630 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.666915:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984496512:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.666935:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.679528:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.679626:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984496384:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.679638:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984496512:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.679674:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1433600->1667071] (req 1433600->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 33 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.679694:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b33800, rc 0) 00000100:00100000:1.0:1746066759.679754:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+33:852:x1830882983336704:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 13088us (13373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.679763:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16237 00000100:00100000:1.0:1746066759.681198:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983336960 00000100:00100000:1.0:1746066759.681213:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983336960 00002000:00100000:1.0:1746066759.681256:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a9500 x1830882983336960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.681265:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9500 with x1830882983336960 ext(1048576->2097151) 00010000:00010000:1.0:1746066759.681273:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.681284:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00002000:00010000:1.0:1746066759.681291:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9500 00000100:00100000:1.0:1746066759.681321:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 986 00000100:00100000:1.0:1746066759.681328:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983336960:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066759.682741:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.682807:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983337088 00000100:00100000:3.0:1746066759.682813:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983337088 00010000:00010000:3.0:1746066759.682842:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 33 pid: 11630 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.682879:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7334 00000100:00100000:3.0:1746066759.682902:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+33:2016:x1830882983337088:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.682916:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.682934:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 33 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.682945:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 33 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.682966:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012155c000/0xf1867c21abfa7bc1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1edd expref: 33 pid: 11630 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.682989:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.683012:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2016:x1830882983337088:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.683018:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7334 00000100:00100000:3.0:1746066759.684118:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983336192:12345-192.168.204.16@tcp:3:cat.0 Request processed in 21835us (22503us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066759.684127:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 985 00002000:00100000:3.0:1746066759.684137:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->4194303) req@ffff88009d9b2d80 x1830882983336192/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.684146:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009d9b2d80 with x1830882983336192 ext(2097152->4194303) 00010000:00010000:3.0:1746066759.684153:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:3.0:1746066759.684163:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00002000:00010000:3.0:1746066759.684169:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009d9b2d80 00000100:00100000:0.0:1746066759.695114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.695282:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983336576:12345-192.168.204.16@tcp:3:cat.0 Request processed in 31648us (33174us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746066759.695295:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4392 00002000:00100000:3.0:1746066759.695307:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->4194303) req@ffff8800967aaa00 x1830882983336576/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.695317:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aaa00 with x1830882983336576 ext(2097152->4194303) 00002000:00010000:3.0:1746066759.695324:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967aaa00 00000100:00100000:1.0:1746066759.695469:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983337216 00000100:00100000:1.0:1746066759.695477:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983337216 00010000:00010000:1.0:1746066759.695505:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.695525:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7335 00000100:00100000:1.0:1746066759.695530:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983337216:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.695545:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.695563:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066759.695577:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066759.695598:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009848ba00/0xf1867c21abfa7bcf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eeb expref: 30 pid: 3528 timeout: 827 lvb_type: 1 00010000:00010000:1.0:1746066759.695625:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.695628:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.695634:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.695642:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.695673:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.695684:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984496640:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066759.695755:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.699468:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.699577:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984496640:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066759.699602:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.699652:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+29:2016:x1830882983337216:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 4120us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.699664:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7335 00000100:00100000:3.0:1746066759.699809:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983337472 00000100:00100000:3.0:1746066759.699817:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983337472 00002000:00100000:3.0:1746066759.699858:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2539520->2543615) req@ffff8800967aad80 x1830882983337472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.699869:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882983337472 ext(2539520->2543615) 00002000:00010000:3.0:1746066759.699874:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:3.0:1746066759.699922:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4393 00000100:00100000:3.0:1746066759.699930:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882983337472:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066759.700061:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2013:x1830882983337472:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 131us (606us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066759.700067:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4393 00002000:00100000:3.0:1746066759.700071:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (2539520->2543615) req@ffff8800967aad80 x1830882983337472/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.700079:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aad80 with x1830882983337472 ext(2539520->2543615) 00002000:00010000:3.0:1746066759.700081:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967aad80 00000100:00100000:2.0:1746066759.701092:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983336960:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 19760us (21571us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.701100:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 986 00002000:00100000:2.0:1746066759.701107:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800967a9500 x1830882983336960/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.701116:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9500 with x1830882983336960 ext(1048576->2097151) 00010000:00010000:2.0:1746066759.701124:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.701138:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.701145:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a9500 00000100:00100000:0.0:1746066759.707327:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.707429:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983337600 00000100:00100000:1.0:1746066759.707440:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983337600 00000100:00100000:2.0:1746066759.708602:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16238 00000100:00100000:2.0:1746066759.708617:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+29:848:x1830882983337600:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:2.0:1746066759.708637:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.708656:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f15 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.708687:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.708695:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.708697:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.708701:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.708734:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 28 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.708745:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 28 pid: 1893 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.708758:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984496768:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.708849:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800970823c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.709749:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.709792:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.709853:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983337856 00000100:00100000:2.0:1746066759.709859:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983337856 00002000:00100000:2.0:1746066759.709919:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2539519) req@ffff8800967a8e00 x1830882983337856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.709929:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882983337856 ext(2097152->2539519) 00010000:00010000:2.0:1746066759.709936:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.709945:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.709951:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a8e00 00000100:00100000:2.0:1746066759.709977:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 987 00000100:00100000:2.0:1746066759.709983:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983337856:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:1.0:1746066759.711527:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983337984 00000100:00100000:1.0:1746066759.711535:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983337984 00010000:00010000:1.0:1746066759.711561:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.711598:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7336 00000100:00100000:1.0:1746066759.711605:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983337984:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.711616:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.711634:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.711645:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.711667:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009dbe2a00/0xf1867c21abfa7bf9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f07 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:1.0:1746066759.711685:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.711687:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.711695:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.711703:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.711737:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.711751:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984496896:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066759.711828:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.715572:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.715897:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983338112 00000100:00100000:1.0:1746066759.715907:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983338112 00000100:00100000:1.0:1746066759.715953:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16239 00000100:00100000:1.0:1746066759.715961:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+34:849:x1830882983338112:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.715981:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.716001:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f1c expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.716032:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.716039:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.716041:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.716044:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.716073:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 9 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.716083:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 9 pid: 1893 timeout: 827 lvb_type: 1 00000100:00100000:1.0:1746066759.716094:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984497024:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.716312:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983337856:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6328us (6566us total) trans 0 rc 442368/442368 00000100:00100000:2.0:1746066759.716321:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 987 00002000:00100000:2.0:1746066759.716330:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2097152->2539519) req@ffff8800967a8e00 x1830882983337856/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 442368/442368 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.716339:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8e00 with x1830882983337856 ext(2097152->2539519) 00010000:00010000:2.0:1746066759.716345:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.716354:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 29 pid: 1893 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.716360:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967a8e00 00000100:00100000:1.0:1746066759.716585:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.717498:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984496768:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.717518:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 30 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.717531:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a23c00, rc 0) 00000100:00100000:1.0:1746066759.717607:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984496896:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066759.717621:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.717940:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+30:848:x1830882983337600:12345-192.168.204.16@tcp:101:cat.0 Request processed in 9327us (10623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.717947:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16238 00000100:00100000:1.0:1746066759.718162:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983337984:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6556us (8368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.718171:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7336 00000100:00100000:0.0:1746066759.719913:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.719953:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.720686:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983338240 00000100:00100000:2.0:1746066759.720695:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983338240 00002000:00100000:2.0:1746066759.720739:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9a:0x0] (2539520->3145727) req@ffff8800967aa680 x1830882983338240/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.720749:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882983338240 ext(2539520->3145727) 00010000:00010000:2.0:1746066759.720757:0:20358:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 28 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.720769:0:20358:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 28 pid: 1893 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.720775:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aa680 00000100:00100000:2.0:1746066759.720794:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983338496 00000100:00100000:2.0:1746066759.720797:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983338496 00002000:00100000:2.0:1746066759.720808:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1433600->1437695) req@ffff8800967a8000 x1830882983338496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.720815:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882983338496 ext(1433600->1437695) 00002000:00010000:2.0:1746066759.720818:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:2.0:1746066759.720837:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 988 00000100:00100000:2.0:1746066759.720844:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983338240:12345-192.168.204.16@tcp:4:cat.0 00000100:00100000:2.0:1746066759.721027:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4394 00000100:00100000:2.0:1746066759.721032:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983338496:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066759.721135:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983338496:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 102us (1181us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066759.721141:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4394 00002000:00100000:2.0:1746066759.721146:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1433600->1437695) req@ffff8800967a8000 x1830882983338496/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.721152:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8000 with x1830882983338496 ext(1433600->1437695) 00002000:00010000:2.0:1746066759.721155:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8000 00000100:00100000:1.0:1746066759.722680:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1893:1830882984497024:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.722708:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 35 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.722723:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a576a000, rc 0) 00000100:00100000:1.0:1746066759.722753:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+35:849:x1830882983338112:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 6792us (7191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.722760:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16239 00000100:00100000:1.0:1746066759.728394:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.728788:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983338624 00000100:00100000:2.0:1746066759.728797:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983338624 00010000:00010000:2.0:1746066759.728837:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 10 pid: 1893 timeout: 827 lvb_type: 1 00000100:00100000:2.0:1746066759.728867:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7337 00000100:00100000:2.0:1746066759.728875:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983338624:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.728911:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.728933:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 10 pid: 1893 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.728945:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 10 pid: 1893 timeout: 827 lvb_type: 1 00010000:00010000:2.0:1746066759.728970:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b32a00/0xf1867c21abfa7bd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef2 expref: 10 pid: 1893 timeout: 827 lvb_type: 1 00000100:00100000:3.0:1746066759.729747:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.729768:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983338880 00000100:00100000:3.0:1746066759.729771:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983338880 00002000:00100000:3.0:1746066759.729804:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1662976->1667071) req@ffff8800a4d03b80 x1830882983338880/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.729814:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d03b80 with x1830882983338880 ext(1662976->1667071) 00002000:00010000:3.0:1746066759.729818:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d03b80 00000100:00100000:3.0:1746066759.729839:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4395 00000100:00100000:3.0:1746066759.729845:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983338880:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066759.729997:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983338880:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 152us (250us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746066759.730003:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4395 00002000:00100000:3.0:1746066759.730007:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1662976->1667071) req@ffff8800a4d03b80 x1830882983338880/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.730014:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4d03b80 with x1830882983338880 ext(1662976->1667071) 00002000:00010000:3.0:1746066759.730016:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4d03b80 00010000:00010000:2.0:1746066759.730596:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.730600:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.730610:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.730619:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.730655:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.730668:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984497152:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066759.730719:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.732013:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983338240:12345-192.168.204.16@tcp:4:cat.0 Request processed in 11166us (12102us total) trans 21474841912 rc 0/0 00000100:00100000:2.0:1746066759.732021:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 988 00002000:00100000:2.0:1746066759.732029:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9a:0x0] (2539520->3145727) req@ffff8800967aa680 x1830882983338240/t21474841912(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.732043:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967aa680 with x1830882983338240 ext(2539520->3145727) 00010000:00010000:2.0:1746066759.732051:0:9595:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.732064:0:9595:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 827 lvb_type: 0 00002000:00010000:2.0:1746066759.732070:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967aa680 00000100:00100000:0.0:1746066759.733481:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.733580:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983339136 00000100:00100000:2.0:1746066759.733588:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983339136 00002000:00100000:2.0:1746066759.733620:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2101248->2105343) req@ffff8800967a9f80 x1830882983339136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.733630:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882983339136 ext(2101248->2105343) 00002000:00010000:2.0:1746066759.733635:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9f80 00000100:00100000:2.0:1746066759.733652:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4396 00000100:00100000:2.0:1746066759.733658:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983339136:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.734015:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983339136:12345-192.168.204.16@tcp:3:cat.0 Request processed in 355us (536us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746066759.734021:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4396 00002000:00100000:2.0:1746066759.734026:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2101248->2105343) req@ffff8800967a9f80 x1830882983339136/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.734032:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9f80 with x1830882983339136 ext(2101248->2105343) 00002000:00010000:2.0:1746066759.734035:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9f80 00000100:00100000:2.0:1746066759.734073:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984497152:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066759.734087:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.735120:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+9:2016:x1830882983338624:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6242us (6732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.735129:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7337 00000100:00100000:0.0:1746066759.740847:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.741001:0:9595:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983339392 00000100:00100000:2.0:1746066759.741011:0:9595:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983339392 00002000:00100000:2.0:1746066759.741063:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2105344->3145727) req@ffff8800967a8a80 x1830882983339392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.741073:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882983339392 ext(2105344->3145727) 00002000:00010000:2.0:1746066759.741080:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8a80 00000100:00100000:2.0:1746066759.741117:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4397 00000100:00100000:2.0:1746066759.741125:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983339392:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.744458:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.745529:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983339648 00000100:00100000:3.0:1746066759.745539:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983339648 00002000:00100000:3.0:1746066759.745586:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967abb80 x1830882983339648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.745596:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882983339648 ext(3145728->4194303) 00010000:00010000:3.0:1746066759.745605:0:13349:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.745618:0:13349:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 827 lvb_type: 0 00002000:00010000:3.0:1746066759.745625:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967abb80 00000100:00100000:3.0:1746066759.745652:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 989 00000100:00100000:3.0:1746066759.745661:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983339648:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.746409:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.746861:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983339904 00000100:00100000:2.0:1746066759.746866:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983339904 00002000:00100000:2.0:1746066759.746900:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800967a9c00 x1830882983339904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.746909:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9c00 with x1830882983339904 ext(3145728->4194303) 00002000:00010000:2.0:1746066759.746913:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9c00 00000100:00100000:2.0:1746066759.746926:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4398 00000100:00100000:2.0:1746066759.746931:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983339904:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.748679:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2013:x1830882983339392:12345-192.168.204.16@tcp:3:cat.0 Request processed in 7546us (7834us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746066759.748689:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4397 00002000:00100000:2.0:1746066759.748698:0:9595:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7a:0x0] (2105344->3145727) req@ffff8800967a8a80 x1830882983339392/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.748706:0:9595:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8a80 with x1830882983339392 ext(2105344->3145727) 00002000:00010000:2.0:1746066759.748710:0:9595:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a8a80 00000100:00100000:3.0:1746066759.757680:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983339648:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12008us (13220us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066759.757693:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 989 00002000:00100000:3.0:1746066759.757705:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967abb80 x1830882983339648/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.757715:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967abb80 with x1830882983339648 ext(3145728->4194303) 00010000:00010000:3.0:1746066759.757725:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:3.0:1746066759.757739:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 30 pid: 1893 timeout: 827 lvb_type: 0 00000100:00100000:1.0:1746066759.757742:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:3.0:1746066759.757746:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800967abb80 00000100:00100000:1.0:1746066759.757769:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983340032 00000100:00100000:1.0:1746066759.757776:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983340032 00000100:00100000:1.0:1746066759.757815:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16240 00000100:00100000:1.0:1746066759.757822:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:841:x1830882983340032:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.757838:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.757853:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f23 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.757878:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066759.757902:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 31 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.757916:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 31 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.757927:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898e00, rc 0) 00000100:00100000:1.0:1746066759.757945:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+31:841:x1830882983340032:12345-192.168.204.16@tcp:101:cat.0 Request processed in 124us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.757951:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16240 00000100:00100000:2.0:1746066759.759102:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2013:x1830882983339904:12345-192.168.204.16@tcp:3:cat.0 Request processed in 12163us (12686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.759111:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4398 00002000:00100000:2.0:1746066759.759118:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff8800967a9c00 x1830882983339904/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.759129:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a9c00 with x1830882983339904 ext(3145728->4194303) 00002000:00010000:2.0:1746066759.759133:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800967a9c00 00000100:00100000:0.0:1746066759.762187:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.762291:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983340160 00000100:00100000:2.0:1746066759.762301:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983340160 00010000:00010000:2.0:1746066759.762338:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00000100:00100000:2.0:1746066759.762365:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7338 00000100:00100000:2.0:1746066759.762373:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983340160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.762387:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.762407:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.762432:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.762457:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b32200/0xf1867c21abfa7bdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2539520->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ef9 expref: 31 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.762492:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.762495:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.762502:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.762511:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.762519:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.762520:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.762523:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.762530:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.762562:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 30 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.762575:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984497280:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066759.762683:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 29 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.762692:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984497408:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066759.762710:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082600 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.765861:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984497280:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066759.765872:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984497408:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066759.765910:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.765946:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983340160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3573us (3770us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.765957:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7338 00000100:00100000:0.0:1746066759.766467:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.766792:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983340416 00000100:00100000:2.0:1746066759.766798:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983340416 00002000:00100000:2.0:1746066759.766836:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967ab100 x1830882983340416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.766846:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab100 with x1830882983340416 ext(3145728->4194303) 00002000:00010000:2.0:1746066759.766850:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967ab100 00000100:00100000:2.0:1746066759.766879:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4399 00000100:00100000:2.0:1746066759.766905:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983340416:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:0.0:1746066759.767989:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.768848:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983340672 00000100:00100000:3.0:1746066759.768855:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983340672 00002000:00100000:3.0:1746066759.768915:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967a8380 x1830882983340672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.768925:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882983340672 ext(3145728->4194303) 00002000:00010000:3.0:1746066759.768930:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8380 00000100:00100000:3.0:1746066759.768947:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4400 00000100:00100000:3.0:1746066759.768952:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983340672:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.781672:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+30:2016:x1830882983340416:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 14754us (15192us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.781686:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4399 00002000:00100000:2.0:1746066759.781699:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967ab100 x1830882983340416/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.781708:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967ab100 with x1830882983340416 ext(3145728->4194303) 00002000:00010000:2.0:1746066759.781714:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967ab100 00000100:00100000:2.0:1746066759.781957:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983340672:12345-192.168.204.16@tcp:3:cat.0 Request processed in 13003us (13969us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066759.781962:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4400 00002000:00100000:2.0:1746066759.781968:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (3145728->4194303) req@ffff8800967a8380 x1830882983340672/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.781974:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800967a8380 with x1830882983340672 ext(3145728->4194303) 00002000:00010000:2.0:1746066759.781977:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800967a8380 00000100:00100000:0.0:1746066759.786114:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.786229:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983340800 00000100:00100000:3.0:1746066759.786239:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983340800 00000100:00100000:3.0:1746066759.786300:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16241 00000100:00100000:3.0:1746066759.786308:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+9:848:x1830882983340800:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.786335:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.786352:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f2a expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.786382:0:12255:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.786388:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066759.786389:0:12255:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746066759.786392:0:12255:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.786437:0:12255:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 34 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.786449:0:12255:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 34 pid: 1893 timeout: 827 lvb_type: 0 00000100:00100000:3.0:1746066759.786461:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984497536:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.786548:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.786843:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.786915:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983340928 00000100:00100000:1.0:1746066759.786919:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983340928 00000100:00100000:1.0:1746066759.786953:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16242 00000100:00100000:1.0:1746066759.786959:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983340928:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.786967:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.786977:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa7c23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f31 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.787008:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984497664:192.168.204.16@tcp:106: 00000100:00100000:1.0:1746066759.787041:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.788089:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12255:1830882984497536:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.788112:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 10 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.788127:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993c00, rc 0) 00000100:00100000:3.0:1746066759.788151:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:848:x1830882983340800:12345-192.168.204.16@tcp:101:cat.0 Request processed in 1844us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.788157:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16241 00000100:00100000:0.0:1746066759.788555:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.788949:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983341056 00000100:00100000:2.0:1746066759.788955:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983341056 00002000:00100000:2.0:1746066759.789322:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2105343) req@ffff88008e332300 x1830882983341056/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 8680/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.789331:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332300 with x1830882983341056 ext(2097152->2105343) 00010000:00010000:2.0:1746066759.789338:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 35 pid: 1893 timeout: 827 lvb_type: 0 00010000:00010000:2.0:1746066759.789351:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 35 pid: 1893 timeout: 828 lvb_type: 0 00002000:00010000:2.0:1746066759.789357:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e332300 00000100:00100000:2.0:1746066759.789384:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 990 00000100:00100000:2.0:1746066759.789390:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983341056:12345-192.168.204.16@tcp:4:cat.0 00002000:00010000:1.0:1746066759.790401:0:1893:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746066759 -> 1746066760 00000100:00100000:1.0:1746066759.790418:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984497664:192.168.204.16@tcp:106: 00010000:00010000:1.0:1746066759.790454:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa7c23 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f31 expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.790464:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71600/0xf1867c21abfa7c23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f31 expref: 31 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.790482:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71600, rc 0) 00000100:00100000:1.0:1746066759.790514:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983340928:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3554us (3671us total) trans 0 rc 301/301 00000100:00100000:1.0:1746066759.790520:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16242 00000100:00100000:2.0:1746066759.790737:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983341056:12345-192.168.204.16@tcp:4:cat.0 Request processed in 1346us (2183us total) trans 17179874458 rc 0/0 00000100:00100000:2.0:1746066759.790743:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 990 00002000:00100000:2.0:1746066759.790749:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7a:0x0] (2097152->2105343) req@ffff88008e332300 x1830882983341056/t17179874458(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 8680/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746066759.790755:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332300 with x1830882983341056 ext(2097152->2105343) 00010000:00010000:2.0:1746066759.790761:0:9596:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 37 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.790771:0:9596:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 37 pid: 1893 timeout: 828 lvb_type: 0 00002000:00010000:2.0:1746066759.790776:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e332300 00000100:00100000:2.0:1746066759.790993:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.791248:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983341184 00000100:00100000:3.0:1746066759.791253:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983341184 00002000:00100000:3.0:1746066759.791276:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1433600->1667071) req@ffff8800966e3100 x1830882983341184/t0(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.791283:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3100 with x1830882983341184 ext(1433600->1667071) 00002000:00010000:3.0:1746066759.791286:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3100 00000100:00100000:3.0:1746066759.791300:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4401 00000100:00100000:3.0:1746066759.791306:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983341184:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:3.0:1746066759.798664:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983341184:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 7345us (7659us total) trans 21474841913 rc 0/0 00000100:00100000:3.0:1746066759.798679:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4401 00002000:00100000:3.0:1746066759.798692:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1433600->1667071) req@ffff8800966e3100 x1830882983341184/t21474841913(0) o4->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/448 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.798701:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800966e3100 with x1830882983341184 ext(1433600->1667071) 00002000:00010000:3.0:1746066759.798707:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800966e3100 00000100:00100000:0.0:1746066759.799404:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.799481:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983341312 00000100:00100000:2.0:1746066759.799490:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983341312 00010000:00010000:2.0:1746066759.799523:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 37 pid: 1893 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.799547:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7339 00000100:00100000:2.0:1746066759.799554:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983341312:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.799566:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746066759.799582:0:8395:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066759 -> 1746066760 00010000:00010000:2.0:1746066759.799588:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 37 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.799599:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 37 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.799625:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a576a000/0xf1867c21abfa7c0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f1c expref: 37 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.799655:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.799657:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.799666:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.799674:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.799707:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.799718:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984497792:192.168.204.16@tcp:105: 00000100:00100000:2.0:1746066759.799995:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.802925:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.803089:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984497792:192.168.204.16@tcp:105: 00010000:00010000:2.0:1746066759.803111:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.803151:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882983341312:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3598us (3750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.803161:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7339 00000100:00100000:3.0:1746066759.803260:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983341568 00000100:00100000:3.0:1746066759.803267:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983341568 00002000:00100000:3.0:1746066759.803308:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88008e332d80 x1830882983341568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.803322:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332d80 with x1830882983341568 ext(4194304->5033983) 00002000:00010000:3.0:1746066759.803327:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e332d80 00000100:00100000:3.0:1746066759.803344:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4402 00000100:00100000:3.0:1746066759.803350:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983341568:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:0.0:1746066759.806600:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.810313:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983341824 00000100:00100000:1.0:1746066759.810329:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983341824 00002000:00100000:1.0:1746066759.810388:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880097a8bb80 x1830882983341824/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.810400:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8bb80 with x1830882983341824 ext(3145728->4194303) 00002000:00010000:1.0:1746066759.810406:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8bb80 00000100:00100000:1.0:1746066759.810444:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4403 00000100:00100000:1.0:1746066759.810452:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983341824:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:3.0:1746066759.823499:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983341568:12345-192.168.204.16@tcp:3:cat.0 Request processed in 20137us (20609us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746066759.823512:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4402 00002000:00100000:3.0:1746066759.823524:0:9596:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff88008e332d80 x1830882983341568/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746066759.823533:0:9596:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e332d80 with x1830882983341568 ext(4194304->5033983) 00002000:00010000:3.0:1746066759.823539:0:9596:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e332d80 00000100:00100000:1.0:1746066759.825534:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+10:2016:x1830882983341824:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 15077us (18939us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066759.825545:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4403 00002000:00100000:1.0:1746066759.825553:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3145728->4194303) req@ffff880097a8bb80 x1830882983341824/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.825561:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8bb80 with x1830882983341824 ext(3145728->4194303) 00002000:00010000:1.0:1746066759.825566:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a8bb80 00000100:00100000:0.0:1746066759.826454:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.826517:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983341952 00000100:00100000:2.0:1746066759.826525:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983341952 00000100:00100000:2.0:1746066759.827047:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16342 00000100:00100000:2.0:1746066759.827057:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:856:x1830882983341952:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066759.827079:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.827098:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f38 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.827159:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827171:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827184:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827196:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827201:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827205:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827273:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827283:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 48 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.827290:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.827296:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 5/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.827324:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.827335:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 26 pid: 7244 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.827347:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984497920:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.827440:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 48 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.827448:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 48 pid: 13370 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.827455:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984498048:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.827472:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.830250:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.830504:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.830566:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983342080 00000100:00100000:3.0:1746066759.830575:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983342080 00000100:00100000:1.0:1746066759.830577:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983342208 00000100:00100000:1.0:1746066759.830580:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983342208 00000100:00100000:1.0:1746066759.830628:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16243 00000100:00100000:1.0:1746066759.830636:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2014:x1830882983342208:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.830655:0:1893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.830673:0:1893:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f46 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.830702:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.830704:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.830714:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.830728:0:1893:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 37 pid: 1893 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066759.830732:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16244 00000100:00100000:3.0:1746066759.830738:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983342080:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:1.0:1746066759.830739:0:1893:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70000, rc 0) 00010000:00010000:3.0:1746066759.830746:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.830755:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5993800/0xf1867c21abfa7c4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f3f expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.830780:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983342208:12345-192.168.204.16@tcp:101:cat.0 Request processed in 146us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.830786:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16243 00000100:00100000:3.0:1746066759.830791:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984498176:192.168.204.16@tcp:106: 00000100:00100000:3.0:1746066759.830842:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.831217:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.831395:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983342464 00000100:00100000:1.0:1746066759.831398:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983342464 00000100:00100000:3.0:1746066759.831415:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984497920:192.168.204.16@tcp:104: 00002000:00100000:1.0:1746066759.831431:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a8b800 x1830882983342464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746066759.831434:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800966e0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984498048:192.168.204.16@tcp:104: 00002000:00100000:1.0:1746066759.831439:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882983342464 ext(4194304->5033983) 00002000:00010000:1.0:1746066759.831443:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8b800 00010000:00010000:3.0:1746066759.831455:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:1.0:1746066759.831465:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4404 00000100:00100000:1.0:1746066759.831470:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983342464:12345-192.168.204.16@tcp:3:cat.0 00000100:00100000:2.0:1746066759.833238:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.833285:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.833303:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983342720 00000100:00100000:2.0:1746066759.833310:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983342720 00000100:00100000:2.0:1746066759.833343:0:7246:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983342976 00000100:00100000:2.0:1746066759.833345:0:7246:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983342976 00000100:00100000:2.0:1746066759.833361:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5974 00000100:00100000:2.0:1746066759.833368:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+49:30848:x1830882983342720:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066759.833579:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a932635-1bad-46b9-b237-470f1d1c8595+50:30848:x1830882983342720:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 211us (347us total) trans 8589936686 rc 0/0 00000100:00100000:2.0:1746066759.833586:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5974 00000100:00100000:2.0:1746066759.833600:0:7246:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5975 00000100:00100000:2.0:1746066759.833605:0:7246:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+27:314:x1830882983342976:12345-192.168.204.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746066759.833665:0:7246:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2051f12-252a-4bb3-b8f3-833317fca821+28:314:x1830882983342976:12345-192.168.204.16@tcp:35:ldlm_bl.0 Request processed in 59us (379us total) trans 8589936687 rc 0/0 00000100:00100000:2.0:1746066759.833670:0:7246:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5975 00000100:00100000:3.0:1746066759.833875:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984498176:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066759.833923:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5993800/0xf1867c21abfa7c4d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f3f expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.833936:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5993800/0xf1867c21abfa7c4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f3f expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.834142:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5993800, rc 0) 00000100:00100000:3.0:1746066759.834170:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2014:x1830882983342080:12345-192.168.204.16@tcp:101:cat.0 Request processed in 3431us (3933us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066759.834177:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16244 00000100:00100000:0.0:1746066759.837177:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.837216:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.837798:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.837844:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983343104 00000100:00100000:2.0:1746066759.837854:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983343104 00000100:00100000:3.0:1746066759.837906:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983343360 00000100:00100000:3.0:1746066759.837911:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983343360 00000100:00100000:3.0:1746066759.837943:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16245 00000100:00100000:3.0:1746066759.837951:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983343360:12345-192.168.204.16@tcp:101:cat.0 00010000:00010000:3.0:1746066759.837968:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.837984:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa7c54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f4d expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.838023:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983342464:12345-192.168.204.16@tcp:3:cat.0 Request processed in 6552us (6806us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746066759.838031:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4404 00000100:00100000:3.0:1746066759.838034:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984498304:192.168.204.16@tcp:106: 00002000:00100000:0.0:1746066759.838040:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->5033983) req@ffff880097a8b800 x1830882983342464/t0(0) o3->e2051f12-252a-4bb3-b8f3-833317fca821@192.168.204.16@tcp:165/0 lens 488/440 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746066759.838047:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a8b800 with x1830882983342464 ext(4194304->5033983) 00002000:00010000:0.0:1746066759.838052:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a8b800 00000100:00100000:3.0:1746066759.838079:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00010000:00010000:2.0:1746066759.838113:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 50 pid: 13370 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.838130:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983343232 00000100:00100000:2.0:1746066759.838133:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983343232 00010000:00010000:2.0:1746066759.838145:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 28 pid: 7244 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.838163:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7340 00000100:00100000:2.0:1746066759.838168:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+50:2016:x1830882983343104:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746066759.838175:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7341 00010000:00010000:2.0:1746066759.838177:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066759.838179:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+28:2015:x1830882983343232:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.838183:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 50 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746066759.838187:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.838190:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 28 pid: 7244 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.838192:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 50 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746066759.838220:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 28 pid: 7244 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746066759.838237:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012155d000/0xf1867c21abfa7beb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f00 expref: 28 pid: 7244 timeout: 828 lvb_type: 0 00010000:00010000:3.0:1746066759.838250:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.838255:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.838264:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.838269:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.838273:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.838290:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+27:2015:x1830882983343232:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 111us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.838296:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7341 00010000:00010000:2.0:1746066759.838397:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009dbe2000/0xf1867c21abfa7bac lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ecf expref: 50 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.838407:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.838410:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838417:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838433:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838454:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.838472:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+49:2016:x1830882983343104:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 304us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.838477:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7340 00010000:00010000:2.0:1746066759.838502:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838509:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:2.0:1746066759.838561:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:2.0:1746066759.838565:0:13370:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746066759.838582:0:13370:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838596:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838606:0:13370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838612:0:13370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838618:0:13370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838624:0:13370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa36400 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066759.838628:0:13370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838633:0:13370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838641:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066759.838644:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066759.838647:0:13370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838651:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36400/0xf1867c21abfa7c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838658:0:13370:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838662:0:13370:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838666:0:13370:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838670:0:13370:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa36a00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066759.838672:0:13370:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838678:0:13370:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838687:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800971a9900) 00010000:00010000:2.0:1746066759.838688:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746066759.838692:0:13370:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838695:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa36a00/0xf1867c21abfa7c38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.838726:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.838740:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 16 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.838746:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.838748:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746066759.838749:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37c00, rc 0) 00000100:00100000:2.0:1746066759.838784:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:856:x1830882983341952:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 11729us (12331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.838790:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16342 00000100:00100000:3.0:1746066759.840437:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984498304:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066759.840467:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa7c54 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f4d expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.840478:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992e00/0xf1867c21abfa7c54 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f4d expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.840488:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992e00, rc 0) 00000100:00100000:3.0:1746066759.840532:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4a932635-1bad-46b9-b237-470f1d1c8595+30:2013:x1830882983343360:12345-192.168.204.16@tcp:101:cat.0 Request processed in 2581us (2734us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066759.840539:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16245 00000100:00100000:0.0:1746066759.840683:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.840728:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.840840:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983343616 00000100:00100000:3.0:1746066759.840846:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983343616 00000100:00100000:3.0:1746066759.840879:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983343872 00000100:00100000:3.0:1746066759.840900:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983343872 00000100:00100000:0.0:1746066759.840905:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16246 00000100:00100000:0.0:1746066759.840911:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2013:x1830882983343616:12345-192.168.204.16@tcp:101:mirror_io.0 00000100:00100000:3.0:1746066759.840914:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16247 00000100:00100000:3.0:1746066759.840918:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983343872:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066759.840924:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.840925:0:12255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.840935:0:12255:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa7c5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f69 expref: -99 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.840935:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f5b expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.840950:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.840952:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.840959:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746066759.840968:0:12255:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984498432:192.168.204.16@tcp:106: 00010000:00010000:0.0:1746066759.840975:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 8 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.840982:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22a00, rc 0) 00000100:00100000:3.0:1746066759.841479:0:12255:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76840 going to sleep for 11 seconds 00000100:00100000:0.0:1746066759.841853:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2013:x1830882983343616:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 940us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.841856:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.841858:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16246 00000100:00100000:0.0:1746066759.841872:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983344128 00000100:00100000:0.0:1746066759.841875:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983344128 00000100:00100000:0.0:1746066759.841906:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16248 00000100:00100000:2.0:1746066759.841908:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.841911:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2013:x1830882983344128:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:0.0:1746066759.841918:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.841926:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f77 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.841934:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066759.841937:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.841938:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.841943:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 9 pid: 3528 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066759.841949:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983343488 00000100:00100000:2.0:1746066759.841951:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983343488 00010000:00010000:0.0:1746066759.841951:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 9 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.841957:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22c00, rc 0) 00000100:00100000:2.0:1746066759.841966:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983343744 00000100:00100000:2.0:1746066759.841968:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983343744 00000100:00100000:0.0:1746066759.841974:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983344128:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 64us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.841978:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16249 00000100:00100000:0.0:1746066759.841981:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16248 00000100:00100000:2.0:1746066759.841983:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983343488:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066759.841989:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066759.841989:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16250 00000100:00100000:0.0:1746066759.841993:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2013:x1830882983343744:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066759.841996:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f54 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.841997:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066759.842001:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f62 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.842005:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.842006:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.842008:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.842009:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.842011:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.842012:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.842020:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 10 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.842026:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.842026:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a22200, rc 0) 00010000:00010000:2.0:1746066759.842032:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa36600, rc 0) 00000100:00100000:0.0:1746066759.842036:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+10:2013:x1830882983343744:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.842041:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16250 00000100:00100000:2.0:1746066759.842042:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882983343488:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 60us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.842046:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16249 00000100:00100000:0.0:1746066759.842089:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.842101:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983344000 00000100:00100000:2.0:1746066759.842104:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983344000 00000100:00100000:2.0:1746066759.842911:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16251 00000100:00100000:2.0:1746066759.842918:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2013:x1830882983344000:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066759.842926:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.842935:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f70 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.842948:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.842949:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.842954:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.842964:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.842971:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37000, rc 0) 00000100:00100000:2.0:1746066759.843122:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2013:x1830882983344000:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 203us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.843130:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16251 00000100:00100000:3.0:1746066759.844259:0:12255:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12255:1830882984498432:192.168.204.16@tcp:106: 00010000:00010000:3.0:1746066759.844288:0:12255:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa7c5b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f69 expref: 15 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.844297:0:12255:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5992a00/0xf1867c21abfa7c5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f69 expref: 15 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066759.844306:0:12255:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992a00, rc 0) 00000100:00100000:3.0:1746066759.844469:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800966e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983343872:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3548us (3739us total) trans 0 rc 301/301 00000100:00100000:3.0:1746066759.844475:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16247 00000100:00100000:0.0:1746066759.846987:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.848069:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983344384 00000100:00100000:2.0:1746066759.848080:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983344384 00000100:00100000:2.0:1746066759.848135:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16343 00000100:00100000:2.0:1746066759.848143:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:856:x1830882983344384:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:2.0:1746066759.848162:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.848182:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37200/0xf1867c21abfa7c85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f7e expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.848284:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.848311:0:13370:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.848318:0:13370:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.848350:0:13370:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.848362:0:13370:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 17 pid: 13370 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.848374:0:13370:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984498560:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.848463:0:13370:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746066759.849972:0:13370:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13370:1830882984498560:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.849995:0:13370:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:0.0:1746066759.850056:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.850355:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983344512 00000100:00100000:2.0:1746066759.850361:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983344512 00010000:00010000:2.0:1746066759.850384:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 18 pid: 13370 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.850430:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7342 00000100:00100000:2.0:1746066759.850437:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2016:x1830882983344512:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.850448:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.850453:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 18 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.850462:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 18 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.850480:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37c00/0xf1867c21abfa7c3f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f38 expref: 18 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.850491:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.850496:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.850503:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.850509:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13370 initiator: MDT0 00010000:00010000:2.0:1746066759.850534:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.850573:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2016:x1830882983344512:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 136us (517us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066759.850574:0:13370:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.850580:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000100:00100000:2.0:1746066759.850580:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7342 00000004:00200000:3.0:1746066759.850595:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066759.850825:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37200/0xf1867c21abfa7c85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f7e expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.850837:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f7e expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.850843:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.850846:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746066759.850848:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fa37600, rc 0) 00000100:00100000:3.0:1746066759.851452:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:856:x1830882983344384:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 3308us (4470us total) trans 8589936688 rc 0/0 00000100:00100000:3.0:1746066759.851459:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16343 00000100:00100000:0.0:1746066759.855291:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.855502:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983344768 00000100:00100000:3.0:1746066759.855511:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983344768 00000100:00100000:3.0:1746066759.855554:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16344 00000100:00100000:3.0:1746066759.855561:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:856:x1830882983344768:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066759.855588:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.855591:0:13370:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746066759.855620:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fa37600/0xf1867c21abfa7c8c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f7e expref: 17 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.855640:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.855643:0:13370:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066759.855655:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993800/0xf1867c21abfa7c9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f85 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.855755:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.855767:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066759.855775:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:3.0:1746066759.855785:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:3.0:1746066759.855876:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993800/0xf1867c21abfa7c9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 19 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.855908:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.855915:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.855917:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066759.855919:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992c00, rc 0) 00000100:00100000:3.0:1746066759.856445:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:856:x1830882983344768:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 765us (1046us total) trans 8589936689 rc 0/0 00000100:00100000:3.0:1746066759.856452:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16344 00000100:00100000:0.0:1746066759.858474:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.858630:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983344896 00000100:00100000:3.0:1746066759.858640:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983344896 00000100:00100000:3.0:1746066759.858693:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16345 00000100:00100000:3.0:1746066759.858700:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:856:x1830882983344896:12345-192.168.204.16@tcp:101:mirror_io.0 00010000:00010000:3.0:1746066759.858722:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.858739:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992000/0xf1867c21abfa7caf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f8c expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.858791:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992000/0xf1867c21abfa7caf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f8c expref: 19 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.858804:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992000/0xf1867c21abfa7caf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f8c expref: 19 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.858820:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066759.858823:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746066759.858826:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992000, rc 0) 00000100:00100000:3.0:1746066759.858868:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:856:x1830882983344896:12345-192.168.204.16@tcp:101:mirror_io.0 Request processed in 168us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.858874:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16345 00000100:00100000:1.0:1746066759.861821:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.861943:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.862504:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.862593:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983345920 00000100:00100000:1.0:1746066759.862602:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983345920 00000100:00100000:1.0:1746066759.862647:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16346 00000100:00100000:1.0:1746066759.862654:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+49:860:x1830882983345920:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:1.0:1746066759.862681:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066759.862699:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70e00/0xf1867c21abfa7cb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f93 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.862799:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066759.862815:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.862820:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 4/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066759.862850:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.862861:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 18 pid: 13370 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746066759.862872:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984498688:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.862968:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460600 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.862996:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.863629:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983345024 00000100:00100000:3.0:1746066759.863635:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983345024 00000100:00100000:1.0:1746066759.863647:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.863662:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983345152 00000100:00100000:3.0:1746066759.863664:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983345280 00000100:00100000:3.0:1746066759.863665:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983345280 00000100:00100000:1.0:1746066759.863665:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983345152 00000100:00100000:3.0:1746066759.863678:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983345408 00000100:00100000:2.0:1746066759.863695:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16252 00000100:00100000:2.0:1746066759.863703:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983345024:12345-192.168.204.16@tcp:1:mirror_io.0 00000100:00100000:3.0:1746066759.863714:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983345408 00010000:00010000:2.0:1746066759.863762:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.863776:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.863778:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16253 00010000:00010000:2.0:1746066759.863783:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746066759.863785:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983345280:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066759.863790:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.863796:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.863798:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.863800:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.863803:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.863812:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.863818:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 31 pid: 12255 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.863819:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.863826:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 31 pid: 12255 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746066759.863826:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.863832:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.863833:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.863835:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.863836:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984498816:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.863849:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.863857:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 36 pid: 3528 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746066759.863866:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984498944:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.863870:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 15 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.863877:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 15 pid: 9590 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746066759.863901:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984499072:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.863924:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.863924:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16254 00000100:00100000:0.0:1746066759.863929:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2015:x1830882983345152:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:2.0:1746066759.863932:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 29 pid: 1893 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.863939:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009d9b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984499200:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.863944:0:9592:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.863953:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746066759.863954:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746066759.863960:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.863966:0:9592:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.863969:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16255 00010000:00010000:0.0:1746066759.863972:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.863973:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746066759.863974:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983345408:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:0.0:1746066759.863975:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.863988:0:9590:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.863988:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 36 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.863996:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 36 pid: 3528 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.864003:0:9590:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 31 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.864003:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984499328:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.864008:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.864020:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746066759.864022:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.864026:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066759.864036:0:9590:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 31 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.864038:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 11 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746066759.864044:0:9590:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 31 pid: 1893 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746066759.864046:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984499456:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.864050:0:9590:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096425f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984499584:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.864062:0:9590:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097082b40 going to sleep for 11 seconds 00010000:00010000:0.0:1746066759.864066:0:9592:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 9 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.864072:0:9592:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 9 pid: 12237 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746066759.864079:0:9592:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984499712:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066759.864091:0:9592:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db840 going to sleep for 11 seconds 00010000:00010000:0.0:1746066759.864102:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 11 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.864109:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 11 pid: 3528 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746066759.864117:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984499840:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.864141:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 9 pid: 9590 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746066759.864144:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:0.0:1746066759.864148:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 9 pid: 9590 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.864155:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983345536 00000100:00100000:1.0:1746066759.864158:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983345536 00000100:00100000:0.0:1746066759.864160:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984499968:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.864172:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16256 00000100:00100000:0.0:1746066759.864173:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800979db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066759.864177:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983345536:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066759.864191:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.864200:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.864204:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066759.864207:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.864214:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.864215:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983345664 00000100:00100000:0.0:1746066759.864218:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983345664 00010000:00010000:1.0:1746066759.864220:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.864221:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.864223:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.864234:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16257 00010000:00010000:1.0:1746066759.864237:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 29 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.864238:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983345664:12345-192.168.204.16@tcp:1:mirror_io.0 00010000:00010000:1.0:1746066759.864244:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 29 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746066759.864250:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.864251:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984500096:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.864259:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.864265:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.864271:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 36 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.864272:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 16 pid: 12237 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.864277:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.864278:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.864279:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 16 pid: 12237 timeout: 828 lvb_type: 1 00010000:00010000:0.0:1746066759.864280:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.864286:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984500224:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.864292:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 36 pid: 1893 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066759.864300:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 31 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.864303:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 36 pid: 1893 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.864306:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 31 pid: 12255 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746066759.864310:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984500352:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.864313:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984500480:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.864321:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c460000 going to sleep for 11 seconds 00010000:00010000:0.0:1746066759.864326:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 12 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066759.864333:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 12 pid: 3528 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746066759.864339:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b167480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984500608:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.864356:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 9 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.864363:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 9 pid: 12255 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746066759.864370:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984500736:192.168.204.16@tcp:104: 00000100:00100000:0.0:1746066759.864380:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098854240 going to sleep for 11 seconds 00000100:00100000:3.0:1746066759.873846:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984498816:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.874291:0:9590:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096425f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9590:1830882984499584:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.874313:0:9590:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.874348:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.874368:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346048 00000100:00100000:2.0:1746066759.874373:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346048 00000100:00100000:3.0:1746066759.874397:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984499072:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.874397:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fbf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984498688:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.874399:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 19 pid: 13370 timeout: 828 lvb_type: 0 00000100:00100000:3.0:1746066759.874406:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009d9b0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984499200:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.874430:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066759.874434:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7343 00000100:00100000:2.0:1746066759.874442:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2014:x1830882983346048:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.874453:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.874458:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 19 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.874467:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 19 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.874485:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992c00/0xf1867c21abfa7ca1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f85 expref: 19 pid: 13370 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.874502:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066759.874506:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.874515:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.874520:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066759.874542:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066759.874568:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066759.874575:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2014:x1830882983346048:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 134us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066759.874575:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066759.874580:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7343 00000004:00200000:1.0:1746066759.874595:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066759.874727:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70e00/0xf1867c21abfa7cb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f93 expref: 52 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.874741:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984500352:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066759.874752:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f93 expref: 51 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.874759:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066759.874762:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746066759.874764:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d71400, rc 0) 00000100:00100000:2.0:1746066759.874776:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b167480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984500608:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.874801:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+51:860:x1830882983345920:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 12147us (12297us total) trans 8589936690 rc 0/0 00000100:00100000:1.0:1746066759.874807:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16346 00000100:00100000:2.0:1746066759.874817:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3528:1830882984500736:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066759.874834:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.874846:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984500096:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.874854:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984500224:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066759.874862:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098fb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984500480:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066759.874878:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066759.874878:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.874908:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346688 00000100:00100000:2.0:1746066759.874911:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346688 00010000:00010000:2.0:1746066759.874924:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 37 pid: 3528 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746066759.874934:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.874952:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346944 00000100:00100000:2.0:1746066759.874955:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346944 00000100:00100000:1.0:1746066759.874961:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066759.874966:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 10 pid: 12237 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.874976:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347200 00000100:00100000:1.0:1746066759.874980:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347200 00000100:00100000:2.0:1746066759.874982:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7344 00000100:00100000:2.0:1746066759.874986:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983346688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.874992:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.874996:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 17 pid: 12237 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746066759.875008:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 37 pid: 3528 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.875015:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 37 pid: 3528 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746066759.875016:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7345 00000100:00100000:1.0:1746066759.875023:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983346944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.875028:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066759.875035:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746066759.875044:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983346688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 58us (166us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066759.875049:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 10 pid: 12237 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746066759.875050:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7344 00010000:00010000:1.0:1746066759.875059:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 10 pid: 12237 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746066759.875061:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7346 00000100:00100000:2.0:1746066759.875066:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:2015:x1830882983347200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.875074:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.875075:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066759.875085:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 17 pid: 12237 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.875093:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983346944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 70us (159us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066759.875097:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 17 pid: 12237 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.875100:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7345 00010000:00010000:2.0:1746066759.875108:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37000/0xf1867c21abfa7c7e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f70 expref: 17 pid: 12237 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746066759.875116:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.875131:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+16:2015:x1830882983347200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.875136:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7346 00000100:00100000:1.0:1746066759.875157:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.875179:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347456 00000100:00100000:2.0:1746066759.875181:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347456 00010000:00010000:2.0:1746066759.875191:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 30 pid: 1893 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.875204:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7347 00000100:00100000:2.0:1746066759.875209:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983347456:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066759.875215:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.875221:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 30 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.875228:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 30 pid: 1893 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746066759.875235:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066759.875239:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898e00/0xf1867c21abfa7c15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f23 expref: 30 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.875247:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.875247:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347712 00000100:00100000:1.0:1746066759.875250:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347712 00000100:00100000:2.0:1746066759.875263:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983347456:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 54us (106us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066759.875263:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 32 pid: 12255 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.875268:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7347 00000100:00100000:1.0:1746066759.875279:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7348 00000100:00100000:1.0:1746066759.875284:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983347712:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.875291:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.875300:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 32 pid: 12255 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.875303:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066759.875308:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 32 pid: 12255 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.875314:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346560 00000100:00100000:2.0:1746066759.875316:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346560 00010000:00010000:1.0:1746066759.875324:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a23c00/0xf1867c21abfa7c07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f15 expref: 33 pid: 12255 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.875326:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 33 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746066759.875333:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.875335:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.875338:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.875339:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7349 00000100:00100000:2.0:1746066759.875343:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983346560:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.875346:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875349:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.875356:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 32 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746066759.875359:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066759.875363:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 32 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.875373:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b33800/0xf1867c21abfa7c00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1667071) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f0e expref: 32 pid: 1893 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746066759.875375:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e2051f12-252a-4bb3-b8f3-833317fca821+32:2015:x1830882983347712:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 90us (139us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066759.875382:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066759.875382:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7348 00010000:00010000:2.0:1746066759.875384:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.875387:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.875396:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875397:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.875403:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875408:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066759.875428:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.875435:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066759.875440:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2051f12-252a-4bb3-b8f3-833317fca821+30:2015:x1830882983346560:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 96us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.875445:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7349 00010000:00010000:1.0:1746066759.875447:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.875454:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d70400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066759.875458:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875460:0:9590:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.875465:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875466:0:9590:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.875474:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875479:0:9590:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.875480:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7ce0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875485:0:9590:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875491:0:9590:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875498:0:9590:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066759.875501:0:9590:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.875511:0:9590:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.875516:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd32fb66-4e4e-4333-89ec-dee53f3687d4+15:2015:x1830882983345536:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11339us (11371us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066759.875520:0:9590:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.875523:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16256 00010000:00010000:2.0:1746066759.875525:0:9590:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14a00/0xf1867c21abfa7cd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.875550:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.875560:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983345408:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 11586us (11913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.875567:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16255 00000100:00100000:1.0:1746066759.875567:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.875576:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346816 00000100:00100000:1.0:1746066759.875578:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346816 00000100:00100000:2.0:1746066759.875585:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347072 00000100:00100000:2.0:1746066759.875588:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347072 00010000:00010000:1.0:1746066759.875589:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 13 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746066759.875599:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 10 pid: 9590 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.875609:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7350 00000100:00100000:2.0:1746066759.875614:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7351 00000100:00100000:1.0:1746066759.875616:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983346816:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746066759.875619:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983347072:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.875622:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.875626:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.875630:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 13 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746066759.875633:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 10 pid: 9590 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.875637:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 13 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746066759.875645:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 10 pid: 9590 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.875939:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.875985:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984499328:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066759.875994:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984499456:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.876002:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009356b200/0xf1867c21abfa7b7b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eac expref: 10 pid: 12237 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746066759.876014:0:9592:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9592:1830882984499712:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066759.876031:0:9592:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.876061:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.876071:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347328 00000100:00100000:3.0:1746066759.876074:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347328 00010000:00010000:3.0:1746066759.876086:0:16766:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 37 pid: 1893 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746066759.876098:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7352 00000100:00100000:3.0:1746066759.876102:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+37:2015:x1830882983347328:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.876108:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.876115:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 37 pid: 1893 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.876122:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 37 pid: 1893 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.876134:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d70000/0xf1867c21abfa7c46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f46 expref: 37 pid: 1893 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.876142:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.876155:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+36:2015:x1830882983347328:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 52us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.876160:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7352 00000100:00100000:3.0:1746066759.876186:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:1.0:1746066759.876190:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066759.876195:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347584 00000100:00100000:3.0:1746066759.876198:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347584 00000100:00100000:1.0:1746066759.876204:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2015:x1830882983346816:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 589us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.876210:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7350 00010000:00010000:3.0:1746066759.876221:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 14 pid: 3528 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.876232:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.876240:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347840 00000100:00100000:3.0:1746066759.876242:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347840 00000100:00100000:1.0:1746066759.876244:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7353 00010000:00010000:2.0:1746066759.876248:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066759.876248:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2015:x1830882983347584:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066759.876250:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 10 pid: 12255 timeout: 828 lvb_type: 0 00010000:00010000:2.0:1746066759.876250:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.876253:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.876254:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.876260:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.876261:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 13 pid: 3528 timeout: 828 lvb_type: 1 00000100:00100000:3.0:1746066759.876262:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7354 00000100:00100000:3.0:1746066759.876266:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983347840:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.876269:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 13 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.876271:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.876271:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066759.876279:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a22c00/0xf1867c21abfa7c69 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f77 expref: 13 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.876284:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 10 pid: 12255 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746066759.876287:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066759.876291:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 10 pid: 12255 timeout: 828 lvb_type: 0 00000100:00100000:2.0:1746066759.876291:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2051f12-252a-4bb3-b8f3-833317fca821+10:2015:x1830882983347072:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 671us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.876298:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7351 00000100:00100000:1.0:1746066759.876299:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983347584:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (112us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066759.876303:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993c00/0xf1867c21abfa7c1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f2a expref: 10 pid: 12255 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746066759.876305:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7353 00010000:00010000:3.0:1746066759.876312:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.876313:0:7232:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.876316:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.876322:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.876344:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066759.876349:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.876355:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+8:2015:x1830882983347840:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (122us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066759.876355:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.876360:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7354 00000100:00100000:1.0:1746066759.876365:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066759.876367:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.876369:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346176 00000100:00100000:3.0:1746066759.876371:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346176 00010000:00010000:2.0:1746066759.876372:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.876377:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.876379:0:7232:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 30 pid: 12255 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.876380:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066759.876384:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b33a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066759.876387:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.876387:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346432 00000100:00100000:1.0:1746066759.876389:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346432 00000100:00100000:3.0:1746066759.876391:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7355 00010000:00010000:2.0:1746066759.876392:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.876395:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+30:2013:x1830882983346176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.876396:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 12 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:2.0:1746066759.876399:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.876400:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066759.876404:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b33a00/0xf1867c21abfa7ce7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.876407:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7356 00010000:00010000:3.0:1746066759.876408:0:7232:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 30 pid: 12255 timeout: 828 lvb_type: 1 00000100:00100000:1.0:1746066759.876411:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2013:x1830882983346432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.876416:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066759.876431:0:7232:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 30 pid: 12255 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.876431:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 12 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.876438:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 12 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.876442:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c8200/0xf1867c21abfa7b82 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ea5 expref: 30 pid: 12255 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.876447:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a22a00/0xf1867c21abfa7c62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f5b expref: 12 pid: 3528 timeout: 828 lvb_type: 1 00010000:00010000:3.0:1746066759.876450:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.876451:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983345664:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12211us (12245us total) trans 0 rc 0/0 00010000:00010000:1.0:1746066759.876454:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066759.876457:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16257 00000100:00100000:3.0:1746066759.876462:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2051f12-252a-4bb3-b8f3-833317fca821+29:2013:x1830882983346176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 66us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.876462:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+11:2013:x1830882983346432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 51us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.876467:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7355 00000100:00100000:2.0:1746066759.876500:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.876533:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7356 00010000:00010000:0.0:1746066759.876580:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848aa00/0xf1867c21abfa7bc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ee4 expref: 35 pid: 3528 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746066759.876594:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984498944:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.876607:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a22200/0xf1867c21abfa7c77 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f62 expref: 9 pid: 3528 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746066759.876613:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984499840:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.876621:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848be00/0xf1867c21abfa7b89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1eb3 expref: 7 pid: 9590 timeout: 828 lvb_type: 1 00000100:00100000:0.0:1746066759.876629:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984499968:192.168.204.16@tcp:104: 00010000:00010000:0.0:1746066759.876644:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876650:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876655:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876673:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876679:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876685:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876695:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a22600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066759.876698:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876703:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876715:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.876721:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a22600/0xf1867c21abfa7ccb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066759.876750:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+8:2015:x1830882983345280:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 12966us (13754us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.876756:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16253 00000100:00100000:1.0:1746066759.878438:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983346304 00000100:00100000:1.0:1746066759.878445:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983346304 00010000:00010000:1.0:1746066759.878469:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 14 pid: 9590 timeout: 828 lvb_type: 1 00000100:00100000:2.0:1746066759.878783:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.879012:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983347968 00000100:00100000:1.0:1746066759.879016:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983347968 00010000:00010000:1.0:1746066759.879029:0:7231:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 29 pid: 1893 timeout: 828 lvb_type: 0 00000100:00100000:1.0:1746066759.879046:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7357 00000100:00100000:1.0:1746066759.879053:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+14:2013:x1830882983346304:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.879067:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.879083:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 14 pid: 9590 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.879092:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 14 pid: 9590 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.879111:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa36600/0xf1867c21abfa7c70 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f54 expref: 14 pid: 9590 timeout: 828 lvb_type: 1 00010000:00010000:1.0:1746066759.879125:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.879152:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+13:2013:x1830882983346304:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 99us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.879157:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7357 00000100:00100000:1.0:1746066759.879169:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7358 00000100:00100000:1.0:1746066759.879174:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2013:x1830882983347968:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066759.879180:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.879186:0:7231:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 29 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746066759.879194:0:7231:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 29 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746066759.879203:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009356ba00/0xf1867c21abfa7b74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1e9e expref: 29 pid: 1893 timeout: 828 lvb_type: 0 00010000:00010000:1.0:1746066759.879210:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.879211:0:7231:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066759.879215:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879222:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879240:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.879250:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2013:x1830882983347968:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 77us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.879255:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7358 00010000:00010000:1.0:1746066759.879269:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879275:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879289:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879295:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879301:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879305:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fa37e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066759.879308:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879314:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879321:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.879325:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fa37e00/0xf1867c21abfa7cc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066759.879353:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd32fb66-4e4e-4333-89ec-dee53f3687d4+12:2015:x1830882983345024:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 15653us (17544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066759.879360:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16252 00000100:00100000:3.0:1746066759.879985:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.880041:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983348096 00000100:00100000:0.0:1746066759.880045:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983348096 00010000:00010000:0.0:1746066759.880060:0:11928:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 35 pid: 3528 timeout: 828 lvb_type: 0 00000100:00100000:0.0:1746066759.880083:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7359 00000100:00100000:0.0:1746066759.880087:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2015:x1830882983348096:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066759.880094:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746066759.880104:0:11928:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 35 pid: 3528 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746066759.880112:0:11928:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 35 pid: 3528 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746066759.880124:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009848a400/0xf1867c21abfa7bba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ed6 expref: 35 pid: 3528 timeout: 828 lvb_type: 0 00010000:00010000:0.0:1746066759.880132:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.880133:0:11928:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066759.880136:0:11928:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.880142:0:11928:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066759.880153:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066759.880170:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4a932635-1bad-46b9-b237-470f1d1c8595+34:2015:x1830882983348096:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066759.880175:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7359 00010000:00010000:3.0:1746066759.880278:0:9592:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880285:0:9592:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880298:0:9592:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880303:0:9592:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880308:0:9592:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880317:0:9592:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c185a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066759.880320:0:9592:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880327:0:9592:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880336:0:9592:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.880341:0:9592:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c185a00/0xf1867c21abfa7cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066759.880379:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2015:x1830882983345152:12345-192.168.204.16@tcp:1:mirror_io.0 Request processed in 16449us (18436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.880385:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16254 00000100:00100000:0.0:1746066759.896994:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.897117:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066759.897209:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983348480 00000100:00100000:3.0:1746066759.897221:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983348480 00000100:00100000:3.0:1746066759.897270:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16258 00000100:00100000:3.0:1746066759.897279:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+34:860:x1830882983348480:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:3.0:1746066759.897300:0:9592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066759.897322:0:9592:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1f9a expref: -99 pid: 9592 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066759.897347:0:9592:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd48, atime: 0x6812dd48, ctime: 0x6812dd48, blocks: 0x1000 00010000:00010000:3.0:1746066759.897373:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.897375:0:9592:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066759.897383:0:9592:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.897398:0:9592:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 35 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066759.897411:0:9592:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5992c00, rc 0) 00000100:00100000:3.0:1746066759.897480:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+35:860:x1830882983348480:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 202us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066759.897487:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16258 00000100:00100000:1.0:1746066759.897818:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983348352 00000100:00100000:1.0:1746066759.897823:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983348352 00000100:00100000:1.0:1746066759.897852:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16347 00000100:00100000:1.0:1746066759.897857:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:856:x1830882983348352:12345-192.168.204.16@tcp:36:mirror_io.0 00010000:00010000:1.0:1746066759.897919:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066759.897940:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5992000/0xf1867c21abfa7caf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f8c expref: 18 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066759.897959:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066759.897963:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066759.897990:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:856:x1830882983348352:12345-192.168.204.16@tcp:36:mirror_io.0 Request processed in 133us (1011us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746066759.897995:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16347 00000100:00100000:0.0:1746066759.900003:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066759.900052:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.900079:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983348736 00000100:00100000:2.0:1746066759.900091:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983348736 00000100:00100000:1.0:1746066759.900129:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983348992 00000100:00100000:1.0:1746066759.900135:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983348992 00000100:00100000:2.0:1746066759.900149:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5976 00000100:00100000:2.0:1746066759.900157:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+17:856:x1830882983348736:12345-192.168.204.16@tcp:35:mirror_io.0 00002000:00100000:1.0:1746066759.900171:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3903488->3907583) req@ffff88012b164000 x1830882983348992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.900180:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164000 with x1830882983348992 ext(3903488->3907583) 00002000:00010000:1.0:1746066759.900185:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b164000 00000100:00100000:1.0:1746066759.900215:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4405 00000100:00100000:1.0:1746066759.900221:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983348992:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:2.0:1746066759.900606:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:856:x1830882983348736:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 444us (603us total) trans 8589936691 rc 0/0 00000100:00100000:2.0:1746066759.900614:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5976 00000100:00100000:1.0:1746066759.900615:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983348992:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 393us (561us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066759.900622:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4405 00002000:00100000:1.0:1746066759.900628:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3903488->3907583) req@ffff88012b164000 x1830882983348992/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.900641:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b164000 with x1830882983348992 ext(3903488->3907583) 00002000:00010000:1.0:1746066759.900643:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b164000 00000100:00100000:0.0:1746066759.906485:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.906668:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983349248 00000100:00100000:2.0:1746066759.906681:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983349248 00000100:00100000:2.0:1746066759.906739:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5977 00000100:00100000:2.0:1746066759.906747:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:856:x1830882983349248:12345-192.168.204.16@tcp:35:mirror_io.0 00000100:00100000:2.0:1746066759.907007:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:856:x1830882983349248:12345-192.168.204.16@tcp:35:mirror_io.0 Request processed in 260us (529us total) trans 8589936692 rc 0/0 00000100:00100000:2.0:1746066759.907013:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5977 00000100:00100000:0.0:1746066759.911115:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066759.912041:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983349376 00000100:00100000:2.0:1746066759.912051:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983349376 00000100:00100000:2.0:1746066759.912107:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16259 00000100:00100000:2.0:1746066759.912115:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+28:860:x1830882983349376:12345-192.168.204.16@tcp:101:multiop.0 00010000:00010000:2.0:1746066759.912137:0:12237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066759.912158:0:12237:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fa1 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066759.912183:0:12237:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd48, blocks: 0x1668 00010000:00010000:2.0:1746066759.912206:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.912208:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066759.912217:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.912232:0:12237:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 29 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066759.912242:0:12237:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15e00, rc 0) 00000100:00100000:2.0:1746066759.912296:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+29:860:x1830882983349376:12345-192.168.204.16@tcp:101:multiop.0 Request processed in 182us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066759.912306:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16259 00000100:00100000:0.0:1746066759.922060:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066759.923565:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983349632 00000100:00100000:1.0:1746066759.923675:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983349632 00002000:00100000:1.0:1746066759.923732:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4288512->4292607) req@ffff88012b165180 x1830882983349632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/0 e 0 to 0 dl 1746066770 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.923742:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165180 with x1830882983349632 ext(4288512->4292607) 00002000:00010000:1.0:1746066759.923748:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165180 00000100:00100000:1.0:1746066759.924306:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4406 00000100:00100000:1.0:1746066759.924316:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983349632:12345-192.168.204.16@tcp:3:multiop.0 00000100:00100000:1.0:1746066759.924641:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983349632:12345-192.168.204.16@tcp:3:multiop.0 Request processed in 325us (2590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746066759.924648:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4406 00002000:00100000:1.0:1746066759.924655:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4288512->4292607) req@ffff88012b165180 x1830882983349632/t0(0) o3->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:165/0 lens 488/4536 e 0 to 0 dl 1746066770 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066759.924662:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165180 with x1830882983349632 ext(4288512->4292607) 00002000:00010000:1.0:1746066759.924665:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165180 00000100:00100000:0.0:1746066760.348125:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.348313:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983349888 00000100:00100000:1.0:1746066760.348322:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983349888 00002000:00100000:1.0:1746066760.348365:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7a:0x0] (3903488->4194303) req@ffff88012b166300 x1830882983349888/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:166/0 lens 488/0 e 0 to 0 dl 1746066771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066760.348373:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b166300 with x1830882983349888 ext(3903488->4194303) 00002000:00010000:1.0:1746066760.348378:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b166300 00000100:00100000:0.0:1746066760.348568:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.350259:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983349760 00000100:00100000:1.0:1746066760.350266:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983349760 00002000:00100000:1.0:1746066760.350298:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4292607) req@ffff88012b165880 x1830882983349760/t0(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:166/0 lens 488/0 e 0 to 0 dl 1746066771 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066760.350310:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882983349760 ext(4194304->4292607) 00002000:00010000:1.0:1746066760.350314:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165880 00000100:00100000:1.0:1746066760.350337:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4407 00000100:00100000:1.0:1746066760.350344:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+35:2014:x1830882983349888:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066760.350578:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4408 00000100:00100000:1.0:1746066760.350584:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+29:2014:x1830882983349760:12345-192.168.204.16@tcp:4:multiop.0 00000100:00100000:1.0:1746066760.360699:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+37:2014:x1830882983349888:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 10346us (12573us total) trans 17179874459 rc 0/0 00000100:00100000:1.0:1746066760.360710:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4407 00002000:00100000:1.0:1746066760.360720:0:20358:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7a:0x0] (3903488->4194303) req@ffff88012b166300 x1830882983349888/t17179874459(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:166/0 lens 488/448 e 0 to 0 dl 1746066771 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066760.360730:0:20358:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b166300 with x1830882983349888 ext(3903488->4194303) 00002000:00010000:1.0:1746066760.360735:0:20358:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b166300 00000100:00100000:1.0:1746066760.364879:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+31:2014:x1830882983349760:12345-192.168.204.16@tcp:4:multiop.0 Request processed in 14287us (16303us total) trans 21474841914 rc 0/0 00000100:00100000:1.0:1746066760.364914:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4408 00002000:00100000:1.0:1746066760.364924:0:13349:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9a:0x0] (4194304->4292607) req@ffff88012b165880 x1830882983349760/t21474841914(0) o4->4a932635-1bad-46b9-b237-470f1d1c8595@192.168.204.16@tcp:166/0 lens 488/448 e 0 to 0 dl 1746066771 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746066760.364932:0:13349:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b165880 with x1830882983349760 ext(4194304->4292607) 00002000:00010000:1.0:1746066760.364939:0:13349:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b165880 00010000:00010000:2.0:1746066760.524187:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066760.572554:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.572597:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.572625:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.572656:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.572670:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.572692:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983350144 00000100:00100000:0.0:1746066760.572699:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983350144 00000100:00100000:0.0:1746066760.572735:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983350016 00000100:00100000:0.0:1746066760.572737:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983350016 00000100:00100000:0.0:1746066760.572746:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983350400 00000100:00100000:0.0:1746066760.572748:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983350400 00000100:00100000:0.0:1746066760.572757:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983350272 00000100:00100000:0.0:1746066760.572758:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983350272 00000100:00100000:0.0:1746066760.572766:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983350528 00000100:00100000:0.0:1746066760.572767:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983350528 00000100:00100000:0.0:1746066760.572779:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16260 00000100:00100000:0.0:1746066760.572787:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+8:2014:x1830882983350144:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066760.572850:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16261 00000100:00100000:0.0:1746066760.572855:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983350016:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066760.573128:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.573152:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983350656 00000100:00100000:0.0:1746066760.573155:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983350656 00000100:00100000:0.0:1746066760.573169:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16262 00000100:00100000:0.0:1746066760.573174:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+31:2014:x1830882983350400:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066760.573207:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16263 00000100:00100000:0.0:1746066760.573211:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+9:2013:x1830882983350272:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066760.573234:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16264 00000100:00100000:0.0:1746066760.573239:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+31:2013:x1830882983350528:12345-192.168.204.16@tcp:16:kworker.0 00000100:00100000:0.0:1746066760.573258:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16265 00000100:00100000:0.0:1746066760.573262:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+9:2014:x1830882983350656:12345-192.168.204.16@tcp:16:kworker.0 00000001:00080000:0.0:1746066760.576845:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841914 is committed 00000001:00080000:0.0:1746066760.576861:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841913 is committed 00000001:00080000:0.0:1746066760.577231:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841902 is committed 00000001:00080000:0.0:1746066760.577259:0:30423:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841884 is committed 00000100:00100000:1.0:1746066760.577788:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e2051f12-252a-4bb3-b8f3-833317fca821+7:2013:x1830882983350528:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 4542us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.577798:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16264 00000100:00100000:0.0:1746066760.578192:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e2051f12-252a-4bb3-b8f3-833317fca821+6:2013:x1830882983350016:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5335us (5592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.578199:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16261 00000100:00100000:2.0:1746066760.578388:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e2051f12-252a-4bb3-b8f3-833317fca821+5:2014:x1830882983350400:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5212us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.578394:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16262 00000001:00080000:2.0:1746066760.578457:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874459 is committed 00000001:00080000:2.0:1746066760.578481:0:32041:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874454 is committed 00000100:00100000:2.0:1746066760.578538:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2051f12-252a-4bb3-b8f3-833317fca821+7:2014:x1830882983350144:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5752us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.578544:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16260 00000100:00100000:3.0:1746066760.578553:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+6:2013:x1830882983350272:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5341us (5895us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.578559:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16263 00000100:00100000:2.0:1746066760.578577:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+5:2014:x1830882983350656:12345-192.168.204.16@tcp:16:kworker.0 Request processed in 5315us (5449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.578582:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16265 00000100:00100000:0.0:1746066760.596444:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.596765:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983350912 00000100:00100000:3.0:1746066760.596774:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983350912 00000100:00100000:3.0:1746066760.596832:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5978 00000100:00100000:3.0:1746066760.596839:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+27:890:x1830882983350912:12345-192.168.204.16@tcp:35:umount.0 00000100:00100000:3.0:1746066760.597028:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2051f12-252a-4bb3-b8f3-833317fca821+28:890:x1830882983350912:12345-192.168.204.16@tcp:35:umount.0 Request processed in 189us (590us total) trans 8589936693 rc 0/0 00000100:00100000:3.0:1746066760.597034:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5978 00000100:00080000:0.0:1746066760.597739:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066760.599374:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.599815:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.600273:0:11928:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983351040 00000100:00100000:1.0:1746066760.600280:0:11928:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983351040 00000100:00100000:2.0:1746066760.600902:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983351168 00000100:00100000:2.0:1746066760.600907:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983351168 00000100:00100000:2.0:1746066760.600954:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 792 00000100:00100000:2.0:1746066760.600961:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+16:2015:x1830882983351168:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066760.600972:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066760.600988:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800962c4e00/0xf1867c21abf9bb48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca712 expref: 16 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.601004:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066760.601039:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2015:x1830882983351168:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 78us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.601045:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 792 00000100:00100000:0.0:1746066760.601431:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.601452:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.601490:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983351424 00000100:00100000:3.0:1746066760.601499:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983351424 00000100:00100000:3.0:1746066760.601538:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16266 00000100:00100000:3.0:1746066760.601545:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+5:2012:x1830882983351424:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:3.0:1746066760.601580:0:13363:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb6b 00000100:00080000:3.0:1746066760.601588:0:13363:0:(import.c:66:import_set_state_nolock()) ffff88009f86d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746066760.601648:0:13363:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874459 00000100:00100000:3.0:1746066760.601779:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e2051f12-252a-4bb3-b8f3-833317fca821+2:2012:x1830882983351424:12345-192.168.204.16@tcp:9:umount.0 Request processed in 234us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.601786:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16266 00010000:00010000:0.0:1746066760.602041:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066760.602271:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983351296 00000100:00100000:2.0:1746066760.602276:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983351296 00000100:00100000:2.0:1746066760.602302:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 793 00000100:00100000:2.0:1746066760.602307:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+15:2016:x1830882983351296:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066760.602316:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746066760.602330:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800acda7600/0xf1867c21abf9bb4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca719 expref: 15 pid: 8138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.602342:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746066760.602362:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+14:2016:x1830882983351296:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 55us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.602367:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 793 00000100:00100000:1.0:1746066760.604045:0:11928:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 794 00000100:00100000:1.0:1746066760.604053:0:11928:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+13:2016:x1830882983351040:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066760.604065:0:11928:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066760.604078:0:11928:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800acda7200/0xf1867c21abf9bb41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca6e1 expref: 13 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.604098:0:11928:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066760.604134:0:11928:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+12:2016:x1830882983351040:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 82us (4766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.604139:0:11928:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 794 00000100:00100000:0.0:1746066760.612652:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.613475:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983351552 00000100:00100000:3.0:1746066760.613487:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983351552 00000100:00100000:3.0:1746066760.613535:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16267 00000100:00100000:3.0:1746066760.613544:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+5:2012:x1830882983351552:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:3.0:1746066760.613579:0:3528:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb64 00000100:00080000:3.0:1746066760.613587:0:3528:0:(import.c:66:import_set_state_nolock()) ffff88009f869800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746066760.613877:0:3528:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841914 00000100:00100000:3.0:1746066760.614063:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e2051f12-252a-4bb3-b8f3-833317fca821+2:2012:x1830882983351552:12345-192.168.204.16@tcp:9:umount.0 Request processed in 520us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.614071:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16267 00010000:00010000:2.0:1746066760.614177:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066760.620536:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.620726:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983351936 00000100:00100000:3.0:1746066760.620737:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983351936 00000100:00100000:3.0:1746066760.620797:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16348 00000100:00100000:3.0:1746066760.620804:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+28:2012:x1830882983351936:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:3.0:1746066760.620840:0:13370:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb56 00000020:00010000:3.0:1746066760.620854:0:13370:0:(genops.c:1938:obd_stale_export_put()) Put export ffff880130e01000: total 0 00000100:00080000:3.0:1746066760.620858:0:13370:0:(import.c:66:import_set_state_nolock()) ffff880130e05800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1746066760.621018:0:8394:0:(genops.c:1924:obd_stale_export_get()) Get export ffff880130e01000: total 0 00010000:00010000:2.0:1746066760.621087:0:8394:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff880130e01000, canceled 0 locks, left on hash table 5. 00010000:00010000:2.0:1746066760.621119:0:8394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066760.621122:0:8394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746066760.621129:0:8394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098497600/0xf1867c21abf9bc28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca7d6 expref: 27 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.621160:0:8394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066760.621163:0:8394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746066760.621166:0:8394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728e00/0xf1867c21abfa76b9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bc6 expref: 26 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.621180:0:8394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066760.621182:0:8394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066760.621185:0:8394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097ce0c00/0xf1867c21abfa75e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b1e expref: 25 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.621199:0:8394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066760.621200:0:8394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746066760.621203:0:8394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5993600/0xf1867c21abfa66e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d11cb expref: 24 pid: 7243 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.621213:0:8394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066760.621214:0:8394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746066760.621216:0:8394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129d2dc00/0xf1867c21abf9c9fe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cafe0 expref: 23 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.621225:0:8394:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff880130e01000, canceled 5 locks, left on hash table 0. 00010000:00010000:2.0:1746066760.621236:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.621238:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.621240:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1746066760.621285:0:13370:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936693 00000100:00100000:3.0:1746066760.622301:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+21:2012:x1830882983351936:12345-192.168.204.16@tcp:39:umount.0 Request processed in 1493us (1773us total) trans 8589936694 rc 0/0 00000100:00100000:3.0:1746066760.622313:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16348 00000100:00100000:0.0:1746066760.631870:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.632104:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983352064 00000100:00100000:3.0:1746066760.632114:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983352064 00000100:00080000:0.0:1746066760.633288:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746066760.633384:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16349 00000100:00100000:3.0:1746066760.633398:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+5:2012:x1830882983352064:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:3.0:1746066760.633446:0:13370:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb5d 00000100:00080000:3.0:1746066760.633455:0:13370:0:(import.c:66:import_set_state_nolock()) ffff880097b72000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746066760.633489:0:13370:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977719 00000100:00100000:3.0:1746066760.633695:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e2051f12-252a-4bb3-b8f3-833317fca821+3:2012:x1830882983352064:12345-192.168.204.16@tcp:39:umount.0 Request processed in 300us (1834us total) trans 4294977720 rc 0/0 00000100:00100000:3.0:1746066760.633701:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16349 00010000:00010000:2.0:1746066760.633772:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066760.883245:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.883274:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.883297:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066760.883371:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983352320 00000100:00100000:2.0:1746066760.883378:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983352320 00000100:00100000:2.0:1746066760.883459:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983352192 00000100:00100000:2.0:1746066760.883462:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983352192 00000100:00100000:3.0:1746066760.884219:0:16766:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983352448 00000100:00100000:3.0:1746066760.884223:0:16766:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983352448 00000100:00100000:3.0:1746066760.884255:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 795 00000100:00100000:3.0:1746066760.884262:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+14:2016:x1830882983352320:12345-192.168.204.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746066760.884268:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 796 00010000:00010000:3.0:1746066760.884278:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066760.884279:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+14:2013:x1830882983352192:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066760.884292:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066760.884296:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880095779000/0xf1867c21abf9bb79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca77b expref: 14 pid: 8136 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.884307:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880135d5e000/0xf1867c21abf9bb72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca74a expref: 13 pid: 8138 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.884311:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066760.884321:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746066760.884355:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+12:2016:x1830882983352320:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 93us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.884357:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+12:2013:x1830882983352192:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.884362:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 795 00000100:00100000:0.0:1746066760.884366:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 796 00000100:00100000:2.0:1746066760.884380:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 797 00000100:00100000:2.0:1746066760.884387:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+11:2014:x1830882983352448:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746066760.884394:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066760.884546:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.884564:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983352832 00000100:00100000:0.0:1746066760.884569:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983352832 00000100:00100000:0.0:1746066760.884603:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16268 00000100:00100000:0.0:1746066760.884607:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+7:2012:x1830882983352832:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:0.0:1746066760.884632:0:13363:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb9c 00000020:00010000:0.0:1746066760.884638:0:13363:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b21a9800: total 0 00000100:00080000:0.0:1746066760.884642:0:13363:0:(import.c:66:import_set_state_nolock()) ffff8800b21a9000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1746066760.884650:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880135d5fa00/0xf1867c21abf9bb80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca782 expref: 10 pid: 8138 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.884664:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:0.0:1746066760.884680:0:13363:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874459 00000100:00100000:2.0:1746066760.884684:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5a45cbd0-93d5-4396-ab9d-20e9fd42e52c+9:2014:x1830882983352448:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 297us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.884693:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 797 00000100:00080000:2.0:1746066760.884738:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1746066760.884746:0:12257:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b21a9800: total 0 00000100:00100000:0.0:1746066760.884789:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2012:x1830882983352832:12345-192.168.204.16@tcp:9:umount.0 Request processed in 181us (243us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066760.884794:0:12257:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b21a9800, canceled 0 locks, left on hash table 2. 00000100:00100000:0.0:1746066760.884795:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16268 00010000:00010000:2.0:1746066760.884831:0:12257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b945800/0xf1867c21abf9c861 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caf0e expref: 4 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.884855:0:12257:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b46e200/0xf1867c21abf9db46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1515520->1564671) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cbaec expref: 3 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.885127:0:12257:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b21a9800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746066760.885142:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.885143:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.885145:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746066760.887347:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.887432:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983353472 00000100:00100000:0.0:1746066760.887440:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983353472 00000100:00100000:0.0:1746066760.887529:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16269 00000100:00100000:0.0:1746066760.887537:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+9:2012:x1830882983353472:12345-192.168.204.16@tcp:9:umount.0 00000020:00000080:0.0:1746066760.887567:0:13363:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb95 00000020:00010000:0.0:1746066760.887574:0:13363:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009789e000: total 0 00000100:00080000:0.0:1746066760.887578:0:13363:0:(import.c:66:import_set_state_nolock()) ffff88009789c000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1746066760.887647:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1746066760.887777:0:13363:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841914 00000020:00010000:2.0:1746066760.888059:0:7233:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009789e000: total 0 00010000:00010000:2.0:1746066760.888066:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.888122:0:7233:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009789e000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1746066760.888161:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b944000/0xf1867c21abf9c8c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3227648->3448831) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caf38 expref: 7 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.888185:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b46f000/0xf1867c21abf9c88b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2965504->3145727) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caf23 expref: 6 pid: 12255 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.888202:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d07800/0xf1867c21abf9db4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1515520->1564671) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cbaf3 expref: 5 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.888222:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b944600/0xf1867c21abf9c8ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 7421952->7643135) gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caf3f expref: 4 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.888232:0:7233:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009789e000, canceled 4 locks, left on hash table 0. 00010000:00010000:2.0:1746066760.888244:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.888246:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.888247:0:7233:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066760.888292:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd32fb66-4e4e-4333-89ec-dee53f3687d4+2:2012:x1830882983353472:12345-192.168.204.16@tcp:9:umount.0 Request processed in 755us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.888300:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16269 00000100:00100000:0.0:1746066760.891862:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.891957:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983353856 00000100:00100000:1.0:1746066760.891967:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983353856 00000100:00100000:1.0:1746066760.892076:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16350 00000100:00100000:1.0:1746066760.892085:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+19:2012:x1830882983353856:12345-192.168.204.16@tcp:39:umount.0 00000020:00000080:1.0:1746066760.892120:0:7244:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb87 00000020:00010000:1.0:1746066760.892126:0:7244:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009f86e000: total 0 00000100:00080000:1.0:1746066760.892131:0:7244:0:(import.c:66:import_set_state_nolock()) ffff8800b5224800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1746066760.892197:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:1.0:1746066760.892410:0:7244:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936694 00000100:00100000:1.0:1746066760.892550:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+18:2012:x1830882983353856:12345-192.168.204.16@tcp:39:umount.0 Request processed in 466us (696us total) trans 8589936695 rc 0/0 00000100:00100000:1.0:1746066760.892556:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16350 00000020:00010000:2.0:1746066760.892701:0:8394:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009f86e000: total 0 00010000:00010000:2.0:1746066760.892760:0:8394:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009f86e000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746066760.892789:0:8394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b531f000) 00010000:00010000:2.0:1746066760.892792:0:8394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746066760.892798:0:8394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5771800/0xf1867c21abf9bbaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14ca7b3 expref: 17 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.892818:0:8394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066760.892820:0:8394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746066760.892823:0:8394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d07200/0xf1867c21abf9db31 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14cbae5 expref: 16 pid: 17253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.892832:0:8394:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009f86e000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746066760.892843:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.892844:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746066760.892846:0:8394:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746066760.897297:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.897345:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983353984 00000100:00100000:1.0:1746066760.897356:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983353984 00000100:00100000:1.0:1746066760.897441:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16351 00000100:00100000:1.0:1746066760.897451:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+5:2012:x1830882983353984:12345-192.168.204.16@tcp:39:umount.0 00000100:00080000:2.0:1746066760.897457:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1746066760.897487:0:7244:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xf1867c21abf9bb8e 00000100:00080000:1.0:1746066760.897495:0:7244:0:(import.c:66:import_set_state_nolock()) ffff88009f861800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746066760.897526:0:7244:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294977720 00010000:00010000:2.0:1746066760.897623:0:7234:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746066760.897666:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd32fb66-4e4e-4333-89ec-dee53f3687d4+3:2012:x1830882983353984:12345-192.168.204.16@tcp:39:umount.0 Request processed in 216us (380us total) trans 4294977721 rc 0/0 00000100:00100000:1.0:1746066760.897673:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16351 00000100:00100000:0.0:1746066760.933009:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.933054:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.933084:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.933114:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.933160:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983354112 00000100:00100000:0.0:1746066760.933169:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983354112 00000100:00100000:0.0:1746066760.933210:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983354240 00000100:00100000:0.0:1746066760.933212:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983354240 00000100:00100000:0.0:1746066760.933224:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983354368 00000100:00100000:0.0:1746066760.933226:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983354368 00000100:00100000:0.0:1746066760.933234:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983354496 00000100:00100000:0.0:1746066760.933236:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983354496 00000100:00100000:0.0:1746066760.933248:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16270 00000100:00100000:0.0:1746066760.933255:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882983354112:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066760.933276:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066760.933297:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fa8 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066760.933321:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd47, atime: 0x6812dd46, ctime: 0x6812dd46, blocks: 0x808 00010000:00010000:0.0:1746066760.933341:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933343:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933353:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933376:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933386:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899200, rc 0) 00000100:00100000:0.0:1746066760.933447:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983354112:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 192us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.933454:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16270 00000100:00100000:0.0:1746066760.933469:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16271 00000100:00100000:0.0:1746066760.933474:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983354240:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066760.933481:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066760.933492:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1faf expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066760.933505:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd47, atime: 0x6812dd47, ctime: 0x6812dd47, blocks: 0x808 00010000:00010000:0.0:1746066760.933513:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933514:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933518:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933528:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933534:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899e00, rc 0) 00000100:00100000:0.0:1746066760.933549:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983354240:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 75us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.933558:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16271 00000100:00100000:0.0:1746066760.933567:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16272 00000100:00100000:0.0:1746066760.933572:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+26:2015:x1830882983354368:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066760.933577:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066760.933586:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fb6 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066760.933595:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd47, blocks: 0x800 00010000:00010000:0.0:1746066760.933603:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933605:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933608:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933617:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933624:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5899800, rc 0) 00000100:00100000:0.0:1746066760.933639:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983354368:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 67us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.933645:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16272 00000100:00100000:0.0:1746066760.933654:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16273 00000100:00100000:0.0:1746066760.933658:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882983354496:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066760.933664:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066760.933673:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fbd expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066760.933687:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd48, blocks: 0x800 00010000:00010000:0.0:1746066760.933694:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933695:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.933699:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933706:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.933712:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5898c00, rc 0) 00000100:00100000:0.0:1746066760.933727:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983354496:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 69us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.933732:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16273 00000100:00100000:0.0:1746066760.942751:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066760.944842:0:10554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983354752 00000100:00100000:2.0:1746066760.944856:0:10554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983354752 00000100:00100000:2.0:1746066760.944966:0:10554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5979 00000100:00100000:2.0:1746066760.944975:0:10554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+51:915:x1830882983354752:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:2.0:1746066760.945206:0:10554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4a932635-1bad-46b9-b237-470f1d1c8595+52:915:x1830882983354752:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 231us (2464us total) trans 8589936696 rc 0/0 00000100:00100000:2.0:1746066760.945213:0:10554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5979 00000100:00080000:0.0:1746066760.946268:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746066760.948700:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.950439:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355008 00000100:00100000:1.0:1746066760.950451:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355008 00000100:00100000:1.0:1746066760.950513:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16352 00000100:00100000:1.0:1746066760.950521:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+52:915:x1830882983355008:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066760.950545:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066760.950549:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746066760.950576:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d71400/0xf1867c21abfa7cbd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x56:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f93 expref: 52 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.950605:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800958a3800/0xf1867c21abfa78e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1cf3 expref: 51 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.950616:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066760.950620:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066760.950630:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70e00/0xf1867c21abfa7d1f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fc4 expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.950730:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70200/0xf1867c21abfa7d26 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.950741:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70200/0xf1867c21abfa7d26 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.950749:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70200/0xf1867c21abfa7d26 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000004:00200000:1.0:1746066760.950760:0:7244:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00010000:00010000:1.0:1746066760.950844:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70e00/0xf1867c21abfa7d1f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fc4 expref: 53 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.950855:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70200/0xf1867c21abfa7d26 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fc4 expref: 52 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.950860:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066760.950863:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746066760.950864:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d70200, rc 0) 00000100:00100000:1.0:1746066760.950940:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+52:915:x1830882983355008:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 420us (2248us total) trans 8589936697 rc 0/0 00000100:00100000:1.0:1746066760.950945:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16352 00000100:00100000:0.0:1746066760.952872:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.953328:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.954385:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.954663:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.954679:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355136 00000100:00100000:3.0:1746066760.954690:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355136 00000100:00100000:3.0:1746066760.954735:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355392 00000100:00100000:3.0:1746066760.954737:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355392 00000100:00100000:3.0:1746066760.954750:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355648 00000100:00100000:3.0:1746066760.954752:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355648 00000100:00100000:3.0:1746066760.954765:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16274 00000100:00100000:3.0:1746066760.954771:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983355136:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066760.954818:0:3528:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.954836:0:3528:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066760.954842:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.954844:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.954847:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.954877:0:3528:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066760.954901:0:3528:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 20 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066760.954916:0:3528:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984500864:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066760.954996:0:3528:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746066760.955017:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16275 00000100:00100000:3.0:1746066760.955023:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983355392:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:3.0:1746066760.955041:0:9591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.955050:0:9591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066760.955056:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.955057:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.955059:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.955072:0:9591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 27 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066760.955079:0:9591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 27 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066760.955088:0:9591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984500992:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066760.955107:0:9591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066760.955593:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16276 00000100:00100000:1.0:1746066760.955601:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983355648:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066760.955618:0:1893:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.955627:0:1893:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.955633:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066760.955635:0:1893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746066760.955637:0:1893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.955650:0:1893:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 20 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.955656:0:1893:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 20 pid: 12237 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746066760.955664:0:1893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984501120:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066760.955689:0:1893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746066760.956529:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355264 00000100:00100000:2.0:1746066760.956536:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355264 00000100:00100000:2.0:1746066760.956574:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16277 00000100:00100000:2.0:1746066760.956579:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983355264:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:2.0:1746066760.956599:0:13363:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.956613:0:13363:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.956619:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.956620:0:13363:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.956622:0:13363:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.956644:0:13363:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 28 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.956658:0:13363:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 28 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746066760.956670:0:13363:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096424380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984501248:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066760.956710:0:13363:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a03c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746066760.957547:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.958438:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355520 00000100:00100000:1.0:1746066760.958444:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355520 00000100:00100000:1.0:1746066760.958476:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16278 00000100:00100000:1.0:1746066760.958483:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983355520:12345-192.168.204.16@tcp:1:lfs.0 00000100:00100000:0.0:1746066760.958483:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.958496:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355776 00000100:00100000:0.0:1746066760.958499:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355776 00010000:00010000:1.0:1746066760.958514:0:12237:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066760.958517:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16279 00000100:00100000:0.0:1746066760.958521:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983355776:12345-192.168.204.16@tcp:1:lfs.0 00010000:00010000:1.0:1746066760.958528:0:12237:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746066760.958535:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066760.958536:0:12237:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.958536:0:12233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.958539:0:12237:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.958545:0:12233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.958550:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066760.958551:0:12233:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746066760.958553:0:12233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.958561:0:12237:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 21 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.958564:0:12233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 29 pid: 9592 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.958571:0:12237:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 21 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746066760.958571:0:12233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 29 pid: 9592 timeout: 829 lvb_type: 0 00000100:00100000:0.0:1746066760.958581:0:12233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984501504:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066760.958582:0:12237:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984501376:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066760.958640:0:12237:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746066760.959393:0:12233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b432f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746066760.959464:0:3528:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3528:1830882984500864:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066760.959484:0:3528:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066760.959510:0:9591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9591:1830882984500992:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066760.959520:0:9591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066760.959654:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.959674:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.959995:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983355904 00000100:00100000:0.0:1746066760.960000:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983355904 00010000:00010000:0.0:1746066760.960270:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 22 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746066760.960551:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983356032 00000100:00100000:0.0:1746066760.960555:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983356032 00010000:00010000:0.0:1746066760.960569:0:7230:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 30 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066760.960571:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7360 00000100:00100000:3.0:1746066760.960579:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+22:2016:x1830882983355904:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066760.960589:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066760.960592:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7361 00000100:00100000:0.0:1746066760.960597:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983356032:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746066760.960605:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066760.960611:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 22 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746066760.960617:0:7230:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 30 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746066760.960622:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 22 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746066760.960626:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 30 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746066760.960641:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5899200/0xf1867c21abfa7d03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa8 expref: 22 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746066760.960641:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899800/0xf1867c21abfa7d11 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fb6 expref: 30 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:3.0:1746066760.960659:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.960659:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.960660:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.960660:0:7230:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.960664:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.960664:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.960671:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.960671:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.960684:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066760.960686:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066760.960744:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983356032:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 146us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.960751:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7361 00000100:00100000:1.0:1746066760.960759:0:1893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1893:1830882984501120:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066760.960771:0:1893:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.960856:0:9591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066760.960863:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066760.960864:0:9591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.960880:0:9591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.960906:0:9591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.960913:0:9591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066760.960916:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00010000:00010000:2.0:1746066760.960920:0:9591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5993000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066760.960924:0:9591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.960932:0:9591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.960943:0:9591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066760.960944:0:13363:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096424380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13363:1830882984501248:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066760.960948:0:9591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5993000/0xf1867c21abfa7d3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.960959:0:13363:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066760.960998:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983355392:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 5975us (7670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.961006:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16275 00010000:00010000:2.0:1746066760.961027:0:3528:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961034:0:3528:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961046:0:3528:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961052:0:3528:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961058:0:3528:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961068:0:3528:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800962c9800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066760.961070:0:3528:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961076:0:3528:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961085:0:3528:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.961091:0:3528:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800962c9800/0xf1867c21abfa7d34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066760.961123:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983355136:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 6352us (8256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.961129:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16274 00000100:00100000:0.0:1746066760.961232:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983356160 00000100:00100000:0.0:1746066760.961236:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983356160 00000100:00100000:3.0:1746066760.961238:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983355904:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 659us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.961244:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7360 00010000:00010000:0.0:1746066760.961248:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 28 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:0.0:1746066760.961263:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983356288 00000100:00100000:0.0:1746066760.961265:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983356288 00010000:00010000:0.0:1746066760.961273:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 20 pid: 12237 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746066760.961280:0:16766:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7362 00000100:00100000:3.0:1746066760.961285:0:16766:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983356160:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066760.961291:0:16766:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746066760.961294:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7363 00000100:00100000:0.0:1746066760.961299:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983356288:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746066760.961301:0:16766:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 28 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746066760.961306:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066760.961307:0:16766:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 28 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746066760.961315:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 20 pid: 12237 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746066760.961318:0:16766:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5899e00/0xf1867c21abfa7d0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1faf expref: 28 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:0.0:1746066760.961324:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 20 pid: 12237 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746066760.961329:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.961331:0:16766:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.961333:0:16766:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.961335:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15e00/0xf1867c21abfa7cfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4292607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fa1 expref: 20 pid: 12237 timeout: 829 lvb_type: 0 00010000:00010000:3.0:1746066760.961338:0:16766:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.961344:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.961346:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.961349:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.961350:0:16766:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746066760.961355:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066760.961365:0:16766:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983356160:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 80us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.961370:0:16766:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7362 00010000:00010000:0.0:1746066760.961371:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066760.961389:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983356288:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.961394:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7363 00010000:00010000:1.0:1746066760.961785:0:1893:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961793:0:1893:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961805:0:1893:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961816:0:1893:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961823:0:1893:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961827:0:1893:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d70400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066760.961830:0:1893:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961836:0:1893:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961845:0:1893:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961851:0:1893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d70400/0xf1867c21abfa7d42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1893 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066760.961914:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983355648:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 6314us (7528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.961919:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16276 00010000:00010000:1.0:1746066760.961934:0:13363:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961939:0:13363:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961951:0:13363:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961957:0:13363:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961961:0:13363:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961965:0:13363:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c15400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066760.961967:0:13363:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961972:0:13363:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961979:0:13363:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.961983:0:13363:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c15400/0xf1867c21abfa7d49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13363 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066760.962007:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983355264:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 5428us (7344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.962011:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16277 00000100:00100000:1.0:1746066760.963180:0:12237:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12237:1830882984501376:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066760.963196:0:12237:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066760.963328:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.963354:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066760.963419:0:12233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:12233:1830882984501504:192.168.204.16@tcp:104: 00010000:00010000:2.0:1746066760.963433:0:12233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066760.963551:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983356416 00000100:00100000:1.0:1746066760.963556:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983356416 00010000:00010000:1.0:1746066760.963577:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 18 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746066760.963595:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983356544 00000100:00100000:1.0:1746066760.963597:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983356544 00010000:00010000:1.0:1746066760.963606:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 26 pid: 9592 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746066760.963721:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7364 00000100:00100000:1.0:1746066760.963728:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+18:2015:x1830882983356416:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066760.963738:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066760.963750:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 18 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066760.963758:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 18 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066760.963775:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5898c00/0xf1867c21abfa7d18 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fbd expref: 18 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066760.963787:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066760.963788:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066760.963791:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.963798:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.963822:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066760.963847:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+17:2015:x1830882983356416:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 119us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.963852:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7364 00000100:00100000:1.0:1746066760.963864:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7365 00000100:00100000:1.0:1746066760.963868:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983356544:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066760.963874:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066760.963897:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 26 pid: 9592 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066760.963905:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 26 pid: 9592 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066760.963915:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5992c00/0xf1867c21abfa7cf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3903488->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1f9a expref: 26 pid: 9592 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066760.963922:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066760.963924:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066760.963926:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.963931:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.963942:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066760.963957:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983356544:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 89us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.963962:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7365 00010000:00010000:0.0:1746066760.964010:0:12237:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964017:0:12237:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964031:0:12237:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964037:0:12237:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964042:0:12237:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964048:0:12237:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d71400 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:0.0:1746066760.964051:0:12237:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964057:0:12237:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964067:0:12237:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.964073:0:12237:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71400/0xf1867c21abfa7d50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12237 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066760.964106:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+16:2016:x1830882983355520:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 5623us (6561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.964113:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16278 00010000:00010000:1.0:1746066760.964905:0:12233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964914:0:12233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964926:0:12233:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964932:0:12233:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964938:0:12233:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964943:0:12233:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5898a00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066760.964946:0:12233:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964952:0:12233:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964966:0:12233:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.964971:0:12233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5898a00/0xf1867c21abfa7d57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12233 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066760.965876:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+24:2016:x1830882983355776:12345-192.168.204.16@tcp:1:lfs.0 Request processed in 7350us (7388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.965919:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16279 00000100:00100000:0.0:1746066760.968195:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.968271:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983356800 00000100:00100000:1.0:1746066760.968281:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983356800 00000100:00100000:1.0:1746066760.968604:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16353 00000100:00100000:1.0:1746066760.968613:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+52:915:x1830882983356800:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:1.0:1746066760.968667:0:7244:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746066760.968694:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ecea00/0xf1867c21abfa75d2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b10 expref: 52 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.968713:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b33e00/0xf1867c21abfa75ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1b2c expref: 51 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.968725:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5728c00/0xf1867c21abfa7696 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1bbf expref: 50 pid: 7245 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.968734:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066760.968738:0:7244:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746066760.968766:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.968778:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.968787:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000040:00080000:1.0:1746066760.969206:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].663, 88 off66064 00000004:00080000:1.0:1746066760.969213:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180328933ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969526:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].593, 88 off59984 00000004:00080000:1.0:1746066760.969532:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180649086ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066760.969556:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].594, 88 off60072 00000004:00080000:1.0:1746066760.969560:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180676318ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066760.969568:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].664, 88 off66152 00000004:00080000:1.0:1746066760.969570:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180687188ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969578:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].665, 88 off66240 00000004:00080000:1.0:1746066760.969580:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180696935ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969587:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].595, 88 off60160 00000004:00080000:1.0:1746066760.969589:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180705983ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066760.969596:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].596, 88 off60248 00000004:00080000:1.0:1746066760.969598:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180715263ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066760.969604:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].597, 88 off60336 00000004:00080000:1.0:1746066760.969607:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180723598ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066760.969613:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].666, 88 off66328 00000004:00080000:1.0:1746066760.969615:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180732053ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969623:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].598, 88 off60424 00000004:00080000:1.0:1746066760.969625:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180741843ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066760.969632:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].667, 88 off66416 00000004:00080000:1.0:1746066760.969635:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180751736ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969642:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].599, 88 off60512 00000004:00080000:1.0:1746066760.969644:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180760428ns, next at 665959948938ns, rc = 0 00000040:00080000:1.0:1746066760.969650:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].668, 88 off66504 00000004:00080000:1.0:1746066760.969652:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180768923ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969658:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].669, 88 off66592 00000004:00080000:1.0:1746066760.969661:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180777618ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969668:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].670, 88 off66680 00000004:00080000:1.0:1746066760.969670:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180787026ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969677:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].671, 88 off66768 00000004:00080000:1.0:1746066760.969679:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729180795903ns, next at 665943319442ns, rc = 0 00000040:00080000:1.0:1746066760.969686:0:7244:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].600, 88 off60600 00000004:00080000:1.0:1746066760.969688:0:7244:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729180804833ns, next at 665959948938ns, rc = 0 00000001:00080000:2.0:1746066760.971396:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936698 is committed 00000004:00080000:2.0:1746066760.971416:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 590 committed 00000004:00080000:2.0:1746066760.971423:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 659 committed 00000004:00080000:2.0:1746066760.971867:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 658 committed 00000004:00080000:2.0:1746066760.971870:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 657 committed 00000004:00080000:2.0:1746066760.971872:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 656 committed 00000004:00080000:2.0:1746066760.971874:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 589 committed 00000004:00080000:2.0:1746066760.971876:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 655 committed 00000004:00080000:2.0:1746066760.971877:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 588 committed 00000004:00080000:2.0:1746066760.971879:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 654 committed 00000004:00080000:2.0:1746066760.971880:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 587 committed 00000004:00080000:2.0:1746066760.971901:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 586 committed 00000004:00080000:2.0:1746066760.971902:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 585 committed 00000004:00080000:2.0:1746066760.971904:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 653 committed 00000004:00080000:2.0:1746066760.971905:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 652 committed 00000004:00080000:2.0:1746066760.971907:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 584 committed 00000004:00080000:2.0:1746066760.971908:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 583 committed 00000004:00080000:2.0:1746066760.971909:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 651 committed 00000001:00100000:2.0:1746066760.971937:0:8132:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd32fb66-4e4e-4333-89ec-dee53f3687d4 00000001:00080000:2.0:1746066760.971941:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936695 is committed 00000001:00100000:2.0:1746066760.971944:0:8132:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2051f12-252a-4bb3-b8f3-833317fca821 00000001:00080000:2.0:1746066760.971948:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936694 is committed 00000100:00100000:1.0:1746066760.972161:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984501760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066760.972231:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066760.972268:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746066760.972273:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984501632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066760.972289:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1746066760.972629:0:8132:0:(genops.c:904:class_export_put()) final put ffff88009f86e000/bd32fb66-4e4e-4333-89ec-dee53f3687d4 00000020:00000080:2.0:1746066760.972660:0:8132:0:(genops.c:904:class_export_put()) final put ffff880130e01000/e2051f12-252a-4bb3-b8f3-833317fca821 00000020:00000080:2.0:1746066760.972681:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff88009f86e000/bd32fb66-4e4e-4333-89ec-dee53f3687d4 for lustre-MDT0000 00000020:00000080:2.0:1746066760.972728:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff880130e01000/e2051f12-252a-4bb3-b8f3-833317fca821 for lustre-MDT0000 00000020:00000080:2.0:1746066760.972753:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800b5224800 for lustre-MDT0000 00000020:00000080:2.0:1746066760.972759:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880130e05800 for lustre-MDT0000 00000100:00100000:0.0:1746066760.972861:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984501888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.972902:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066760.972929:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984502400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.972945:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066760.972957:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066760.972961:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984502016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066760.972977:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066760.972987:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984502528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973000:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066760.973022:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984501760 00000100:00100000:0.0:1746066760.973029:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984501760 00000100:00080000:0.0:1746066760.973050:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746066760.973081:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984501632 00000100:00100000:0.0:1746066760.973083:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984501632 00000100:00100000:0.0:1746066760.973095:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984501888 00000100:00100000:0.0:1746066760.973097:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984501888 00000100:00100000:0.0:1746066760.973105:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502400 00000100:00100000:0.0:1746066760.973107:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502400 00000100:00100000:0.0:1746066760.973114:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502016 00000100:00100000:0.0:1746066760.973115:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502016 00000100:00100000:0.0:1746066760.973127:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502528 00000100:00100000:0.0:1746066760.973129:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502528 00000100:00100000:0.0:1746066760.973137:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16280 00000100:00100000:0.0:1746066760.973144:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984501760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973298:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984501760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (1067us total) trans 17179874460 rc 0/0 00000100:00100000:0.0:1746066760.973304:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16280 00000100:00100000:0.0:1746066760.973318:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16281 00000100:00100000:0.0:1746066760.973322:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3775:x1830882984501632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973373:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984501632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (1082us total) trans 17179874461 rc 0/0 00000100:00100000:0.0:1746066760.973379:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16281 00000100:00100000:0.0:1746066760.973388:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16282 00000100:00100000:0.0:1746066760.973392:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882984501888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973458:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882984501888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (555us total) trans 17179874462 rc 0/0 00000100:00100000:0.0:1746066760.973463:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16282 00000100:00100000:0.0:1746066760.973472:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16283 00000100:00100000:0.0:1746066760.973476:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3776:x1830882984502400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973526:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882984502400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (579us total) trans 17179874463 rc 0/0 00000100:00100000:0.0:1746066760.973531:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16283 00000100:00100000:0.0:1746066760.973540:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16284 00000100:00100000:0.0:1746066760.973544:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984502016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.973602:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973620:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3776:x1830882984502016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (641us total) trans 21474841915 rc 0/0 00000100:00100000:0.0:1746066760.973624:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16284 00000100:00100000:1.0:1746066760.973627:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066760.973633:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502272 00000100:00100000:0.0:1746066760.973635:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502272 00000100:00100000:0.0:1746066760.973644:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16285 00000100:00100000:0.0:1746066760.973647:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3776:x1830882984502528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066760.973651:0:3775:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874449 gen 2 00000004:00080000:1.0:1746066760.973656:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb5880, transno 17179874366 00000004:00080000:1.0:1746066760.973662:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d80000, transno 17179874367 00000004:00080000:1.0:1746066760.973664:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb5500, transno 17179874368 00000004:00080000:1.0:1746066760.973666:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb6a00, transno 17179874369 00000004:00080000:1.0:1746066760.973669:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb7100, transno 17179874370 00000004:00080000:1.0:1746066760.973671:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d81500, transno 17179874371 00000004:00080000:1.0:1746066760.973674:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098fb4380, transno 17179874372 00000004:00080000:1.0:1746066760.973677:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d83800, transno 17179874373 00000004:00080000:1.0:1746066760.973679:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed5500, transno 17179874374 00000004:00080000:1.0:1746066760.973682:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed4000, transno 17179874375 00000004:00080000:1.0:1746066760.973684:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed7480, transno 17179874376 00000004:00080000:1.0:1746066760.973686:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed6680, transno 17179874377 00000004:00080000:1.0:1746066760.973689:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed5f80, transno 17179874378 00000004:00080000:1.0:1746066760.973691:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed7800, transno 17179874379 00000004:00080000:1.0:1746066760.973693:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4ed4700, transno 17179874380 00000004:00080000:1.0:1746066760.973695:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009677c000, transno 17179874381 00000100:00100000:0.0:1746066760.973696:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3776:x1830882984502528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (696us total) trans 17179874464 rc 0/0 00000004:00080000:1.0:1746066760.973697:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098481c00, transno 17179874385 00000004:00080000:1.0:1746066760.973699:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098483100, transno 17179874386 00000004:00080000:1.0:1746066760.973701:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098481180, transno 17179874387 00000100:00100000:0.0:1746066760.973701:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16285 00000004:00080000:1.0:1746066760.973703:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098482d80, transno 17179874388 00000004:00080000:1.0:1746066760.973705:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098481f80, transno 17179874389 00000004:00080000:1.0:1746066760.973707:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098480700, transno 17179874390 00000100:00100000:0.0:1746066760.973708:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16286 00000004:00080000:1.0:1746066760.973710:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098483b80, transno 17179874391 00000004:00080000:1.0:1746066760.973712:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098481880, transno 17179874392 00000100:00100000:0.0:1746066760.973712:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3775:x1830882984502272:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066760.973715:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b6300, transno 17179874393 00000004:00080000:1.0:1746066760.973717:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b5180, transno 17179874394 00000004:00080000:1.0:1746066760.973719:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b6d80, transno 17179874395 00000004:00080000:1.0:1746066760.973722:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b4700, transno 17179874396 00000004:00080000:1.0:1746066760.973723:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b7480, transno 17179874397 00000004:00080000:1.0:1746066760.973726:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b6a00, transno 17179874398 00000004:00080000:1.0:1746066760.973728:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098481500, transno 17179874399 00000004:00080000:1.0:1746066760.973730:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800b40b5c00, transno 17179874400 00000004:00080000:1.0:1746066760.973733:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094305880, transno 17179874423 00000004:00080000:1.0:1746066760.973736:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307480, transno 17179874424 00000004:00080000:1.0:1746066760.973738:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307b80, transno 17179874425 00000004:00080000:1.0:1746066760.973740:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304700, transno 17179874426 00000004:00080000:1.0:1746066760.973743:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304a80, transno 17179874427 00000004:00080000:1.0:1746066760.973745:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094304000, transno 17179874428 00000004:00080000:1.0:1746066760.973747:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094307800, transno 17179874429 00000004:00080000:1.0:1746066760.973749:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306a00, transno 17179874430 00000004:00080000:1.0:1746066760.973751:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d03100, transno 17179874434 00000004:00080000:1.0:1746066760.973753:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d00700, transno 17179874435 00000100:00100000:0.0:1746066760.973754:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3775:x1830882984502272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (126us total) trans 17179874465 rc 0/0 00000004:00080000:1.0:1746066760.973755:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d00000, transno 17179874436 00000004:00080000:1.0:1746066760.973757:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d00380, transno 17179874437 00000100:00100000:0.0:1746066760.973758:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16286 00000004:00080000:1.0:1746066760.973759:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d01880, transno 17179874438 00000004:00080000:1.0:1746066760.973761:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d03800, transno 17179874439 00000004:00080000:1.0:1746066760.973764:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d01180, transno 17179874440 00000004:00080000:1.0:1746066760.973766:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4d00e00, transno 17179874441 00000004:00080000:1.0:1746066760.973768:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094306680, transno 17179874442 00000004:00080000:1.0:1746066760.973770:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e69180, transno 17179874443 00000004:00080000:1.0:1746066760.973772:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e6bb80, transno 17179874444 00000004:00080000:1.0:1746066760.973774:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e68000, transno 17179874445 00000100:00080000:0.0:1746066760.973774:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746066760.973775:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e6b800, transno 17179874446 00000004:00080000:1.0:1746066760.973777:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e69500, transno 17179874447 00000004:00080000:1.0:1746066760.973780:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e69880, transno 17179874448 00000004:00080000:1.0:1746066760.973782:0:3775:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096e68a80, transno 17179874449 00000100:00100000:0.0:1746066760.973786:0:3776:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841902 gen 2 00000100:00100000:1.0:1746066760.973788:0:3775:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800945d4380 x1830882984501632/t17179874461(17179874461) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066776 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746066760.973790:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce07800, transno 21474841873 00000004:00080000:0.0:1746066760.973792:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e1180, transno 21474841874 00000004:00080000:0.0:1746066760.973795:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce07b80, transno 21474841875 00000004:00080000:1.0:1746066760.973797:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d4380/2, rc 0, transno 17179874461 00000004:00080000:0.0:1746066760.973797:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e3480, transno 21474841876 00000004:00080000:0.0:1746066760.973799:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e2680, transno 21474841877 00000100:00100000:1.0:1746066760.973801:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984501632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066760.973801:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e2d80, transno 21474841878 00000004:00080000:0.0:1746066760.973802:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800966e1f80, transno 21474841879 00000004:00080000:0.0:1746066760.973805:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ce05f80, transno 21474841880 00000004:00080000:0.0:1746066760.973808:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5c00, transno 21474841881 00000004:00080000:1.0:1746066760.973811:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d5880/2, rc 0, transno 17179874460 00000004:00080000:0.0:1746066760.973811:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8000, transno 21474841885 00000004:00080000:0.0:1746066760.973812:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8380, transno 21474841886 00000100:00100000:1.0:1746066760.973814:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984501760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066760.973814:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecaa00, transno 21474841887 00000004:00080000:0.0:1746066760.973816:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec8e00, transno 21474841888 00000004:00080000:0.0:1746066760.973819:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e211f80, transno 21474841889 00000004:00080000:0.0:1746066760.973821:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecbb80, transno 21474841890 00000004:00080000:0.0:1746066760.973823:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ec9180, transno 21474841891 00000004:00080000:1.0:1746066760.973824:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d4a80/2, rc 0, transno 17179874465 00000004:00080000:0.0:1746066760.973825:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88006e210000, transno 21474841892 00000100:00100000:1.0:1746066760.973826:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066760.973828:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096ecb100, transno 21474841893 00000004:00080000:0.0:1746066760.973830:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7100, transno 21474841894 00000100:00100000:1.0:1746066760.973831:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000004:00080000:0.0:1746066760.973832:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7800, transno 21474841895 00000004:00080000:0.0:1746066760.973834:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5f80, transno 21474841896 00000100:00100000:1.0:1746066760.973835:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066760.973835:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7b80, transno 21474841897 00000004:00080000:0.0:1746066760.973837:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a6d80, transno 21474841898 00000004:00080000:0.0:1746066760.973839:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a4a80, transno 21474841899 00000004:00080000:0.0:1746066760.973841:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a5880, transno 21474841900 00000004:00080000:0.0:1746066760.973843:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800958a7480, transno 21474841901 00000004:00080000:0.0:1746066760.973846:0:3776:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095cedf80, transno 21474841902 00000100:00100000:0.0:1746066760.973849:0:3776:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a4d82300 x1830882984502016/t21474841915(21474841915) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746066776 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:1.0:1746066760.973852:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746066760.973856:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d82300/2, rc 0, transno 21474841915 00000100:00100000:0.0:1746066760.973859:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984502016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.973865:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800945d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066760.973867:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d6300/2, rc 0, transno 17179874464 00000100:00100000:0.0:1746066760.973870:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984502528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066760.973875:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d4700/2, rc 0, transno 17179874462 00000100:00100000:1.0:1746066760.973877:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066760.973877:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984501888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066760.973901:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d6d80/2, rc 0, transno 17179874463 00000100:00100000:0.0:1746066760.973904:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984502400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066760.973908:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502144 00000100:00100000:1.0:1746066760.973912:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502144 00000100:00100000:0.0:1746066760.973916:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502656 00000100:00100000:0.0:1746066760.973918:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502656 00000100:00100000:1.0:1746066760.973930:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16287 00000100:00100000:1.0:1746066760.973934:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882984502144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973938:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16288 00000100:00100000:0.0:1746066760.973942:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882984502656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066760.973997:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984502656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (119us total) trans 17179874466 rc 0/0 00000100:00100000:0.0:1746066760.974003:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16288 00000100:00100000:1.0:1746066760.974093:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984502144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (240us total) trans 17179874467 rc 0/0 00000100:00100000:1.0:1746066760.974099:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16287 00000004:00080000:1.0:1746066760.974119:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d5180/2, rc 0, transno 17179874467 00000100:00100000:1.0:1746066760.974122:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066760.974128:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800945d6680/2, rc 0, transno 17179874466 00000100:00100000:1.0:1746066760.974130:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800945d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502656:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746066760.974376:0:8148:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 56 done 00000004:00010000:1.0:1746066760.974424:0:7244:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800945d5f80 reply state ffff8800984e3000 transno 8589936698 ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.974443:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.974451:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066760.974454:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746066760.974457:0:7244:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:3.0:1746066760.974514:0:8146:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 8 changes, 1 in progress, 0 in flight, 27 done 00010000:00080000:1.0:1746066760.974533:0:7244:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746066760.974547:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800945d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:915:x1830882983356800:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 5934us (6359us total) trans 8589936698 rc 0/0 00000100:00100000:1.0:1746066760.974553:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16353 00010000:00010000:1.0:1746066760.974575:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.974582:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066760.974587:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984503040:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746066760.974587:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.974592:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800979a6200 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066760.974597:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.974603:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066760.974611:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746066760.974611:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066760.974613:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066760.974616:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066760.974621:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800979a6200/0xf1867c21abfa7d5e lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:3.0:1746066760.974625:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984503552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.974637:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.974639:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066760.974649:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746066760.974654:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984502912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.974659:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066760.974668:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066760.974673:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984503296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.974679:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984503424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.974687:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066760.974697:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984503040 00000100:00100000:3.0:1746066760.974700:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984503040 00000100:00100000:1.0:1746066760.974701:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746066760.974705:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984503168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.974715:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984503552 00000100:00100000:1.0:1746066760.974716:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066760.974717:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984503552 00000100:00100000:1.0:1746066760.974723:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984503680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.974728:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502784 00000100:00100000:3.0:1746066760.974730:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502784 00000100:00100000:1.0:1746066760.974732:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066760.974739:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984502912 00000100:00100000:3.0:1746066760.974741:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984502912 00000100:00100000:1.0:1746066760.974745:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984503296 00000100:00100000:3.0:1746066760.974748:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984503168 00000100:00100000:1.0:1746066760.974748:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984503296 00000100:00100000:3.0:1746066760.974749:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984503168 00000100:00100000:3.0:1746066760.974756:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984503680 00000100:00100000:3.0:1746066760.974758:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984503680 00000100:00100000:1.0:1746066760.974760:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16289 00000100:00100000:1.0:1746066760.974764:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3777:x1830882984503040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.974767:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16290 00000100:00100000:3.0:1746066760.974772:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3777:x1830882984503552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.974826:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984503040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (214us total) trans 21474841916 rc 0/0 00000100:00100000:1.0:1746066760.974830:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16289 00000100:00100000:3.0:1746066760.974833:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984503552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (193us total) trans 21474841917 rc 0/0 00000100:00100000:3.0:1746066760.974839:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16290 00000100:00100000:1.0:1746066760.974842:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16291 00000100:00100000:1.0:1746066760.974845:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984502784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.974850:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16292 00000100:00100000:3.0:1746066760.974854:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3777:x1830882984502912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.974901:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984502784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (242us total) trans 21474841918 rc 0/0 00000100:00100000:1.0:1746066760.974906:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16291 00000100:00100000:3.0:1746066760.974928:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882984502912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (258us total) trans 21474841919 rc 0/0 00000100:00100000:3.0:1746066760.974933:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16292 00000100:00100000:3.0:1746066760.974944:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16293 00000100:00100000:3.0:1746066760.974948:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882984503296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.974995:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800967a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984503296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (307us total) trans 21474841920 rc 0/0 00000100:00100000:1.0:1746066760.974998:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16294 00000100:00100000:3.0:1746066760.975000:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16293 00000100:00100000:1.0:1746066760.975002:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984503168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746066760.975010:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16295 00000100:00100000:3.0:1746066760.975015:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3775:x1830882984503680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.975053:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984503168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (335us total) trans 21474841921 rc 0/0 00000100:00100000:1.0:1746066760.975057:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16294 00000100:00100000:3.0:1746066760.975065:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3775:x1830882984503680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (331us total) trans 21474841922 rc 0/0 00000100:00100000:3.0:1746066760.975073:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16295 00000004:00080000:1.0:1746066760.975079:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d83100/2, rc 0, transno 21474841921 00000100:00100000:1.0:1746066760.975082:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984503168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066760.975088:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d82a00/2, rc 0, transno 21474841922 00000100:00100000:3.0:1746066760.975090:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066760.975091:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984503680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066760.975096:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d80700/2, rc 0, transno 21474841918 00000100:00100000:1.0:1746066760.975098:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984502784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066760.975104:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d80000/2, rc 0, transno 21474841920 00000100:00100000:1.0:1746066760.975106:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984503296:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066760.975109:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d82680/2, rc 0, transno 21474841916 00000100:00100000:3.0:1746066760.975113:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984503040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.975117:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984503424 00000004:00080000:3.0:1746066760.975119:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d83800/2, rc 0, transno 21474841917 00000100:00100000:1.0:1746066760.975120:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984503424 00000100:00100000:3.0:1746066760.975122:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984503552:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746066760.975128:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d80380/2, rc 0, transno 21474841919 00000100:00100000:3.0:1746066760.975131:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984502912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.975133:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16296 00000100:00100000:1.0:1746066760.975137:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3777:x1830882984503424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066760.975195:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3777:x1830882984503424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (104us total) trans 21474841923 rc 0/0 00000004:00080000:3.0:1746066760.975200:0:3777:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4d81500/2, rc 0, transno 21474841923 00000100:00100000:1.0:1746066760.975200:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16296 00000100:00100000:3.0:1746066760.975203:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3777:1830882984503424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066760.978285:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.978358:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983356928 00000100:00100000:1.0:1746066760.978368:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983356928 00000100:00100000:1.0:1746066760.978977:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16354 00000100:00100000:1.0:1746066760.978986:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:915:x1830882983356928:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066760.979011:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066760.979031:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fcb expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.979093:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.979106:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 28 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066760.979123:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066760.979127:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746066760.979130:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e363600, rc 0) 00000100:00100000:1.0:1746066760.979192:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+28:915:x1830882983356928:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 207us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.979198:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16354 00000100:00100000:0.0:1746066760.981870:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.981954:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357056 00000100:00100000:3.0:1746066760.981963:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357056 00000100:00100000:3.0:1746066760.982005:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16355 00000100:00100000:3.0:1746066760.982013:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+28:915:x1830882983357056:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066760.982031:0:13370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066760.982048:0:13370:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009718ce00/0xf1867c21abfa7d6c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fd2 expref: -99 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.982137:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009718c200/0xf1867c21abfa7d73 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066760.982148:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009718c200/0xf1867c21abfa7d73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066760.982158:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009718c200/0xf1867c21abfa7d73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00200000:3.0:1746066760.982190:0:13370:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x56:0x0]: returning size 9225344 00000004:00200000:3.0:1746066760.982194:0:13370:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746066760.982207:0:13370:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009718c200/0xf1867c21abfa7d73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066760.982226:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009718ce00/0xf1867c21abfa7d6c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd2 expref: 30 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.982257:0:13370:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009718c200/0xf1867c21abfa7d73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd2 expref: 29 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066760.982264:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066760.982266:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746066760.982269:0:13370:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718c200, rc 0) 00000100:00100000:3.0:1746066760.982841:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:915:x1830882983357056:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 826us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.982848:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16355 00000100:00100000:1.0:1746066760.987015:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.987054:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.987079:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.987108:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357184 00000100:00100000:0.0:1746066760.987118:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357184 00000100:00100000:2.0:1746066760.987123:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357440 00000100:00100000:2.0:1746066760.987128:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357440 00000100:00100000:1.0:1746066760.987159:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066760.987543:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357568 00000100:00100000:0.0:1746066760.987543:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357312 00000100:00100000:1.0:1746066760.987547:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357568 00000100:00100000:0.0:1746066760.987547:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357312 00000100:00100000:2.0:1746066760.987560:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16297 00000100:00100000:2.0:1746066760.987570:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+17:2016:x1830882983357184:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066760.987594:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746066760.987602:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16298 00000100:00100000:0.0:1746066760.987609:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983357440:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066760.987614:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fd9 expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066760.987617:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066760.987629:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fe7 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066760.987644:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x6812dd47, atime: 0x6812dd46, ctime: 0x6812dd46, blocks: 0x808 00002000:00010000:0.0:1746066760.987644:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd47, blocks: 0x800 00010000:00010000:2.0:1746066760.987662:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.987662:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.987664:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.987664:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.987672:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.987672:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.987686:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.987686:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.987696:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14600, rc 0) 00010000:00010000:0.0:1746066760.987698:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2d200, rc 0) 00000100:00100000:2.0:1746066760.987739:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983357184:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 172us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.987740:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983357440:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 131us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.987746:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16298 00000100:00100000:2.0:1746066760.987750:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16297 00000100:00100000:0.0:1746066760.987762:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16299 00000100:00100000:2.0:1746066760.987766:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16300 00000100:00100000:0.0:1746066760.987767:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2016:x1830882983357312:12345-192.168.204.16@tcp:101:lfs.0 00000100:00100000:2.0:1746066760.987771:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+17:2016:x1830882983357568:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:0.0:1746066760.987773:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066760.987777:0:9591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746066760.987780:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fe0 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066760.987786:0:9591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1fee expref: -99 pid: 9591 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746066760.987790:0:11630:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x6812dd47, atime: 0x6812dd47, ctime: 0x6812dd47, blocks: 0x808 00000100:00100000:1.0:1746066760.987795:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00002000:00010000:2.0:1746066760.987796:0:9591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd48, blocks: 0x800 00010000:00010000:0.0:1746066760.987797:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.987799:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066760.987802:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.987804:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.987805:0:9591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.987809:0:9591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.987811:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 26 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746066760.987817:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129d2c400, rc 0) 00010000:00010000:2.0:1746066760.987818:0:9591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 18 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.987826:0:9591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15c00, rc 0) 00000100:00100000:0.0:1746066760.987832:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983357312:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 65us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.987837:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16299 00000100:00100000:2.0:1746066760.987842:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983357568:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 70us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.987848:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16300 00000100:00100000:2.0:1746066760.987960:0:9590:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357696 00000100:00100000:2.0:1746066760.987964:0:9590:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357696 00000100:00100000:2.0:1746066760.987983:0:9590:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16301 00000100:00100000:2.0:1746066760.987987:0:9590:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+18:2016:x1830882983357696:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066760.987994:0:9590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066760.988002:0:9590:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ff5 expref: -99 pid: 9590 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746066760.988012:0:9590:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9a:0x0] initial LVB size: 5031040, mtime: 0x6812dd48, atime: 0x6812dd47, ctime: 0x6812dd48, blocks: 0x1668 00010000:00010000:2.0:1746066760.988021:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.988022:0:9590:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066760.988027:0:9590:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.988035:0:9590:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 19 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066760.988041:0:9590:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15400, rc 0) 00000100:00100000:2.0:1746066760.988060:0:9590:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983357696:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066760.988065:0:9590:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16301 00000100:00100000:1.0:1746066760.988668:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066760.991140:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357824 00000100:00100000:3.0:1746066760.991151:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357824 00000100:00100000:3.0:1746066760.991206:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16302 00000100:00100000:3.0:1746066760.991213:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+26:2016:x1830882983357824:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066760.991230:0:3528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066760.991248:0:3528:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d1ffc expref: -99 pid: 3528 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746066760.991296:0:3528:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7a:0x0] initial LVB size: 4194304, mtime: 0x6812dd48, atime: 0x6812dd48, ctime: 0x6812dd48, blocks: 0x1000 00010000:00010000:3.0:1746066760.991315:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.991318:0:3528:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066760.991326:0:3528:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066760.991340:0:3528:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 27 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066760.991351:0:3528:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718d400, rc 0) 00000100:00100000:3.0:1746066760.991408:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983357824:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 196us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.991414:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16302 00000100:00100000:0.0:1746066760.995392:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.995446:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.995475:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.995492:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.995503:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.995545:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.995570:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983357952 00000100:00100000:0.0:1746066760.995578:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983357952 00000100:00100000:3.0:1746066760.995581:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358208 00000100:00100000:3.0:1746066760.995586:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358208 00000100:00100000:3.0:1746066760.995615:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358464 00000100:00100000:3.0:1746066760.995617:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358464 00000100:00100000:0.0:1746066760.995727:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358080 00000100:00100000:0.0:1746066760.995731:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358080 00000100:00100000:1.0:1746066760.995733:0:1893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358336 00000100:00100000:3.0:1746066760.995735:0:9592:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358592 00000100:00100000:1.0:1746066760.995736:0:1893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358336 00000100:00100000:3.0:1746066760.995738:0:9592:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358592 00000100:00100000:0.0:1746066760.995750:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16303 00000100:00100000:1.0:1746066760.995761:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16304 00000100:00100000:3.0:1746066760.995766:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16305 00000100:00100000:1.0:1746066760.995766:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983357952:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066760.995772:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983358464:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066760.995790:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16306 00000100:00100000:3.0:1746066760.995794:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983358080:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066760.995879:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+21:2016:x1830882983357952:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 112us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.995914:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16304 00000100:00100000:1.0:1746066760.995929:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16307 00000100:00100000:1.0:1746066760.995934:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983358592:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066760.995968:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983358592:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.995973:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16307 00000100:00100000:1.0:1746066760.995984:0:1893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16308 00000100:00100000:1.0:1746066760.995988:0:1893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983358336:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066760.996005:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983358080:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 209us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.996011:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16306 00000100:00100000:1.0:1746066760.996018:0:1893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983358336:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066760.996022:0:1893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16308 00000100:00100000:3.0:1746066760.996050:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983358464:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 278us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066760.996055:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16305 00000100:00100000:0.0:1746066760.996414:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983358208:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066760.996473:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983358208:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 716us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066760.996480:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16303 00000100:00100000:0.0:1746066760.999682:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066760.999719:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066761.000394:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.000452:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358720 00000100:00100000:2.0:1746066761.000461:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358720 00000100:00080000:1.0:1746066761.000519:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066761.000521:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358976 00000100:00100000:2.0:1746066761.000524:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358976 00000100:00080000:1.0:1746066761.000536:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746066761.000544:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16309 00000100:00100000:2.0:1746066761.000557:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983358720:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066761.000681:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983358720:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 130us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.000688:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16309 00000100:00100000:2.0:1746066761.000703:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16310 00000100:00100000:2.0:1746066761.000708:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983358976:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:2.0:1746066761.000747:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983358976:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 39us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.000753:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16310 00000100:00100000:3.0:1746066761.000807:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983359232 00000100:00100000:3.0:1746066761.000811:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983359232 00000100:00100000:0.0:1746066761.000827:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.000841:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983358848 00000100:00100000:3.0:1746066761.000843:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983358848 00000100:00100000:1.0:1746066761.000847:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16311 00000100:00100000:0.0:1746066761.000852:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.000855:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983359232:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066761.000866:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983359104 00000100:00100000:3.0:1746066761.000868:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983359104 00000100:00100000:3.0:1746066761.000880:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16312 00000100:00100000:0.0:1746066761.000897:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.000898:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983358848:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:1.0:1746066761.000908:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983359232:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 54us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.000913:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16311 00000100:00100000:0.0:1746066761.000924:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983359360 00000100:00100000:0.0:1746066761.000928:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983359360 00000100:00100000:3.0:1746066761.000937:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+28:2016:x1830882983358848:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.000942:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16312 00000100:00100000:0.0:1746066761.000952:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16313 00000100:00100000:0.0:1746066761.000958:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983359360:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:3.0:1746066761.000971:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16314 00000100:00100000:3.0:1746066761.000975:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983359104:12345-192.168.204.16@tcp:23:lfs.0 00000100:00100000:0.0:1746066761.000992:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983359360:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066761.000998:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16313 00000100:00100000:3.0:1746066761.001008:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983359104:12345-192.168.204.16@tcp:23:lfs.0 Request processed in 31us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.001012:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16314 00000100:00100000:0.0:1746066761.010262:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.010425:0:13349:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983359616 00000100:00100000:1.0:1746066761.010437:0:13349:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983359616 00000100:00100000:1.0:1746066761.010697:0:13349:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4409 00000100:00100000:1.0:1746066761.010706:0:13349:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983359616:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066761.010745:0:13349:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.010760:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.010762:0:13349:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.010768:0:13349:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.010783:0:13349:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066761.012335:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.012614:0:20358:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983360000 00000100:00100000:2.0:1746066761.012620:0:20358:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983360000 00000100:00100000:2.0:1746066761.012677:0:20358:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4410 00000100:00100000:2.0:1746066761.012686:0:20358:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+27:2016:x1830882983360000:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066761.012718:0:20358:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.012732:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.012734:0:20358:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.012738:0:20358:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.012751:0:20358:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.012868:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.012901:0:9596:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983359872 00000100:00100000:3.0:1746066761.012910:0:9596:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983359872 00000100:00100000:3.0:1746066761.012939:0:9596:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4411 00000100:00100000:3.0:1746066761.012944:0:9596:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983359872:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066761.012960:0:9596:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.012967:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.012969:0:9596:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.012971:0:9596:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.012983:0:9596:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746066761.018552:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066761.018572:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066761.018604:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:0.0:1746066761.018626:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983360384 00000100:00100000:0.0:1746066761.018636:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983360384 00000100:00100000:0.0:1746066761.018693:0:29519:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983360640 00000100:00100000:0.0:1746066761.018696:0:29519:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983360640 00000100:00100000:1.0:1746066761.018699:0:9597:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983360896 00000100:00100000:1.0:1746066761.018705:0:9597:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983360896 00000100:00100000:0.0:1746066761.018712:0:29519:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4412 00000100:00100000:0.0:1746066761.018720:0:29519:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983360384:12345-192.168.204.16@tcp:3:lfs.0 00000100:00100000:1.0:1746066761.018734:0:9597:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4413 00000100:00100000:1.0:1746066761.018739:0:9597:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983360640:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:1.0:1746066761.018756:0:9597:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066761.018756:0:29519:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.018770:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066761.018770:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.018772:0:9597:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746066761.018772:0:29519:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.018776:0:9597:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066761.018776:0:29519:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.018788:0:9597:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746066761.018788:0:29519:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066761.018962:0:9595:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4414 00000100:00100000:2.0:1746066761.018969:0:9595:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983360896:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066761.018987:0:9595:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.018994:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.018995:0:9595:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.018998:0:9595:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.019006:0:9595:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.020442:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.020580:0:20357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983361152 00000100:00100000:2.0:1746066761.020588:0:20357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983361152 00000100:00100000:2.0:1746066761.020640:0:20357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4415 00000100:00100000:2.0:1746066761.020647:0:20357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983361152:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:2.0:1746066761.020671:0:20357:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.020683:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.020685:0:20357:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.020689:0:20357:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.020698:0:20357:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066761.023662:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.025436:0:13353:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983361408 00000100:00100000:3.0:1746066761.025448:0:13353:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983361408 00000100:00100000:3.0:1746066761.025511:0:13353:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 4416 00000100:00100000:3.0:1746066761.025518:0:13353:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+33:2015:x1830882983361408:12345-192.168.204.16@tcp:3:lfs.0 00010000:00010000:3.0:1746066761.025555:0:13353:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.025569:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.025571:0:13353:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.025576:0:13353:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.025587:0:13353:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.035426:0:13349:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.035445:0:13349:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.035453:0:13349:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.035460:0:13349:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098a4b600 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066761.035464:0:13349:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.035471:0:13349:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.035492:0:13349:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.035498:0:13349:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098a4b600/0xf1867c21abfa7da4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13349 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.036436:0:13349:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4a932635-1bad-46b9-b237-470f1d1c8595+25:2015:x1830882983359616:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 25723us (26176us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066761.036447:0:13349:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4409 00010000:00010000:3.0:1746066761.052373:0:9596:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.052392:0:9596:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.052425:0:9596:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.052441:0:9596:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f21800 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066761.052446:0:9596:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.052454:0:9596:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.052478:0:9596:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.052491:0:9596:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f21800/0xf1867c21abfa7db2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9596 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066761.053712:0:9596:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a932635-1bad-46b9-b237-470f1d1c8595+33:2016:x1830882983359872:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 40759us (40836us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066761.053722:0:9596:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4411 00010000:00010000:2.0:1746066761.056690:0:20358:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.056707:0:20358:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.056714:0:20358:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.056720:0:20358:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066761.056723:0:20358:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.056732:0:20358:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.056751:0:20358:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.056756:0:20358:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c14e00/0xf1867c21abfa7dab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20358 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066761.056831:0:20358:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983360000:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 44142us (44497us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066761.056841:0:20358:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4410 00010000:00010000:1.0:1746066761.068996:0:9597:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.069014:0:9597:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.069022:0:9597:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.069030:0:9597:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d71c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:1.0:1746066761.069033:0:9597:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.069041:0:9597:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.069059:0:9597:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.069070:0:9597:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d71c00/0xf1867c21abfa7dc0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9597 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.069178:0:9597:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4a932635-1bad-46b9-b237-470f1d1c8595+23:2015:x1830882983360640:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 50432us (50598us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746066761.069189:0:9597:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4413 00010000:00010000:2.0:1746066761.073362:0:9595:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.073381:0:9595:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.073390:0:9595:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.073409:0:9595:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c15e00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066761.073413:0:9595:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.073421:0:9595:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.073440:0:9595:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.073446:0:9595:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097c15e00/0xf1867c21abfa7dc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9595 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066761.074162:0:9595:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983360896:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 55188us (55551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066761.074173:0:9595:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4414 00010000:00010000:2.0:1746066761.077757:0:20357:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.077775:0:20357:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.077785:0:20357:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.077791:0:20357:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097c14c00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066761.077796:0:20357:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.077804:0:20357:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.077824:0:20357:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.077830:0:20357:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14c00/0xf1867c21abfa7dce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20357 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066761.077931:0:20357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983361152:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 57278us (57488us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066761.077942:0:20357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4415 00010000:00010000:2.0:1746066761.079435:0:29519:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.079446:0:29519:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.079453:0:29519:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.079463:0:29519:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098be3000 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:2.0:1746066761.079466:0:29519:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.079473:0:29519:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.079486:0:29519:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.079492:0:29519:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098be3000/0xf1867c21abfa7db9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066761.079551:0:29519:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983360384:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 60829us (61006us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746066761.079558:0:29519:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4412 00010000:00010000:3.0:1746066761.085579:0:13353:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.085598:0:13353:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.085606:0:13353:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.085614:0:13353:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009718ce00 already unused, calling callback (ffffffffa0898d70) 00010000:00010000:3.0:1746066761.085618:0:13353:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.085628:0:13353:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.085647:0:13353:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.085654:0:13353:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009718ce00/0xf1867c21abfa7dd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13353 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746066761.086095:0:13353:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983361408:12345-192.168.204.16@tcp:3:lfs.0 Request processed in 60571us (62439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746066761.086106:0:13353:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 4416 00000100:00100000:0.0:1746066761.093260:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.093374:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983361664 00000100:00100000:3.0:1746066761.093385:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983361664 00000100:00100000:3.0:1746066761.093474:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16356 00000100:00100000:3.0:1746066761.093483:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+29:915:x1830882983361664:12345-192.168.204.16@tcp:36:lfs.0 00010000:00010000:3.0:1746066761.093541:0:13370:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746066761.093571:0:13370:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009718c200/0xf1867c21abfa7d73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd2 expref: 29 pid: 13370 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.093609:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066761.093614:0:13370:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066761.093674:0:13370:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066761.093687:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066761.093700:0:13370:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00000004:00010000:3.0:1746066761.093804:0:13370:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ea25500 reply state ffff880096efa000 transno 8589936699 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066761.093813:0:13370:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:3.0:1746066761.093818:0:13370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066761.093821:0:13370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746066761.093823:0:13370:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746066761.093934:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4a932635-1bad-46b9-b237-470f1d1c8595+30:915:x1830882983361664:12345-192.168.204.16@tcp:36:lfs.0 Request processed in 451us (685us total) trans 8589936699 rc 0/0 00000100:00100000:3.0:1746066761.093940:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16356 00000100:00100000:0.0:1746066761.095317:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.096763:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983361792 00000100:00100000:2.0:1746066761.096771:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983361792 00000100:00100000:2.0:1746066761.097015:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16315 00000100:00100000:2.0:1746066761.097023:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:915:x1830882983361792:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066761.097042:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066761.097061:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097c15600/0xf1867c21abfa7de3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d2003 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.097090:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066761.097104:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.097106:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746066761.097109:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15600/0xf1867c21abfa7de3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2003 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.097143:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746066761.097155:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00000100:00100000:2.0:1746066761.097167:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096427b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984503808:192.168.204.16@tcp:104: 00000100:00100000:2.0:1746066761.097264:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746066761.101706:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096427b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984503808:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066761.101744:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097c15600/0xf1867c21abfa7de3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2003 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.101763:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c15600, rc 0) 00000100:00100000:3.0:1746066761.101814:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:915:x1830882983361792:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 4791us (6499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.101823:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16315 00000100:00100000:0.0:1746066761.103525:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.104092:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983361920 00000100:00100000:1.0:1746066761.104103:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983361920 00010000:00010000:1.0:1746066761.104144:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746066761.104755:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7366 00000100:00100000:1.0:1746066761.104765:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983361920:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.104783:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066761.104812:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.104828:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.104856:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c14600/0xf1867c21abfa7d7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fd9 expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.105207:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.105210:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.105218:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15600/0xf1867c21abfa7de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2003 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.105227:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15600/0xf1867c21abfa7de3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2003 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.105266:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15600/0xf1867c21abfa7de3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2003 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.105280:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984503936:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066761.105373:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31540 going to sleep for 11 seconds 00000100:00100000:1.0:1746066761.107797:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984503936:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066761.107818:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066761.107861:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983361920:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 3097us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.107871:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7366 00000100:00100000:0.0:1746066761.108095:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.108164:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362048 00000100:00100000:3.0:1746066761.108171:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362048 00000100:00100000:3.0:1746066761.108209:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16316 00000100:00100000:3.0:1746066761.108216:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:915:x1830882983362048:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066761.108234:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066761.108252:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009718c200/0xf1867c21abfa7dea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d200a expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.108279:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.108286:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.108288:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.108291:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009718c200/0xf1867c21abfa7dea lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d200a expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.108318:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.108331:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066761.108342:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984504064:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066761.108467:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066761.110289:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.110542:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362176 00000100:00100000:1.0:1746066761.110550:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362176 00010000:00010000:1.0:1746066761.110579:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 29 pid: 11630 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066761.110688:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984504064:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066761.110712:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009718c200/0xf1867c21abfa7dea lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d200a expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.110726:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009718c200, rc 0) 00000100:00100000:1.0:1746066761.110847:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7367 00000100:00100000:1.0:1746066761.110855:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983362176:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.110866:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746066761.110976:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:915:x1830882983362048:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2759us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.110983:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16316 00010000:00010000:1.0:1746066761.111285:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.111301:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.111323:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2c400/0xf1867c21abfa7d88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe0 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.111334:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.111335:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.111342:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009718c200/0xf1867c21abfa7dea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d200a expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.111349:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009718c200/0xf1867c21abfa7dea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d200a expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.111376:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009718c200/0xf1867c21abfa7dea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d200a expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.111387:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984504192:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066761.111459:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066761.117299:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.117388:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362304 00000100:00100000:3.0:1746066761.117406:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362304 00000100:00100000:1.0:1746066761.117426:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984504192:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066761.117461:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16317 00000100:00100000:3.0:1746066761.117470:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:915:x1830882983362304:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066761.117610:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746066761.117622:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066761.117628:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7df1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d2011 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.117656:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 29 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.117663:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746066761.117663:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983362176:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 6809us (7380us total) trans 0 rc 0/0 00010000:00010000:3.0:1746066761.117665:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.117668:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7df1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2011 expref: 29 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.117672:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7367 00010000:00010000:3.0:1746066761.117696:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 28 pid: 11630 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.117706:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066761.117716:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984504320:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066761.117769:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066761.119482:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.119607:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984504320:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066761.119628:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7df1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2011 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.119648:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009414ca00, rc 0) 00000100:00100000:3.0:1746066761.119675:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:915:x1830882983362304:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 2207us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.119682:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16317 00000100:00100000:1.0:1746066761.119704:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362432 00000100:00100000:1.0:1746066761.119709:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362432 00010000:00010000:1.0:1746066761.119730:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746066761.120292:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7368 00000100:00100000:1.0:1746066761.120298:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983362432:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.120309:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066761.120330:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.120340:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.120362:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129d2d200/0xf1867c21abfa7d81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fe7 expref: 28 pid: 11630 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.120373:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.120374:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.120580:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7df1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2011 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.120589:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7df1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2011 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.120613:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009414ca00/0xf1867c21abfa7df1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2011 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.120623:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984504448:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066761.120678:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066761.122094:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.122135:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362560 00000100:00100000:3.0:1746066761.122140:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362560 00000100:00100000:3.0:1746066761.122171:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16318 00000100:00100000:1.0:1746066761.122172:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984504448:192.168.204.16@tcp:105: 00000100:00100000:3.0:1746066761.122177:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:915:x1830882983362560:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:1.0:1746066761.122184:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746066761.122191:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066761.122207:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7df8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d2018 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.122213:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:2015:x1830882983362432:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1916us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.122219:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7368 00010000:00010000:3.0:1746066761.122229:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.122236:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.122237:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.122240:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7df8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2018 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.122259:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 20 pid: 9591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.122270:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066761.122285:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984504576:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066761.122343:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066761.123462:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984504576:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066761.123479:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7df8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2018 expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.123490:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009414dc00, rc 0) 00000100:00100000:3.0:1746066761.123646:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:915:x1830882983362560:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1468us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.123652:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16318 00000100:00100000:0.0:1746066761.124274:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.124312:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362688 00000100:00100000:1.0:1746066761.124317:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362688 00010000:00010000:1.0:1746066761.124340:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746066761.124786:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7369 00000100:00100000:1.0:1746066761.124793:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2016:x1830882983362688:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.124803:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066761.124821:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.124832:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.124853:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15c00/0xf1867c21abfa7d8f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fee expref: 20 pid: 9591 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.124906:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.124908:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.124918:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7df8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2018 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.124934:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7df8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2018 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.124959:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009414dc00/0xf1867c21abfa7df8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2018 expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.124969:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984504704:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066761.125125:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746066761.126380:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.126463:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984504704:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066761.126474:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066761.126501:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2016:x1830882983362688:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1708us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.126508:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7369 00000100:00100000:3.0:1746066761.126568:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362816 00000100:00100000:3.0:1746066761.126573:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362816 00000100:00100000:3.0:1746066761.126600:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16319 00000100:00100000:3.0:1746066761.126606:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:915:x1830882983362816:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066761.126621:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066761.126634:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7dff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d201f expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.126654:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.126660:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.126662:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.126664:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7dff lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d201f expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.126685:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 20 pid: 9590 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.126696:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 20 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066761.126704:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984504832:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066761.127052:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066761.128532:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11630:1830882984504832:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066761.128556:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7dff lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d201f expref: 20 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.128571:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecfc00, rc 0) 00000100:00100000:3.0:1746066761.128605:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:915:x1830882983362816:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1997us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.128611:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16319 00000100:00100000:0.0:1746066761.128770:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.128964:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983362944 00000100:00100000:1.0:1746066761.128970:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983362944 00010000:00010000:1.0:1746066761.128996:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 20 pid: 9590 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746066761.129018:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7370 00000100:00100000:1.0:1746066761.129024:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882983362944:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.129037:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066761.129056:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 20 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.129072:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 20 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.129092:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097c15400/0xf1867c21abfa7d96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ff5 expref: 20 pid: 9590 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.129275:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.129277:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.129284:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7dff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d201f expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.129292:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d201f expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.129442:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ecfc00/0xf1867c21abfa7dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d201f expref: 19 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.129454:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984504960:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066761.129505:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066761.130974:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8395:1830882984504960:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066761.130988:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066761.131028:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983362944:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 2003us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.131036:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7370 00000100:00100000:0.0:1746066761.131308:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.131439:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363072 00000100:00100000:3.0:1746066761.131445:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363072 00000100:00100000:3.0:1746066761.131484:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16320 00000100:00100000:3.0:1746066761.131490:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+27:915:x1830882983363072:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:3.0:1746066761.131507:0:11630:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746066761.131522:0:11630:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa7e06 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d2026 expref: -99 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.131554:0:11630:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 28 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.131561:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.131563:0:11630:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746066761.131567:0:11630:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa7e06 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2026 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.131589:0:11630:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 28 pid: 3528 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746066761.131604:0:11630:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 28 pid: 3528 timeout: 829 lvb_type: 1 00000100:00100000:3.0:1746066761.131614:0:11630:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984505088:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066761.131943:0:11630:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1746066761.133102:0:11630:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11630:1830882984505088:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066761.133122:0:11630:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa7e06 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2026 expref: 28 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.133134:0:11630:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ecec00, rc 0) 00000100:00100000:3.0:1746066761.133167:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:915:x1830882983363072:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 1676us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.133172:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16320 00000100:00100000:0.0:1746066761.133373:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.133474:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363200 00000100:00100000:1.0:1746066761.133480:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363200 00010000:00010000:1.0:1746066761.133499:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 28 pid: 3528 timeout: 829 lvb_type: 1 00000100:00100000:1.0:1746066761.133529:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7371 00000100:00100000:1.0:1746066761.133535:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983363200:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.133545:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066761.133563:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 28 pid: 3528 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.133571:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 28 pid: 3528 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.133590:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009718d400/0xf1867c21abfa7d9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1ffc expref: 28 pid: 3528 timeout: 829 lvb_type: 1 00010000:00010000:1.0:1746066761.133648:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.133650:0:8395:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746066761.133657:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa7e06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2026 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.133665:0:8395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa7e06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2026 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.133687:0:8395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4ecec00/0xf1867c21abfa7e06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d2026 expref: 27 pid: 11630 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746066761.133696:0:8395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984505216:192.168.204.16@tcp:105: 00000100:00100000:1.0:1746066761.133870:0:8395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746066761.135260:0:8395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8395:1830882984505216:192.168.204.16@tcp:105: 00010000:00010000:1.0:1746066761.135272:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746066761.135286:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.135336:0:11630:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363456 00000100:00100000:3.0:1746066761.135340:0:11630:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363456 00000100:00100000:3.0:1746066761.135376:0:11630:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16321 00000100:00100000:3.0:1746066761.135383:0:11630:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983363456:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:1.0:1746066761.135507:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009677f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983363200:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 1971us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.135515:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7371 00000100:00100000:2.0:1746066761.135577:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.135654:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363712 00000100:00100000:1.0:1746066761.135657:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363712 00000100:00100000:1.0:1746066761.135682:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16322 00000100:00100000:1.0:1746066761.135687:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+19:2015:x1830882983363712:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:1.0:1746066761.135813:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746066761.135816:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:1.0:1746066761.135818:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066759 -> 1746066760 00002000:00010000:1.0:1746066761.135820:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066760 -> 1746066762 00002000:00010000:1.0:1746066761.135821:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:3.0:1746066761.135827:0:11630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746066761.135829:0:11630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066759 -> 1746066760 00002000:00010000:3.0:1746066761.135830:0:11630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066759 -> 1746066760 00002000:00010000:3.0:1746066761.135832:0:11630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066759 -> 1746066762 00002000:00010000:3.0:1746066761.135833:0:11630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746066761.135841:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+20:2015:x1830882983363712:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 154us (264us total) trans 21474841924 rc 0/0 00000100:00100000:1.0:1746066761.135846:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16322 00000100:00100000:3.0:1746066761.135847:0:11630:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a932635-1bad-46b9-b237-470f1d1c8595+28:2015:x1830882983363456:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 465us (562us total) trans 17179874468 rc 0/0 00000100:00100000:3.0:1746066761.135852:0:11630:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16321 00000100:00100000:2.0:1746066761.136014:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.136041:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.136053:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.136073:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.136210:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363968 00000100:00100000:3.0:1746066761.136213:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363968 00000100:00100000:3.0:1746066761.136230:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363328 00000100:00100000:3.0:1746066761.136232:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363328 00000100:00100000:1.0:1746066761.136234:0:9591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363584 00000100:00100000:1.0:1746066761.136236:0:9591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363584 00000100:00100000:3.0:1746066761.136242:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983363840 00000100:00100000:3.0:1746066761.136243:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983363840 00000100:00100000:1.0:1746066761.136250:0:9591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16323 00000100:00100000:1.0:1746066761.136254:0:9591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:2015:x1830882983363968:12345-192.168.204.16@tcp:2:lfs.0 00000100:00100000:3.0:1746066761.136257:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16324 00000100:00100000:3.0:1746066761.136261:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983363328:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066761.136296:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066761.136296:0:9591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746066761.136298:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066759 -> 1746066760 00002000:00010000:1.0:1746066761.136298:0:9591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:3.0:1746066761.136300:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066758 -> 1746066760 00002000:00010000:1.0:1746066761.136300:0:9591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066760 -> 1746066760 00002000:00010000:3.0:1746066761.136302:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066758 -> 1746066762 00002000:00010000:1.0:1746066761.136303:0:9591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066760 -> 1746066762 00002000:00010000:3.0:1746066761.136304:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746066761.136304:0:9591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066761.136386:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16325 00000100:00100000:2.0:1746066761.136393:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983363584:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:2.0:1746066761.136451:0:12237:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066761.136454:0:12237:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:2.0:1746066761.136456:0:12237:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066759 -> 1746066760 00002000:00010000:2.0:1746066761.136457:0:12237:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066759 -> 1746066762 00002000:00010000:2.0:1746066761.136459:0:12237:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746066761.136490:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983363328:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 227us (447us total) trans 21474841925 rc 0/0 00000100:00100000:3.0:1746066761.136495:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16324 00000100:00100000:3.0:1746066761.136507:0:9592:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16326 00000100:00100000:3.0:1746066761.136511:0:9592:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+21:2015:x1830882983363840:12345-192.168.204.16@tcp:2:lfs.0 00002000:00010000:3.0:1746066761.136550:0:9592:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:3.0:1746066761.136552:0:9592:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:3.0:1746066761.136554:0:9592:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066759 -> 1746066760 00002000:00010000:3.0:1746066761.136555:0:9592:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066760 -> 1746066762 00002000:00010000:3.0:1746066761.136557:0:9592:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:1.0:1746066761.136583:0:9591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a932635-1bad-46b9-b237-470f1d1c8595+31:2015:x1830882983363968:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 327us (568us total) trans 17179874469 rc 0/0 00000100:00100000:1.0:1746066761.136589:0:9591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16323 00000100:00100000:2.0:1746066761.136750:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4a932635-1bad-46b9-b237-470f1d1c8595+30:2015:x1830882983363584:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 358us (694us total) trans 17179874470 rc 0/0 00000100:00100000:2.0:1746066761.136756:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16325 00000100:00100000:3.0:1746066761.136828:0:9592:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a932635-1bad-46b9-b237-470f1d1c8595+22:2015:x1830882983363840:12345-192.168.204.16@tcp:2:lfs.0 Request processed in 316us (754us total) trans 21474841926 rc 0/0 00000100:00100000:3.0:1746066761.136834:0:9592:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16326 00000100:00100000:0.0:1746066761.137841:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.137905:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983364224 00000100:00100000:1.0:1746066761.137911:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983364224 00000100:00100000:1.0:1746066761.137939:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16357 00000100:00100000:1.0:1746066761.137944:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+30:915:x1830882983364224:12345-192.168.204.16@tcp:55:lfs.0 00010000:00010000:1.0:1746066761.137988:0:7244:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066761.138003:0:7244:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751000/0xf1867c21abf9ca21 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caffc expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.138011:0:7244:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 4/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066761.138035:0:7244:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095751000/0xf1867c21abf9ca21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caffc expref: 30 pid: 10125 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746066761.138044:0:7244:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095751000/0xf1867c21abf9ca21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caffc expref: 30 pid: 10125 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746066761.138053:0:7244:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984505344:192.168.204.16@tcp:104: 00000100:00100000:1.0:1746066761.138113:0:7244:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5f31d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746066761.139144:0:7244:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7244:1830882984505344:192.168.204.16@tcp:104: 00010000:00010000:1.0:1746066761.139159:0:7244:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:0.0:1746066761.139266:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:1.0:1746066761.139402:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983364352 00000100:00100000:1.0:1746066761.139406:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983364352 00010000:00010000:1.0:1746066761.139427:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095751000/0xf1867c21abf9ca21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caffc expref: 31 pid: 10125 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746066761.139456:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7372 00000100:00100000:1.0:1746066761.139461:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+31:2016:x1830882983364352:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.139470:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066761.139474:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095751000/0xf1867c21abf9ca21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caffc expref: 31 pid: 10125 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066761.139484:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095751000/0xf1867c21abf9ca21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caffc expref: 31 pid: 10125 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066761.139502:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095751000/0xf1867c21abf9ca21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x56:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14caffc expref: 31 pid: 10125 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066761.139516:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066761.139520:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066761.139526:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066761.139532:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7244 initiator: MDT0 00010000:00010000:1.0:1746066761.139554:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746066761.139579:0:7244:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066761.139583:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983364352:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 121us (317us total) trans 0 rc 0/0 00010000:00010000:2.0:1746066761.139585:0:7244:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7244 initiator: MDT0 00000100:00100000:1.0:1746066761.139589:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7372 00010000:00010000:2.0:1746066761.139616:0:7244:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066761.139627:0:7244:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066761.139632:0:7244:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066761.139638:0:7244:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098f9ca00 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066761.139641:0:7244:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066761.139647:0:7244:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066761.139655:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066761.139658:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1746066761.139661:0:7244:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00010000:00010000:2.0:1746066761.139665:0:7244:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f9ca00/0xf1867c21abfa7e0d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7244 initiator: MDT0 00000100:00100000:2.0:1746066761.139696:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:915:x1830882983364224:12345-192.168.204.16@tcp:55:lfs.0 Request processed in 1752us (1855us total) trans 0 rc -22/-22 00000100:00100000:2.0:1746066761.139704:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16357 00000100:00100000:0.0:1746066761.140593:0:3769:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.140664:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983364608 00000100:00100000:3.0:1746066761.140668:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983364608 00000100:00100000:3.0:1746066761.140706:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5980 00000100:00100000:3.0:1746066761.140711:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a4ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+29:915:x1830882983364608:12345-192.168.204.16@tcp:35:lfs.0 00000004:00010000:3.0:1746066761.140750:0:7247:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x56:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70200/0xf1867c21abfa7d26 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fc4 expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.140778:0:7247:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746066761.140786:0:7247:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.140792:0:7247:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746066761.140811:0:7247:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 29 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746066761.140824:0:7247:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 29 pid: 7244 timeout: 829 lvb_type: 0 00000100:00100000:3.0:1746066761.140833:0:7247:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830882984505472:192.168.204.16@tcp:104: 00000100:00100000:3.0:1746066761.140926:0:7247:0:(client.c:2553:ptlrpc_set_wait()) set ffff880083e76540 going to sleep for 11 seconds 00000100:00100000:0.0:1746066761.142348:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.142433:0:7247:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7247:1830882984505472:192.168.204.16@tcp:104: 00010000:00010000:3.0:1746066761.142449:0:7247:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746066761.142596:0:8395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983364736 00000100:00100000:1.0:1746066761.142601:0:8395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983364736 00010000:00010000:1.0:1746066761.142622:0:8395:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 30 pid: 7244 timeout: 829 lvb_type: 0 00000100:00100000:1.0:1746066761.142650:0:8395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 7373 00000100:00100000:1.0:1746066761.142656:0:8395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+30:2016:x1830882983364736:12345-192.168.204.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746066761.142664:0:8395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746066761.142669:0:8395:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 30 pid: 7244 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066761.142679:0:8395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 30 pid: 7244 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066761.142693:0:8395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e363600/0xf1867c21abfa7d65 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fcb expref: 30 pid: 7244 timeout: 829 lvb_type: 0 00010000:00010000:1.0:1746066761.142706:0:8395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066761.142710:0:8395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746066761.142717:0:8395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746066761.142723:0:8395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7247 initiator: MDT0 00010000:00010000:1.0:1746066761.142741:0:8395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746066761.142774:0:8395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b54f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a932635-1bad-46b9-b237-470f1d1c8595+29:2016:x1830882983364736:12345-192.168.204.16@tcp:103:ldlm_bl.0 Request processed in 117us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.142780:0:8395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 7373 00010000:00010000:3.0:1746066761.142880:0:7247:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746066761.142909:0:7247:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00000040:00080000:3.0:1746066761.143153:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].672, 88 off66856 00000004:00080000:3.0:1746066761.143159:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354275066ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143183:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].601, 88 off60688 00000004:00080000:3.0:1746066761.143187:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354303460ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066761.143202:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].602, 88 off60776 00000004:00080000:3.0:1746066761.143204:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354320872ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066761.143211:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].673, 88 off66944 00000004:00080000:3.0:1746066761.143213:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354329820ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143219:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].674, 88 off67032 00000004:00080000:3.0:1746066761.143222:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354338351ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143232:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].603, 88 off60864 00000004:00080000:3.0:1746066761.143235:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354351636ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066761.143247:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].604, 88 off60952 00000004:00080000:3.0:1746066761.143249:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354365841ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066761.143547:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].605, 88 off61040 00000004:00080000:3.0:1746066761.143552:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354668831ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066761.143579:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].675, 88 off67120 00000004:00080000:3.0:1746066761.143583:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354699501ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143606:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].606, 88 off61128 00000004:00080000:3.0:1746066761.143609:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354726125ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066761.143617:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].676, 88 off67208 00000004:00080000:3.0:1746066761.143620:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354736781ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143629:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].607, 88 off61216 00000004:00080000:3.0:1746066761.143632:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354748556ns, next at 665959948938ns, rc = 0 00000040:00080000:3.0:1746066761.143687:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].677, 88 off67296 00000004:00080000:3.0:1746066761.143691:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354807883ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143714:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].678, 88 off67384 00000004:00080000:3.0:1746066761.143717:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354833920ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143726:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].679, 88 off67472 00000004:00080000:3.0:1746066761.143729:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354845495ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143737:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].680, 88 off67560 00000004:00080000:3.0:1746066761.143739:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 729354855936ns, next at 665943319442ns, rc = 0 00000040:00080000:3.0:1746066761.143748:0:7247:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].608, 88 off61304 00000004:00080000:3.0:1746066761.143751:0:7247:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 729354868186ns, next at 665959948938ns, rc = 0 00000001:00080000:2.0:1746066761.145175:0:8132:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936700 is committed 00000004:00080000:2.0:1746066761.145181:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 598 committed 00000004:00080000:2.0:1746066761.145193:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 668 committed 00000004:00080000:2.0:1746066761.145196:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 667 committed 00000004:00080000:2.0:1746066761.145198:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 666 committed 00000004:00080000:2.0:1746066761.145199:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 665 committed 00000004:00080000:2.0:1746066761.145201:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 597 committed 00000004:00080000:2.0:1746066761.145202:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 664 committed 00000004:00080000:2.0:1746066761.145204:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 596 committed 00000004:00080000:2.0:1746066761.145205:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 663 committed 00000004:00080000:2.0:1746066761.145207:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 595 committed 00000004:00080000:2.0:1746066761.145208:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 594 committed 00000004:00080000:2.0:1746066761.145209:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 593 committed 00000004:00080000:2.0:1746066761.145210:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 662 committed 00000004:00080000:2.0:1746066761.145212:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 661 committed 00000004:00080000:2.0:1746066761.145213:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 592 committed 00000004:00080000:2.0:1746066761.145214:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 591 committed 00000004:00080000:2.0:1746066761.145216:0:8132:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 660 committed 00010000:00010000:1.0:1746066761.145412:0:3760:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066761.145422:0:3760:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066761.145428:0:3760:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066761.145433:0:3760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f21800 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:1.0:1746066761.145436:0:3760:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13370 initiator: MDT0 00010000:00010000:1.0:1746066761.145442:0:3760:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13370 initiator: MDT0 00000100:00100000:2.0:1746066761.145636:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746066761.145652:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984505600:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746066761.145673:0:3760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:1.0:1746066761.145676:0:3760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746066761.145680:0:3760:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00000100:00100000:0.0:1746066761.145680:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984505728:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746066761.145685:0:3760:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f21800/0xf1867c21abfa7ddc lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13370 initiator: MDT0 00000100:00100000:1.0:1746066761.145704:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984506112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.145725:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066761.145741:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.145749:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.145761:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.145772:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066761.145776:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984505856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.145789:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.145797:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.145809:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.145829:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984505728 00000100:00100000:0.0:1746066761.145833:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984505728 00000100:00100000:0.0:1746066761.145855:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984506112 00000100:00100000:0.0:1746066761.145857:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984506112 00000100:00100000:0.0:1746066761.145866:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984506240 00000100:00100000:0.0:1746066761.145867:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984506240 00000100:00100000:0.0:1746066761.145875:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984505856 00000100:00100000:0.0:1746066761.145876:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984505856 00000100:00100000:0.0:1746066761.145902:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984506368 00000100:00100000:0.0:1746066761.145905:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984506368 00000100:00100000:0.0:1746066761.145916:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16327 00000100:00100000:0.0:1746066761.145922:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3776:x1830882984505728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066761.145927:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066761.146021:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066761.146024:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:0.0:1746066761.146026:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746066760 -> 1746066760 00002000:00010000:0.0:1746066761.146028:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746066762 -> 1746066762 00002000:00010000:0.0:1746066761.146030:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746066761.146471:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984505984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.146477:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882984505728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 554us (752us total) trans 17179874471 rc 0/0 00000100:00100000:0.0:1746066761.146483:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16327 00000100:00100000:2.0:1746066761.146491:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.146494:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984505600 00000100:00100000:0.0:1746066761.146496:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984505600 00000100:00100000:2.0:1746066761.146500:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984506496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.146504:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984505984 00000100:00100000:0.0:1746066761.146506:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984505984 00000100:00100000:0.0:1746066761.146512:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16328 00000100:00100000:2.0:1746066761.146513:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.146516:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3775:x1830882984506112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066761.146533:0:20361:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984506496 00000100:00100000:2.0:1746066761.146537:0:20361:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984506496 00000100:00100000:2.0:1746066761.146553:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16329 00000100:00100000:2.0:1746066761.146557:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984506240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.146562:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984506112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (821us total) trans 17179874472 rc 0/0 00000100:00100000:0.0:1746066761.146567:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16328 00000100:00100000:0.0:1746066761.146576:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16330 00000100:00100000:0.0:1746066761.146579:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880072aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882984505856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746066761.146608:0:12255:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746066761.146610:0:12255:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:0.0:1746066761.146612:0:12255:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 1746066760 -> 1746066760 00002000:00010000:0.0:1746066761.146614:0:12255:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746066762 -> 1746066762 00002000:00010000:0.0:1746066761.146616:0:12255:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 4096 -> 4096 00000100:00100000:2.0:1746066761.146621:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984506240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (858us total) trans 17179874473 rc 0/0 00000100:00100000:2.0:1746066761.146627:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16329 00000100:00100000:0.0:1746066761.146630:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880072aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984505856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (840us total) trans 17179874474 rc 0/0 00000100:00100000:0.0:1746066761.146635:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16330 00000100:00100000:2.0:1746066761.146638:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16331 00000100:00100000:2.0:1746066761.146642:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882984506368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746066761.146697:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984506368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (886us total) trans 17179874475 rc 0/0 00000100:00100000:2.0:1746066761.146701:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16331 00000100:00100000:2.0:1746066761.146710:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16332 00000100:00100000:2.0:1746066761.146713:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3774:x1830882984505600:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746066761.146735:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16333 00000100:00100000:0.0:1746066761.146739:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882984505984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746066761.146747:0:20361:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746066761.146750:0:20361:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:2.0:1746066761.146752:0:20361:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746066760 -> 1746066760 00002000:00010000:2.0:1746066761.146753:0:20361:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746066762 -> 1746066762 00002000:00010000:2.0:1746066761.146755:0:20361:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000004:00080000:1.0:1746066761.146824:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c490700/2, rc 0, transno 17179874472 00000100:00100000:1.0:1746066761.146829:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984506112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066761.146846:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16334 00000100:00100000:1.0:1746066761.146853:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882984506496:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746066761.147392:0:7247:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008a4ea050 reply state ffff8800956b4c00 transno 8589936700 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746066761.147414:0:7247:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:3.0:1746066761.147425:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066761.147427:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746066761.147430:0:7247:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746066761.147434:0:7247:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:3.0:1746066761.147436:0:7247:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746066761.147441:0:7247:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d70200/0xf1867c21abfa7d26 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x56:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d1fc4 expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746066761.148032:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984505600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1317us (2104us total) trans 17179874476 rc 0/0 00000100:00100000:2.0:1746066761.148038:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16332 00000100:00100000:0.0:1746066761.148045:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984505984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1304us (1551us total) trans 17179874477 rc 0/0 00000100:00100000:0.0:1746066761.148051:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16333 00000004:00080000:2.0:1746066761.148061:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c493100/2, rc 0, transno 17179874477 00000100:00100000:2.0:1746066761.148064:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984505984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746066761.148071:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54ce00/2, rc 0, transno 17179874476 00000100:00100000:2.0:1746066761.148074:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984505600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066761.148079:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c492d80/2, rc 0, transno 17179874474 00000100:00100000:0.0:1746066761.148082:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984505856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066761.148089:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c491500/2, rc 0, transno 17179874475 00000100:00100000:0.0:1746066761.148091:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066761.148097:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b54d180/2, rc 0, transno 17179874471 00000100:00100000:0.0:1746066761.148099:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b54d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984505728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746066761.148104:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c492680/2, rc 0, transno 17179874473 00000100:00100000:0.0:1746066761.148106:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506240:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746066761.148181:0:7247:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746066761.148192:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a4ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:915:x1830882983364608:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 7480us (7599us total) trans 8589936700 rc 0/0 00000100:00100000:3.0:1746066761.148199:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5980 00000100:00100000:1.0:1746066761.148290:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3774:x1830882984506496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1438us (1775us total) trans 17179874478 rc 0/0 00000100:00100000:1.0:1746066761.148296:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16334 00000004:00080000:3.0:1746066761.148350:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb76300/2, rc 0, transno 17179874478 00000100:00100000:3.0:1746066761.148353:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984506496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746066761.148539:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984506624:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746066761.148548:0:3761:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746066761.148558:0:3761:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746066761.148562:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746066761.148563:0:3761:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746066761.148567:0:3761:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ece600 already unused, calling callback (ffffffffa0f1c690) 00010000:00010000:2.0:1746066761.148570:0:3761:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746066761.148577:0:3761:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746066761.148581:0:3528:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984506624 00000100:00100000:1.0:1746066761.148584:0:3528:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984506624 00010000:00010000:2.0:1746066761.148586:0:3761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a7fe1400) 00010000:00010000:2.0:1746066761.148588:0:3761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066761.148591:0:3761:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00010000:00010000:2.0:1746066761.148596:0:3761:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4ece600/0xf1867c21abfa7e14 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7247 initiator: MDT0 00000100:00100000:1.0:1746066761.148602:0:3528:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16335 00000100:00100000:1.0:1746066761.148606:0:3528:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3775:x1830882984506624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.148749:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.148766:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.148781:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984507264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.148793:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.148804:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746066761.148808:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.148819:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.148826:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984507392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.148836:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.148849:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984506752 00000100:00100000:0.0:1746066761.148852:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984506752 00000100:00100000:0.0:1746066761.148869:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507264 00000100:00100000:0.0:1746066761.148871:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507264 00000100:00100000:0.0:1746066761.148880:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984506880 00000100:00100000:1.0:1746066761.148895:0:12233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507392 00000100:00100000:0.0:1746066761.148895:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984506880 00000100:00100000:1.0:1746066761.148898:0:12233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507392 00000100:00100000:0.0:1746066761.148906:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16336 00000100:00100000:1.0:1746066761.148910:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16337 00000100:00100000:0.0:1746066761.148911:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882984506752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066761.148914:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3776:x1830882984507264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066761.148951:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984507136:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066761.148964:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746066761.148967:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00000100:00100000:1.0:1746066761.148969:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746066761.148969:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746066760 -> 1746066760 00002000:00010000:0.0:1746066761.148971:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746066762 -> 1746066762 00002000:00010000:0.0:1746066761.148973:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746066761.148979:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746066761.148983:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984507008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.148990:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3776:x1830882984506752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (224us total) trans 21474841928 rc 0/0 00000100:00100000:1.0:1746066761.148994:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.148995:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16336 00000100:00100000:1.0:1746066761.149000:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984507520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.149004:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507136 00000100:00100000:0.0:1746066761.149006:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507136 00000100:00100000:1.0:1746066761.149010:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.149013:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507008 00000100:00100000:0.0:1746066761.149014:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507008 00000100:00100000:0.0:1746066761.149019:0:13363:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507520 00000100:00100000:0.0:1746066761.149021:0:13363:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507520 00000100:00100000:0.0:1746066761.149028:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16338 00000100:00100000:0.0:1746066761.149031:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984506880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066761.149039:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984507264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (245us total) trans 21474841927 rc 0/0 00000100:00100000:1.0:1746066761.149044:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16337 00000100:00100000:1.0:1746066761.149052:0:12233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16339 00000100:00100000:1.0:1746066761.149056:0:12233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3776:x1830882984507392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746066761.149065:0:13363:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb size from disk: 5031040 -> 5031040 00002000:00010000:0.0:1746066761.149067:0:13363:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00002000:00010000:0.0:1746066761.149070:0:13363:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb atime from disk: 1746066760 -> 1746066760 00002000:00010000:0.0:1746066761.149072:0:13363:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb ctime from disk: 1746066762 -> 1746066762 00002000:00010000:0.0:1746066761.149074:0:13363:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9a:0x0] updating lvb blocks from disk: 5736 -> 5736 00000100:00100000:0.0:1746066761.149090:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3776:x1830882984506880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (270us total) trans 21474841929 rc 0/0 00000100:00100000:0.0:1746066761.149095:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16338 00000100:00100000:0.0:1746066761.149105:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16340 00000100:00100000:0.0:1746066761.149109:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984507136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.149159:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984507136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (189us total) trans 21474841930 rc 0/0 00000100:00100000:0.0:1746066761.149164:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16340 00000100:00100000:0.0:1746066761.149172:0:13363:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16341 00000100:00100000:0.0:1746066761.149176:0:13363:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984507008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066761.149186:0:20361:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16342 00000100:00100000:2.0:1746066761.149193:0:20361:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984507520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066761.149213:0:12233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3776:x1830882984507392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (374us total) trans 21474841931 rc 0/0 00000004:00080000:0.0:1746066761.149213:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb75880/2, rc 0, transno 21474841929 00000100:00100000:1.0:1746066761.149218:0:12233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16339 00000100:00100000:0.0:1746066761.149219:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066761.149225:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095cedf80/2, rc 0, transno 21474841931 00000100:00100000:0.0:1746066761.149227:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095cedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984507392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746066761.149233:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb75500/2, rc 0, transno 21474841928 00000004:00080000:1.0:1746066761.149234:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb74a80/2, rc 0, transno 21474841930 00000100:00100000:0.0:1746066761.149235:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984506752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746066761.149236:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984507136:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746066761.149262:0:3528:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746066761.149264:0:3528:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746066760 -> 1746066760 00000100:00100000:2.0:1746066761.149265:0:20361:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3775:x1830882984507520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (253us total) trans 21474841933 rc 0/0 00002000:00010000:1.0:1746066761.149266:0:3528:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746066760 -> 1746066760 00002000:00010000:1.0:1746066761.149267:0:3528:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746066762 -> 1746066762 00002000:00010000:1.0:1746066761.149269:0:3528:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746066761.149271:0:20361:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16342 00000100:00100000:1.0:1746066761.149462:0:3528:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882984506624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 854us (898us total) trans 21474841934 rc 0/0 00000004:00080000:0.0:1746066761.149464:0:3776:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb76d80/2, rc 0, transno 21474841927 00000100:00100000:1.0:1746066761.149467:0:3528:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16335 00000100:00100000:0.0:1746066761.149467:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984507264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066761.149473:0:13363:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3775:x1830882984507008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 295us (476us total) trans 21474841932 rc 0/0 00000100:00100000:2.0:1746066761.149478:0:13363:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16341 00000004:00080000:1.0:1746066761.149483:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb77480/2, rc 0, transno 21474841932 00000100:00100000:1.0:1746066761.149486:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984507008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066761.149489:0:3774:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1746066761.149492:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a5c00/2, rc 0, transno 21474841933 00000100:00100000:1.0:1746066761.149494:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984507520:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066761.149496:0:3774:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984507648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746066761.149500:0:3775:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bb77b80/2, rc 0, transno 21474841934 00000100:00100000:1.0:1746066761.149502:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984506624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066761.149513:0:3774:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066761.149547:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507648 00000100:00100000:2.0:1746066761.149550:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507648 00000100:00100000:2.0:1746066761.149565:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16343 00000100:00100000:2.0:1746066761.149569:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3774:x1830882984507648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746066761.150113:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3774:x1830882984507648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 543us (598us total) trans 21474841935 rc 0/0 00000100:00100000:2.0:1746066761.150119:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16343 00000004:00080000:0.0:1746066761.150210:0:3774:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800958a7100/2, rc 0, transno 21474841935 00000100:00100000:0.0:1746066761.150214:0:3774:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800958a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3774:1830882984507648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746066761.151112:0:3768:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:2.0:1746066761.151214:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983364864 00000100:00100000:2.0:1746066761.151219:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983364864 00000100:00100000:2.0:1746066761.151259:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 16358 00000100:00100000:2.0:1746066761.151265:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+25:915:x1830882983364864:12345-192.168.204.16@tcp:101:lfs.0 00010000:00010000:2.0:1746066761.151281:0:7244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746066761.151297:0:7244:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfa7e1b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c8f5161c14d202d expref: -99 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.151347:0:7244:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfa7e1b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d202d expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.151360:0:7244:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097c14e00/0xf1867c21abfa7e1b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.16@tcp remote: 0x1c8f5161c14d202d expref: 26 pid: 7244 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746066761.151381:0:7244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x56:0x0].0x0 (ffff8800a5746b00) 00010000:00010000:2.0:1746066761.151384:0:7244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746066761.151387:0:7244:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097c14e00, rc 0) 00000100:00100000:2.0:1746066761.151442:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:915:x1830882983364864:12345-192.168.204.16@tcp:101:lfs.0 Request processed in 176us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.151451:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 16358 00000100:00100000:0.0:1746066761.155119:0:3767:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.16@tcp (source: 12345-192.168.204.16@tcp) 00000100:00100000:3.0:1746066761.155143:0:7247:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882983365120 00000100:00100000:3.0:1746066761.155198:0:7247:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882983365120 00000100:00100000:3.0:1746066761.155251:0:7247:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.16@tcp, seq: 5981 00000100:00100000:3.0:1746066761.155259:0:7247:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+26:915:x1830882983365120:12345-192.168.204.16@tcp:35:lfs.0 00000100:00100000:3.0:1746066761.155471:0:7247:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a932635-1bad-46b9-b237-470f1d1c8595+27:915:x1830882983365120:12345-192.168.204.16@tcp:35:lfs.0 Request processed in 212us (359us total) trans 8589936701 rc 0/0 00000100:00100000:3.0:1746066761.155477:0:7247:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.16@tcp, seq: 5981 00010000:00010000:2.0:1746066761.526216:0:12257:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1746066761.720712:0:13428:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed 00000100:00100000:0.0:1746066761.820198:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882984507776:0@lo:400:kworker.0 00000100:00100000:0.0:1746066761.820269:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.820326:0:3776:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746066761.820332:0:3776:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984507904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746066761.820357:0:3776:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746066761.820399:0:8136:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507776 00000100:00100000:0.0:1746066761.820406:0:8136:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507776 00000100:00100000:0.0:1746066761.820446:0:8136:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1746066761.820453:0:8136:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3776:x1830882984507776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746066761.820491:0:8136:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28b87956-2543-42c1-b799-d011d2dfefc7+23:3776:x1830882984507776:12345-0@lo:400:kworker.0 Request processed in 39us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066761.820497:0:8136:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1746066761.820528:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984507904 00000100:00100000:0.0:1746066761.820530:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984507904 00000100:00100000:0.0:1746066761.820548:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1746066761.820552:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984507904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746066761.820578:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445572608 avail 1316110336 00000100:00100000:0.0:1746066761.820603:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800958a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3776:x1830882984507904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746066761.820608:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1746066761.820639:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3776:1830882984507904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746066761.820646:0:3776:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28b87956-2543-42c1-b799-d011d2dfefc7:3776:1830882984507776:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.820799:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3775:1830882984508160:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.820828:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066761.820843:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3775:1830882984508672:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.820857:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066761.820970:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984508416:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.820999:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066761.821017:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3777:1830882984508928:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.821037:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508416 00000100:00100000:2.0:1746066761.821039:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508416 00000100:00100000:2.0:1746066761.821072:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1746066761.821076:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984508416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.821103:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984508416:12345-0@lo:400:kworker.0 Request processed in 27us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.821109:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00080000:2.0:1746066761.821123:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746066761.821192:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509184:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821210:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066761.821222:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746066761.821226:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984508032:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821239:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066761.821247:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3775:1830882984508544:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821262:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066761.821324:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509056:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821340:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066761.821356:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984509184 00000100:00100000:1.0:1746066761.821359:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984509184 00000100:00100000:1.0:1746066761.821375:0:12255:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984509056 00000100:00100000:1.0:1746066761.821376:0:12255:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984509056 00000100:00100000:1.0:1746066761.821399:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1746066761.821403:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984509184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821427:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b165f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984509184:12345-0@lo:400:kworker.0 Request processed in 24us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.821431:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1746066761.821440:0:12255:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1746066761.821443:0:12255:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882984509056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821461:0:12255:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882984509056:12345-0@lo:400:kworker.0 Request processed in 18us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.821465:0:12255:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1746066761.821479:0:7249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508032 00000100:00100000:1.0:1746066761.821481:0:7249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508032 00000100:00100000:1.0:1746066761.821495:0:7249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1746066761.821499:0:7249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882984508032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821520:0:7249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3775:x1830882984508032:12345-0@lo:400:kworker.0 Request processed in 21us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.821525:0:7249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1746066761.821539:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3775:1830882984508032:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821547:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b165c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509056:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.821554:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b166680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509184:0@lo:400:kworker.0 00000100:00100000:3.0:1746066761.821658:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508160 00000100:00100000:3.0:1746066761.821662:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508160 00000100:00100000:3.0:1746066761.821686:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508672 00000100:00100000:3.0:1746066761.821688:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508672 00000100:00100000:3.0:1746066761.821713:0:13370:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508544 00000100:00100000:3.0:1746066761.821716:0:13370:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508544 00000100:00100000:3.0:1746066761.821730:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1746066761.821735:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3775:x1830882984508160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066761.821763:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3775:x1830882984508160:12345-0@lo:400:kworker.0 Request processed in 29us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.821768:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1746066761.821778:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1746066761.821782:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3775:x1830882984508672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066761.821800:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3775:x1830882984508672:12345-0@lo:400:kworker.0 Request processed in 18us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.821804:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1746066761.821811:0:13370:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1746066761.821814:0:13370:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3775:x1830882984508544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746066761.821829:0:13370:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3775:x1830882984508544:12345-0@lo:400:kworker.0 Request processed in 15us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.821833:0:13370:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00080000:2.0:1746066761.821900:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746066761.821903:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746066761.821911:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066761.821936:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984508416:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.821943:0:3777:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1746066761.821948:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984508288:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.821963:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066761.821974:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882984508800:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.821988:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066761.821996:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3777:1830882984509312:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822010:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746066761.822023:0:12237:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508288 00000100:00100000:2.0:1746066761.822026:0:12237:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508288 00000100:00100000:2.0:1746066761.822045:0:12237:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:2.0:1746066761.822049:0:12237:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984508288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822070:0:12237:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3777:x1830882984508288:12345-0@lo:400:kworker.0 Request processed in 21us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.822075:0:12237:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00080000:2.0:1746066761.822084:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746066761.822088:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508928 00000100:00100000:2.0:1746066761.822090:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508928 00000100:00100000:2.0:1746066761.822103:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984508800 00000100:00100000:2.0:1746066761.822105:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984508800 00000100:00100000:2.0:1746066761.822114:0:7244:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984509312 00000100:00100000:2.0:1746066761.822116:0:7244:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984509312 00000100:00100000:2.0:1746066761.822124:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1746066761.822127:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3777:x1830882984508928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822149:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3777:x1830882984508928:12345-0@lo:400:kworker.0 Request processed in 21us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.822153:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1746066761.822160:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1746066761.822163:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984508800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822179:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3777:x1830882984508800:12345-0@lo:400:kworker.0 Request processed in 15us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.822183:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1746066761.822189:0:7244:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1746066761.822193:0:7244:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3777:x1830882984509312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822207:0:7244:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3777:x1830882984509312:12345-0@lo:400:kworker.0 Request processed in 15us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746066761.822214:0:7244:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00080000:2.0:1746066761.822222:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746066761.822223:0:7241:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746066761.822233:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984508288:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822240:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3777:1830882984508800:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822247:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3777:1830882984509312:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.822254:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3777:1830882984508928:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.822420:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3775:1830882984508544:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.822430:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3775:1830882984508160:0@lo:400:kworker.0 00000100:00100000:1.0:1746066761.822437:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3775:1830882984508672:0@lo:400:kworker.0 00000100:00100000:2.0:1746066761.836129:0:3777:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984509440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746066761.836195:0:3777:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746066761.836360:0:7248:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984509440 00000100:00100000:1.0:1746066761.836369:0:7248:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984509440 00000100:00100000:1.0:1746066761.836414:0:7248:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1746066761.836422:0:7248:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882984509440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746066761.836455:0:7248:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445642240 avail 1316179968 00000100:00100000:1.0:1746066761.836502:0:7248:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3777:x1830882984509440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746066761.836507:0:7248:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1746066761.836569:0:3777:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012faf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3777:1830882984509440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746066761.836699:0:3775:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746066761.836706:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746066761.836727:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066761.836832:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984509568 00000100:00100000:3.0:1746066761.836835:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984509568 00000100:00100000:3.0:1746066761.836879:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1746066761.837014:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882984509568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746066761.837035:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490125760 pending 0 free 3906408448 avail 3674886144 00000100:00100000:3.0:1746066761.837151:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3775:x1830882984509568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.837156:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1746066761.837224:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5d7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746066761.868185:0:3775:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746066761.868256:0:3775:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746066761.868490:0:9594:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830882984509696 00000100:00100000:3.0:1746066761.868499:0:9594:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830882984509696 00000100:00100000:3.0:1746066761.868540:0:9594:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1746066761.868548:0:9594:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984509696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746066761.868588:0:9594:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490126656 pending 0 free 3912097792 avail 3680575488 00000100:00100000:3.0:1746066761.868631:0:9594:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3775:x1830882984509696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746066761.868637:0:9594:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1746066761.868715:0:3775:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ea24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3775:1830882984509696:0@lo:13:osp-pre-1-0.0 Debug log: 70011 lines, 70011 kept, 0 dropped, 0 bad.